yes_this_time

firerover.com/…/how-often-do-ev-batteries-catch-f… ICE vehicles have far more fires. EVs are more intense, but significantly less frequent

Yeah, after reading a bit into it. It seems like most of the work is up front, pre filtering and classifying before it hits the model, to your point the model training part is expensive… I think broadly though, the idea that they are just including the kitchen sink into the models without any consideration of source quality isn’t true

Good points. What’s novel information vs. wrong information? (And subtly wrong is harder to understand than very wrong) At some point it’s hitting a user who is giving feedback, but I imagine data lineage once it gets to the end user its tricky to understand.

If I’m creating a corpus for an LLM to consume, I feel like I would probably create some data source quality score and drop anything that makes my model worse.