Profile pic is from Jason Box, depicting a projection of Arctic warming to the year 2100 based on current trends.

  • 0 Posts
  • 1.69K Comments
Joined 2 years ago
cake
Cake day: March 3rd, 2024

help-circle














  • selectivity based on probability and not weighing on evidence

    I don’t follow this, but an LLM’s whole “world” is basically the prompt it’s fed. It can “weigh” that, but then how does one choose what’s in the prompt?

    Some describe or use the analogy of an autocompleter with a very big database. LLMs are more complex than just that, but that’s the idea, and when the model looks at the prompt and context of the conversation, it’s choosing the best match of words to fulfill that prompt. My point was that the best word or phrase completion doesn’t mean it’s the best answer, or even right. It’s just seen as the most probabilistic in the huge training data. If that data is crap, the answers are crap. Having Wikipedia as a source and presumably the only source is better than many places on the internet to pull from, but that doesn’t guarantee the answers that pop up will be always correct or the best in a choice of answers. It’s just the most likely based on the data.

    It would be different if it was AGI because by definition it would be able to find the best data based on the data itself, not text probability, and could look at anything connected including discussion behind the article and make a judgement on how solid the information is for the prompt in question. We don’t have that yet. Maybe we will, maybe we won’t for any number of reasons.





  • An LLM with a cultivating source is a lot better than what the other major ones are, but it still has the issue of selectivity based on probability and not weighing on evidence (unless it does that, which would be huge). Because people are naturally gullible and believe the first thing they read, especially if it’s presented as if “someone” has validated it for them.

    But the good part is that both DDG and Firefox made it both obvious and easy to disable the AI.