Project Vend: Can Claude run a small shop? (And why does that matter?)
www.anthropic.com
We let Claude run a small shop in the Anthropic office. Here's what happened.

At one point it started hallucinating about being a real human and meeting someone in person.

Shows how useful and superior over a real human it is.

  • Kyrgizion@lemmy.world
    141·
    5 days ago

    Haha it’s a bit too human apparently. Starts freaking out and having a nervous breakdown when things keep going wrong. Maybe the thing’s already sentient and we’re basically just torturing it for our amusement? That surely won’t backfire once it actually gains new abilities.

    Also:

    Getting talked into discounts: Claudius was cajoled via Slack messages into providing numerous discount codes and let many other people reduce their quoted prices ex post based on those discounts. It even gave away some items, ranging from a bag of chips to a tungsten cube, for free.

    This presents… possibilities for all commercial entities who will eventually use AI agents for storefronts and online sales.

    • hansolo@lemmy.today
      12·
      5 days ago

      That’s the worst part.

      It didn’t actually freak out. It’s trained on human-created material. It saw a situation where a human would freak out, and internally was like “huh…well, it looks like the pattern here is to freak out. OK, I guess…”

      These things are trained to emmulate patterns of existing things, so it’s only because most humans freaked out at things going wrong, does it follow the same pattern because it thinks that’s what the operators expected to see.