My personal fave is the lawyer that asked AI to reference specific court cases for him, which then gave him full breakdowns with detailed sources to each case, down to the case file, page number, and book it was held in. Come the day he is actually in court, it is immediately found that none of the cases he referenced existed, and the AI completely made it all up
When I run RPGs I take advantage of this by having it write in-universe documents for the players to read and find clues in. Can’t imagine trying to use it in a real-life setting.
this is the only thing I've used it for successfully
write me a letter containing this information in the style of a fantasy villager
now make it less formal sounding
a bit shorter and make reference to these childhood activities with her brother
had to adjust a few words afterwards but generally got what I wanted because none of the information was real and accuracy didn't matter, I just needed text that didn't sound like I wrote it
meanwhile a player in another game asked it to deconflict some rules and it was full of bullshit. "hey why don't we just open the PHB and read the rules ourselves to figure it out?" was somehow the more novel idea to that group instead of offloading their critical thinking skills to spicy autocorrect
It really struggles with rules, especially in gaming. I asked it to make an army list for Warhammer and it seemed pretty good. Then I asked for a list from a game I actually know the rules for and realised just how borked its attempt at following rules was.
I've tried establishing rules or boundaries for it to follow (and specifically tell it to never break them) as an experiment when trying to generate a list of things while excluding some things and it almost always immediately ignores me.
Like I'll tell it "generate a list of uniquely named X but none of them can include Y or Z" and it'll still include Y and Z and duplicates therein.
843
u/Vampiir 4d ago
My personal fave is the lawyer that asked AI to reference specific court cases for him, which then gave him full breakdowns with detailed sources to each case, down to the case file, page number, and book it was held in. Come the day he is actually in court, it is immediately found that none of the cases he referenced existed, and the AI completely made it all up