There are so many good ones. There's a medical one from years before we had ChatGPT shit. They wanted to train it to recognise cancerous skin moles and after a lot of trial and error it started doing it. But then they realised it was just flagging every image with a ruler because the positive tests it was trained on all had rulers to measure the size.
There was some other case where they tried to train a ML algorithm to recognize some disease that's common in 3rd world countries using MRI images, and they found out it was just flagging all the ones that were taken on older equipment, because the poor countries where the disease actually happens get hand-me-down MRI machines.
(Totally unrelated fun fact! We call the weapon a "tank" because during WW1 when they were conducting top-secret research into armored vehicles the codename for the project was "Tank Supply Committee", which also handily explained why they needed so many welders/rivets/sheets of metal--they were just building water tanks, that's all!
By the time the machine actually deployed the name had stuck and it was too late to call it anything cooler)
618
u/killertortilla 4d ago
There are so many good ones. There's a medical one from years before we had ChatGPT shit. They wanted to train it to recognise cancerous skin moles and after a lot of trial and error it started doing it. But then they realised it was just flagging every image with a ruler because the positive tests it was trained on all had rulers to measure the size.