Dear #Fediverse I am trying to find a thing.
It is a screenshot I remember seeing a couple of times of an Xitter post from some dudebro talking about their #AI startup that focuses on training an LLM to do math.
The tweet contained a heatmap of how "good" their "AI" is in multiplication. For small operands it was like 95% and up "accurate", for operands larger than 5 it quickly dropped off.
It was hilarious and a great illustration of AI hype. Can't find it though. Help?
@EndlessMason thanks! Not exactly what I was looking for, but still great. Appreciated!
@rysiek This substgack post shows the image embedded in a musktodon post, is it that one?
https://garymarcus.substack.com/p/llms-dont-do-formal-reasoning-and ?
@EndlessMason not really. This is an image showing the performance of OpenAI's model in maths. Instead, I am looking for an image showing how somebody was trying to build a model trained specifically to do math.
Thank you nonetheless!
@rysiek
Aah, I see
I'm pretty sure the correct choice it's teaching it to identify math and then hand it to wolfram alpha or something