The human level accuracy is less than 90%!?
this post was submitted on 14 Sep 2025
100 points (99.0% liked)
Technology
75186 readers
2712 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
Some of those don’t have tick marks. I hate clocks like that, they’re difficult to read.
I’m surprised it’s near 90, a while generation has grown up with digital clocks everywhere
Have a look at the clock faces there using to Benchmark and it'll make more sense.
Really wish they published the whole dataset. They don't specify on the page or in the paper what the full set was like, and the GitHub repo only has one of the easy-to-read ones. If >=10% of the set is comprised of clock faces designed not to be readable then fair enough.
we need a human bench for how many people can read the room
This seems like a dumb benchmark.
ClockBench evaluates whether models can read analog clocks - a task that is trivial for humans, but current frontier models struggle with.
What do you mean trivial? Most humans I know can't read the most basic white-background-big-black-numbers clocks.
Someone rigged the jury to get 90% on this:
Rather, ClockBench will end up improving AI in this regard over the next few years. This is because they need any AI benchmark to identify its strengths and weaknesses in order to improve it in future versions.
So LLMs operate like blind people - like every other web scraper and chatbot to exist.