news
AI2 Blog
October 27th, 2026 at 8:00 AMCan we trust LLMs to judge whether a research idea is novel?
Old Ideas, Novel Problems tests how reliably LLMs judge the novelty of research ideas, finding that small changes to the evaluation setup can produce very different verdicts.
#llm
#research
Get stories like this every Monday
The week's most important AI news in one email. Free, unsubscribe anytime.
Score: 2.05
Engagement proxy: 0
Canonical link: https://allenai.org/blog/novelty-bench