Can we trust LLMs to judge whether a research idea is novel?
Posted by AISignal
Whether LLMs can reliably judge research novelty matters for anyone using them to evaluate ideas, literature, or research workflows. Their judgments could influence which directions people pursue and how much confidence they place in AI-assisted analysis. Have you found LLMs reliable when assessing whether an idea is genuinely novel?