Deductive Reasoning

Assessing the Reasoning Capabilities of LLMs in the context of Evidence-based Claim Verification
RECV, a benchmark of real-world claims labeled by reasoning type, shows that LLMs verify claims by deduction well but fail when abduction is needed.
John Dougrez-Lewis, Mahmud Elahi Akhter, Federico Ruggeri, Sebastian Löbbers, Yulan He, Maria Liakata
Cite DOI URL
Assessing the Reasoning Capabilities of LLMs in the context of Evidence-based Claim Verification