{"id":91637,"date":"2025-10-06T16:25:23","date_gmt":"2025-10-06T21:25:23","guid":{"rendered":"http:\/\/www.kateva.org\/sh\/?p=91637"},"modified":"2025-10-06T16:25:23","modified_gmt":"2025-10-06T21:25:23","slug":"reasoning-model-reasoning-rule-is-correct-on-the-demonstrations-and-the-given-test-but-it-is-right-for-the-wrong-reason-correct-but-unintended","status":"publish","type":"post","link":"http:\/\/www.kateva.org\/sh\/?p=91637","title":{"rendered":"Reasoning model reasoning: \u201crule is correct on the demonstrations and the given test, but it is right for the wrong reason\u2014\u201ccorrect but unintended\u201d."},"content":{"rendered":"<p><a href=\"https:\/\/aiguide.substack.com\/p\/do-ai-reasoning-models-abstract-and\">https:\/\/aiguide.substack.com\/p\/do-ai-reasoning-models-abstract-and<\/a><\/p>\n<p>\u201cwhile o3, Claude, and Gemini approach or exceed human accuracy on these tasks with textual inputs, they are substantially more prone to use unintended \u201cshortcuts\u201d to solve the tasks than do humans\u201d<\/p>\n<p>They can reason but they are not very good at it.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>https:\/\/aiguide.substack.com\/p\/do-ai-reasoning-models-abstract-and \u201cwhile o3, Claude, and Gemini approach or exceed human accuracy on these tasks with textual inputs, they are substantially more prone to use unintended \u201cshortcuts\u201d to solve the tasks than do humans\u201d They can reason but they are not &hellip; <a href=\"http:\/\/www.kateva.org\/sh\/?p=91637\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[28,40],"class_list":["post-91637","post","type-post","status-publish","format-standard","hentry","category-share","tag-ifttt","tag-pinboard-jgordon"],"_links":{"self":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/91637","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=91637"}],"version-history":[{"count":1,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/91637\/revisions"}],"predecessor-version":[{"id":91638,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/91637\/revisions\/91638"}],"wp:attachment":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=91637"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=91637"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=91637"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}