{"id":89413,"date":"2024-10-30T18:26:36","date_gmt":"2024-10-30T23:26:36","guid":{"rendered":"http:\/\/www.kateva.org\/sh\/?p=89413"},"modified":"2024-10-30T18:26:36","modified_gmt":"2024-10-30T23:26:36","slug":"simpleqa-test-to-measure-hallucinations-questions-had-to-induce-hallucinations-from-either-gpt-4o-or-gpt-3-5","status":"publish","type":"post","link":"http:\/\/www.kateva.org\/sh\/?p=89413","title":{"rendered":"SimpleQA test to measure hallucinations: \u201cquestions had to induce hallucinations from either GPT-4o or GPT-3.5\u201d"},"content":{"rendered":"<p><a href=\"https:\/\/openai.com\/index\/introducing-simpleqa\/\">Link<\/a>. \u201cWe hired AI trainers to browse the web and create short, fact-seeking questions and corresponding answers\u201d<\/p>\n<p>I wonder if they used \u201cAmazing Turk\u201d<\/p>\n<p>\u201c\u2026 there is a lot of room to improve the calibration of large language models in terms of stated confidence\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Link. \u201cWe hired AI trainers to browse the web and create short, fact-seeking questions and corresponding answers\u201d I wonder if they used \u201cAmazing Turk\u201d \u201c\u2026 there is a lot of room to improve the calibration of large language models in &hellip; <a href=\"http:\/\/www.kateva.org\/sh\/?p=89413\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[32],"class_list":["post-89413","post","type-post","status-publish","format-standard","hentry","category-share","tag-pinboard"],"_links":{"self":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/89413","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=89413"}],"version-history":[{"count":1,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/89413\/revisions"}],"predecessor-version":[{"id":89414,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/89413\/revisions\/89414"}],"wp:attachment":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=89413"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=89413"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=89413"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}