{"id":93081,"date":"2026-10-19T19:45:33","date_gmt":"2026-10-20T00:45:33","guid":{"rendered":"http:\/\/www.kateva.org\/sh\/?p=93081"},"modified":"2026-10-19T19:45:33","modified_gmt":"2026-10-20T00:45:33","slug":"central-claim-is-that-for-larger-llms-most-neurons-represents-a-singular-concept-and-things-clustered-around-that-concept-perhaps-with-small-offshoots-and-some-use-of-low-level-activations","status":"publish","type":"post","link":"http:\/\/www.kateva.org\/sh\/?p=93081","title":{"rendered":"\u201ccentral claim is that for larger LLMs, most neurons represents a singular concept and things clustered around that concept, perhaps with small offshoots and some use of low-level activations.\u201d"},"content":{"rendered":"<p><a href=\"https:\/\/thezvi.substack.com\/p\/i-can-see-everything\">https:\/\/thezvi.substack.com\/p\/i-can-see-everything<\/a><\/p>\n<p>Beyond predicting the next token.   I remember smart people being very confident about what an LLM was. The experts always seemed less confident.<\/p>\n<p>\u201cTake a neuron that tracks \u2018a sense of righteousness when a bargain purchase turns out to work better than the expensive alternative\u2019. Neurons that track a feeling or social cue like this are some of the most common we\u2019ve found\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"<p>https:\/\/thezvi.substack.com\/p\/i-can-see-everything Beyond predicting the next token. I remember smart people being very confident about what an LLM was. The experts always seemed less confident. \u201cTake a neuron that tracks \u2018a sense of righteousness when a bargain purchase turns out to &hellip; <a href=\"http:\/\/www.kateva.org\/sh\/?p=93081\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[28,40],"class_list":["post-93081","post","type-post","status-publish","format-standard","hentry","category-share","tag-ifttt","tag-pinboard-jgordon"],"_links":{"self":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/93081","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=93081"}],"version-history":[{"count":1,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/93081\/revisions"}],"predecessor-version":[{"id":93082,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/93081\/revisions\/93082"}],"wp:attachment":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=93081"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=93081"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=93081"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}