{"id":86545,"date":"2023-10-11T15:02:46","date_gmt":"2023-10-11T20:02:46","guid":{"rendered":"http:\/\/www.kateva.org\/sh\/?p=86545"},"modified":"2023-10-11T15:02:46","modified_gmt":"2023-10-11T20:02:46","slug":"using-gpt-4-to-generate-synthetic-childrens-stories-to-train-tiny-language-models","status":"publish","type":"post","link":"http:\/\/www.kateva.org\/sh\/?p=86545","title":{"rendered":"Using GPT-4 to generate synthetic children\u2019s stories to train tiny language models."},"content":{"rendered":"<p><a href=\"https:\/\/www.quantamagazine.org\/tiny-language-models-thrive-with-gpt-4-as-a-teacher-20231005\/\">Link<\/a>. ChatGPT training its replacements. Many workers can sympathize.<\/p>\n<p>\u201cresearchers settled on a training data set containing roughly 2 million stories \u2026 networks with fewer layers but more neurons per layer were better at answering questions that required factual knowledge; conversely, networks with more layers and fewer neurons per layer were better at keeping track of characters and plot points\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Link. ChatGPT training its replacements. Many workers can sympathize. \u201cresearchers settled on a training data set containing roughly 2 million stories \u2026 networks with fewer layers but more neurons per layer were better at answering questions that required factual knowledge; &hellip; <a href=\"http:\/\/www.kateva.org\/sh\/?p=86545\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[32],"class_list":["post-86545","post","type-post","status-publish","format-standard","hentry","category-share","tag-pinboard"],"_links":{"self":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/86545","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=86545"}],"version-history":[{"count":1,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/86545\/revisions"}],"predecessor-version":[{"id":86546,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=\/wp\/v2\/posts\/86545\/revisions\/86546"}],"wp:attachment":[{"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=86545"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=86545"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.kateva.org\/sh\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=86545"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}