{"id":819,"date":"2023-01-27T11:06:56","date_gmt":"2023-01-27T10:06:56","guid":{"rendered":"https:\/\/metrics.blogg.gu.se\/?p=819"},"modified":"2023-01-20T11:13:14","modified_gmt":"2023-01-20T10:13:14","slug":"creating-your-own-models","status":"publish","type":"post","link":"https:\/\/metrics.blogg.gu.se\/?p=819","title":{"rendered":"Creating your own models"},"content":{"rendered":"\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"683\" src=\"https:\/\/metrics.blogg.gu.se\/files\/2023\/01\/hands-gc69a716f0_1920-1024x683.jpg\" alt=\"\" class=\"wp-image-820\" srcset=\"https:\/\/metrics.blogg.gu.se\/files\/2023\/01\/hands-gc69a716f0_1920-1024x683.jpg 1024w, https:\/\/metrics.blogg.gu.se\/files\/2023\/01\/hands-gc69a716f0_1920-300x200.jpg 300w, https:\/\/metrics.blogg.gu.se\/files\/2023\/01\/hands-gc69a716f0_1920-768x512.jpg 768w, https:\/\/metrics.blogg.gu.se\/files\/2023\/01\/hands-gc69a716f0_1920-1200x800.jpg 1200w, https:\/\/metrics.blogg.gu.se\/files\/2023\/01\/hands-gc69a716f0_1920-1320x880.jpg 1320w, https:\/\/metrics.blogg.gu.se\/files\/2023\/01\/hands-gc69a716f0_1920.jpg 1920w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><figcaption>BIld av <a href=\"https:\/\/pixabay.com\/sv\/users\/pexels-2286921\/?utm_source=link-attribution&amp;utm_medium=referral&amp;utm_campaign=image&amp;utm_content=1868562\">Pexels<\/a> fr\u00e5n <a href=\"https:\/\/pixabay.com\/sv\/\/?utm_source=link-attribution&amp;utm_medium=referral&amp;utm_campaign=image&amp;utm_content=1868562\">Pixabay<\/a><\/figcaption><\/figure>\n\n\n\n<p class=\"has-drop-cap\">Last week I wrote about our seminar and Co-pilot. I&#8217;m sure that has stimulated a lot of thoughts on these language models. Many think that this is a difficult task to create, train and use them. <\/p>\n\n\n\n<p>Nothing further from the truth. If you are interested in training such a model from scratch, I recommend the following book (in particular Chapter 4 if you are anxious to get started). <\/p>\n\n\n\n<p><a href=\"https:\/\/www.packtpub.com\/product\/transformers-for-natural-language-processing\/9781800565791\">Transformers for Natural Language Processing | Packt (packtpub.com)<\/a><\/p>\n\n\n\n<p>The book explains how these models work for natural language processing, but making it work for source code is trivial. Use your code instead of the provided text and there you go. You need a GPU or use some cloud service, otherwise you will wait forever. <\/p>\n\n\n\n<p>But if you have it, you can get really cool results within a day or two. <\/p>\n\n\n\n<p>Good luck!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Last week I wrote about our seminar and Co-pilot. I&#8217;m sure that has stimulated a lot of thoughts on these language models. Many think that this is a difficult task to create, train and use them. Nothing further from the truth. If you are interested in training such a model from scratch, I recommend the &hellip; <a href=\"https:\/\/metrics.blogg.gu.se\/?p=819\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Creating your own models&#8221;<\/span><\/a><\/p>\n","protected":false},"author":68,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6,4],"tags":[],"_links":{"self":[{"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/posts\/819"}],"collection":[{"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/users\/68"}],"replies":[{"embeddable":true,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=819"}],"version-history":[{"count":1,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/posts\/819\/revisions"}],"predecessor-version":[{"id":821,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=\/wp\/v2\/posts\/819\/revisions\/821"}],"wp:attachment":[{"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=819"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=819"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/metrics.blogg.gu.se\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=819"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}