{"id":2043,"date":"2023-09-14T05:04:43","date_gmt":"2023-09-14T10:04:43","guid":{"rendered":"https:\/\/www.thinkulum.net\/blog\/?p=2043"},"modified":"2023-09-14T05:14:33","modified_gmt":"2023-09-14T10:14:33","slug":"weeknote-for-9-10-2023","status":"publish","type":"post","link":"https:\/\/www.thinkulum.net\/blog\/2023\/09\/14\/weeknote-for-9-10-2023\/","title":{"rendered":"Weeknote for 9\/10\/2023"},"content":{"rendered":"<h2>Math<\/h2>\n<p>\ud83d\ude10<\/p>\n<p><strong>I imported my notes from the earlier iterations and began considering how to make my flashcards.<\/strong> I was still distracted by my AI side project and didn&#8217;t gain much momentum on this one.<\/p>\n<h2>AI<\/h2>\n<p><span role=\"img\" aria-label=\"\ud83d\ude0c\">\ud83d\ude0c<\/span><\/p>\n<p><strong>I got past my blockages from the week before.<\/strong> (1) I found out how to free Llama 2 from its excessive false refusals (just change the system prompt), and (2) I learned how to compile the llama-cpp-python code that will enable me to install more language models on my computer (install Visual Studio with the Windows SDK). These solutions open up avenues for a lot more experimentation. Specifically, I want to look for Llama 2 <a href=\"https:\/\/www.lesswrong.com\/posts\/aPeJE8bSo6rAFoLqg\/solidgoldmagikarp-plus-prompt-generation\">glitch tokens<\/a> that will make its responses extra random.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Math \ud83d\ude10 I imported my notes from the earlier iterations and began considering how to make my flashcards. I was still distracted by my AI side project and didn&#8217;t gain much momentum on this one. AI \ud83d\ude0c I got past &hellip; <a href=\"https:\/\/www.thinkulum.net\/blog\/2023\/09\/14\/weeknote-for-9-10-2023\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[168,100,167],"tags":[],"class_list":["post-2043","post","type-post","status-publish","format-standard","hentry","category-ai","category-math-relearning","category-weeknotes"],"_links":{"self":[{"href":"https:\/\/www.thinkulum.net\/blog\/wp-json\/wp\/v2\/posts\/2043","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.thinkulum.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.thinkulum.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.thinkulum.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.thinkulum.net\/blog\/wp-json\/wp\/v2\/comments?post=2043"}],"version-history":[{"count":3,"href":"https:\/\/www.thinkulum.net\/blog\/wp-json\/wp\/v2\/posts\/2043\/revisions"}],"predecessor-version":[{"id":2046,"href":"https:\/\/www.thinkulum.net\/blog\/wp-json\/wp\/v2\/posts\/2043\/revisions\/2046"}],"wp:attachment":[{"href":"https:\/\/www.thinkulum.net\/blog\/wp-json\/wp\/v2\/media?parent=2043"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.thinkulum.net\/blog\/wp-json\/wp\/v2\/categories?post=2043"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.thinkulum.net\/blog\/wp-json\/wp\/v2\/tags?post=2043"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}