Export to

• Google Calendar
• iCalendar file
• hCalendar markup
  <div class="vevent h-event"> <h1 class="summary p-name">How to Run A Large Language Model (LLM) Locally on your PC or Laptop</h1> <div class='date'><time class="dtstart dt-start" title="2024-01-27T18:00:00" datetime="2024-01-27T18:00:00">Saturday, January 27, 2024 from 6</time>–<time class="dtend dt-end" title="2024-01-27T19:30:00" datetime="2024-01-27T19:30:00">7:30pm</time></div> <div class="location vcard p-location h-card"> <a class="url" href='http://calagator.org/venues/202390270'><span class='fn org p-name'>Online</span></a> <div class="adr p-adr h-adr"> <div class="street-address p-street-address">placeholder for on-line events</div> (<a href='https://maps.google.com/maps?q=placeholder%20for%20on-line%20events,%20%20%20%20'>map</a>) </div> </div> <div class="description p-description"> <p><img src="https://img.evbuc.com/https%3A%2F%2Fcdn.evbuc.com%2Fimages%2F670296459%2F865117757203%2F1%2Foriginal.20240109-010701?w=940&auto=format%2Ccompress&q=75&sharp=10&rect=0%2C48%2C1856%2C928&s=5ae41487131f928ac5a2bbd0944d0d44" alt="cover photo"></p> <p><strong>How to run a Large Lanuage Model on your PC or Laptop</strong></p> <p>Large language models are essentially large files (think GB in size!) that contain information somone can draw upon with a prompt. You've undoubtedly heard of (or used) OpenAI, which uses the ChatGPT LLM.</p> <p>All OpenAI is is someone else's computer with a large language model installed. So why not do the same thing on your home computer?</p> <p>For this event I'll walk through how to install an interface to chat with an AI model, download a model that works for you, and how to interface it.</p> <p>This is intended to be more of a workshop, but since it takes a long time to install and download the models, this is more of a class format (it will be recorded and shared later with attendees).</p> <p>After the tutorial attendees will be able to contact me with any questions about the process.</p> <p><strong>What will you need for the tutorial?</strong></p> <p>A computer. And, of course, an Internet connection. If you have a computer with a graphic card, opt for that, but you can use a local LLM on your laptop all the same.</p> <p><strong>To Make the Most of the Class</strong></p> <p>This isn't required, but if you have the technical know-how, I'd highly recommend doing the following:</p> <ul> <li>downloading (and installing) <a href="https://github.com/oobabooga/text-generation-webui">https://github.com/oobabooga/text-generation-webui</a> for your platform.</li> <li>Once it's installed, use the "Download Models" tab to download <strong>TheBloke/dolphin-2.6-mistral-7B-GGUF</strong> (model info here: <a href="https://huggingface.co/TheBloke/dolphin-2.6-mistral-7B-GGUF">https://huggingface.co/TheBloke/dolphin-2.6-mistral-7B-GGUF</a>)</li> </ul> <p><strong>Again, if these instructions don't make sense or you find them confusing, don't worry! I'm not expecting anyone to have done this.</strong></p> <p>Still have questions? Feel free to reach out to me on XMPP: <a href="xmpp://damngoodtech@movim.eu">xmpp://damngoodtech@movim.eu</a></p> </div> <h3>Links</h3> <ul> <li><a class="url u-url" href="https://www.eventbrite.com/e/how-to-run-a-large-language-model-llm-locally-on-your-pc-or-laptop-tickets-786683129417?aff=oddtdtcreator">Website</a></li> </ul> </div>