|
Change #71102
2024-01-10
07:14:58
|
create
Calagator::Event
1250480912
How to Run A Large Language Model (LLM) Locally on your PC or Laptop
Roll back
| description |
nil |
→ |
**How to run a Large Lanuage Model on your PC or Laptop**
Large language models are essentially large files (think GB in size!) that contain information somone can draw upon with a prompt. You've undoubtedly heard of (or used) OpenAI, which uses the ChatGPT LLM.
All OpenAI is is someone else's computer with a large language model installed. So why not do the same thing on your home computer?
For this event I'll walk through how to install an interface to chat with an AI model, download a model that works for you, and how to interface it.
This is intended to be more of a workshop, but since it takes a long time to install and download the models, this is more of a class format (it will be recorded and shared later with attendees).
After the tutorial attendees will be able to contact me with any questions about the process.
**What will you need for the tutorial?**
A computer. And, of course, an Internet connection. If you have a computer with a graphic card, opt for that, but you can use a local LLM on your laptop all the same.
**To Make the Most of the Class**
This isn't required, but if you have the technical know-how, I'd highly recommend doing the following:
- downloading (and installing) https://github.com/oobabooga/text-generation-webui for your platform.
- Once it's installed, use the "Download Models" tab to download **TheBloke/dolphin-2.6-mistral-7B-GGUF** (model info here: https://huggingface.co/TheBloke/dolphin-2.6-mistral-7B-GGUF)
**Again, if these instructions don't make sense or you find them confusing, don't worry! I'm not expecting anyone to have done this.**
Still have questions? Feel free to reach out to me on XMPP: xmpp://[email protected] |
| end_time |
nil |
→ |
2024-01-27 19:30:00 -0800 |
| id |
nil |
→ |
1250480912 |
| start_time |
nil |
→ |
2024-01-27 18:00:00 -0800 |
| title |
nil |
→ |
How to Run A Large Language Model (LLM) Locally on your PC or Laptop |
| url |
nil |
→ |
https://www.eventbrite.com/e/how-to-run-a-large-language-model-llm-locally-on-your-pc-or-laptop-tickets-786683129417?aff=oddtdtcreator |
| venue_details |
nil |
→ |
Once you purchase a ticket, a Jtisi video conference link will be provided. |
| venue_id |
nil |
→ |
202390270 |
|