How-to Run Your Own AI LLM For Free & Locally
Craig Bennett II
In this video I will get into how to install and run your own open source and free AI model on a Windows computer. Note while the video is long, I tried to make it as simple as possible so anyone coming in should be able to run with it.
Note I forgot to mention, if you want a good LLM (AI brain). Ask on reddit for what useful LLM. There is a number of LLM communities and many will go out of their way to help you.
Links in the video:
Python: https://www.python.org/downloads/ LM Studio: https://lmstudio.ai/ Autogen: https://github.com/microsoft/autogen/tree/main Document on autogen: https://microsoft.github.io/autogen/docs/reference/agentchat/conversable_agent/ Example of multiple bots talking to each other: https://github.com/microsoft/autogen/blob/main/notebook/agentchat_groupchat_vis.ipynb Memgpt: https://github.com/cpacker/MemGPT 7B vs 13B vs 70B: https://replicate.com/blog/all-the-llamas
Timestamp 0:00 - Intro and general info you should know 2:24 - Python 2:56 - LM Studio 4:40 - 7B vs 13B vs 70B 13:46 - The code
●▬▬▬▬๑۩۩๑▬▬▬▬▬● What I used to make my videos: ● My fav VPN: https://www.privateinternetaccess.com/pages/buy-vpn/techrhelp ● Microphone: http://amzn.to/2yF8dUy ● Pop filter: http://amzn.to/2ArPIQu ● Webcam: http://amzn.to/2ydEvSf ● Video editing software: http://amzn.to/2Aq3nrj ● Starter light kit: http://amzn.to/2m3dr6J ● Color light: http://amzn.to/2zqYWhS ● Desk Light: http://amzn.to/2yG7K4j
👉 I am a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to amazon.com (Same with PIA) ●▬▬▬▬๑۩۩๑▬▬▬▬▬●
Donate: https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=Y6HZMBNDG5ZJ4 ●▬▬▬▬๑۩۩๑▬▬▬▬▬● ... https://www.youtube.com/watch?v=UIrWPtXWbSo
137535020 Bytes