Cyber Notes

Cyber Notes

Share this post

Cyber Notes
Cyber Notes
Weekend Project: LLM πŸ–₯

Weekend Project: LLM πŸ–₯

Run your own AI locally like ChatGPT

W J Pearce's avatar
W J Pearce
Aug 14, 2024
βˆ™ Paid
8

Share this post

Cyber Notes
Cyber Notes
Weekend Project: LLM πŸ–₯
4
2
Share

Here I am running my own AI locally!

This is awesome:

  • You have your own chat history

  • Your data is stored on the local Instance

  • You can fine tune the models to your liking

  • You have the ability to switch models, to take advantage of uncensored LLMs that have been pre-trained!

  • It’s all containerized

You can also run it from the command line:

How do you set this up???

You can do it in literally Six Steps….


Step One: If you’re on Windows you’ll first need to install WSL, you can follow the instructions here:

Cloud Security Project? πŸ› οΈ

Cloud Security Project? πŸ› οΈ

W J Pearce
Β·
August 7, 2024
Read full story

If you’re using macOS or Linux you can skip this step.

Keep reading with a 7-day free trial

Subscribe to Cyber Notes to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
Β© 2025 W J Pearce
Privacy βˆ™ Terms βˆ™ Collection notice
Start writingGet the app
Substack is the home for great culture

Share