Need guidance in this sea of information on how to set up a local AI

Hey, I have no idea if this is even the right sub to ask for help in, but I have no idea where to start.

I was asking the Bing AI for leads on how to setup a local/offline AI chatbot on my PC, and eventually found this article. I followed it but when I got to the end, I realized that a dataset or source documents or something is needed for it to actually have knowledge. This is where I’m starting to get really confused.

I am essentially trying to make something like CharacterAI (won’t be nearly as good, I know) that can run on my PC. Just something that is somewhat ChatGPT-like or CharacterAI-like that I can interact with without my PC melting, with perhaps the ability down the road to set up voice commands that it can respond to, like an Alexa device, but with more… intelligence.

PC specs:

  • i9 13900k
  • ASUS Prime Z790-P motherboard
  • Corsair Vengeance 32gb RAM DDR5
  • GIGABYTE RTX 3060ti 8gb GDDR6
  • Corsair RM850x Power Supply
  • MSI MAG 360r V2 liquid cooler

I found things like this dataset and LocalAI and I followed the article to get PrivateGPT and the GPT4ALL groovy.bin but I’m completely lost and it feels like the more I research the internet or ask BingAI for answers, the more questions I get instead. At this stage I don’t know what goes where, if there’s a difference between source documents and datasets, should I run this from my 2tb SSD? Should I have the data on my 8tb HDD? Will all this even work on my PC?

Can anybody help direct me or teach me? I really want to learn.

submitted by /u/grimsikk
[link] [comments]