Very new to this space, but I had the idea of putting my Nvidia gaming PC to use and a raspberry pi5 to create a remote chatbot.
The aim is to have the pi untethered from the pc which will be taking mic input, transfer the audio to the pc to be interpreted, and ran through the LLM and get the output with TTS, sending it back to the pi to be played through a speaker, in essence the pc doing all the heavy lifting.
Is there any sources/projects out there I can read up on that you know of ?
I’m aware that raspberry pis are able to run offline LLMs these days, but tend to be slow, or due to their nature have some limitations. I’m aware the transfer of data may create some delay between the devices
submitted by /u/iBilliam01
[link] [comments]