Seeking Advice on Building a Custom Offline Chatbot

Hello everyone,

I’m embarking on a project to develop an “offline” chatbot that operates independently without relying on commercial APIs. My goal is to create a unique persona for this chatbot and equip it with specific information tailored to its intended purpose. I’m looking for a model that is unbiased and uncensored, prioritizing natural and unfiltered responses over balanced content. However, it should be compact enough to maintain quality conversations.

So far, I’ve gathered some model suggestions from various sources:

• GPT4Turbo recommended FreedomGPT, DeepPavlov, Llama2, or Falcon.
• Bing GPT-4 suggested BERT, GPT-J, or WiSE-FT.
• Bard Gemini pointed towards Open GPT-2, Bloom, or Jurassic-1 Jumbo.

I’d greatly appreciate any feedback or additional recommendations from the community. This project will be run on a Debian machine with an i9 processor, 128GB RAM, and an RTX 2080 OC 12GB graphics card.

Thanks in advance for your insights!