Blog

I want to create a chatbot with additional capability to search and retrieve the necessary information. I have no experience in this.

I did some research and the recommended frameworks for chatbots are: 1. Dailogflow (No idea which option I would need: ES or CX) 2. RASA 3. Langchain 4. Botpress 5. Anything better that I might have missed

The alternatives for search feature are: 1. Google search API 2. Elastic Search

Hosting: 1. GCP 2. VPS

My constraints are 1. I want to complete this project as early as possible. I’d like to avoid anything ‘from scratch’ at this point. I’ll prefer ‘batteries included’ kinda approach like django. A smaller learning curve would be better though I don’t have any problem to go through steeper learning curve if it’s absolutely necessary and worth it.

1. I’ll be bearing the expense out of my own pocket. I can’t afford anything expensive. I’ve a bad experience with AWS during my learning phase. I had left one ECS instance ON and I got huge bill. I don’t want to repeat the same mistake. I don’t want to shoot the expenses out of roof during development and the testing phase itself. Hidden costs shouldn’t be even a possibility.

2. I understand that LLMs aren’t really perfect and hallucinations are a constant issue. So, anything near to satisfactory conversation is acceptable in terms of bot quality.

3. Data privacy. Eventually, I would be testing this tool on actual users. I’d like their data to be safe and protected.

4. This bot will be limited to specific industry. So, ability to train or fine tune it for specialized knowledge is important.

Google ecosystem (dialogflow + search api + GCP) looks good but I’ve some reservations when it comes to google. I worry about the costs. I don’t want to repeat my AWS like experience again. I don’t trust google with user data.

But barring above concerns, it seems better alternative from development speed and conversation accuracy point of view.

1. I don’t have any idea about RASA. The only thing I know is that it’ll take more development time than dialogflow or botpress.

2. Langchain: Same as RASA. Not much idea about it. I saw some posts on reddit complaining that it makes the code messy.

3. Botpress: I believe it’s similar to dialogflow and will be easier to develop a chatbot with it. I don’t know about quality of the conversations or costs associated with it.

What framework would you recommend? What framework is in demand in the industry? Any other tips are welcome. If you are running similar thing, please share your experiences.

TLDR: I’m looking for a framework to create chatbot with search capabilities. I need to keep the expenses, development time, and learning curve as little as possible. Data privacy is important. What tech stack would you recommend?

“Someone licks your tears and sucks on the blood oozing from your leg wounds. Then, his heavy breath brushes against your face. You’re held tightly, a murmur in your ear”
Can’t wait for NSFW content lol

u/playme_ai

The 8B and 70B llama 3 models were released a few hours ago by Meta. Benchmarks look really promising, so this could be a great upgrade to all our chatbots!

https://llama.meta.com/llama3/

The GGUF formats are just coming out, but seem to work in Faraday.dev if you want to try them out locally.

Meta released a base version as well as the instruct version. So far instruct seems to be a little too helpful to play a character, but I’m sure we’ll see finetunes shortly.