Hi everyone,

I run a small eco-friendly car wash and I’m building a WhatsApp chatbot to automate customer inquiries like hours, pricing, and location. The goal is to make it feel human-like, not just like a typical bot.

My Current Approach:

1. Hosting: Using PythonAnywhere for simplicity and affordability.
2. AI Integration: Leveraging the Together API with the LLaMA 405B model to generate responses. The chatbot is fed specific business information (hours, pricing, etc.) to ensure accurate answers.
3. Prompt Engineering: I’ve tailored prompts to make sure the chatbot only answers the customer’s question without sounding like a language model—keeping the interaction focused and human-like.
4. WhatsApp Integration: Using the WhatsApp Business API to receive and respond to customer messages directly based on predefined business context.

My Questions:

1. Is PythonAnywhere suitable for this, or should I consider another platform for scalability?
2. Is the LLaMA 405B model the right choice for handling these simple queries? I found that the 70B model doesn’t perform as well for all my cases
3. What challenges might I face in maintaining and scaling this chatbot?
4. Is there a more efficient or cost-effective way to implement this solution?

Thanks in advance for your insights!