Hi everyone just want to get some advice from more experienced people on this. I’m trying to make something to help a group of friends so I’m trying to find the most cost-efficient way to do this.
I was thinking host the LLM on AWS server. Use falcon-40b as base then continue teaching it from there. Use flowiseai to create the chat bot and embed it onto the website.
I’m going to be feeding it a lot of information about certain regulations in the states that way they can ask the bot and it can give precise information about it.
I’m very new to building AI chat bots in general so would really love insights from everyone on how to structure this whole thing and what to use. Maybe even some good open tools that can be used?