Scaling Chat Interface for Multiple Databases: Seeking Guidance and Resources

I am responsible for developing a chat interface to engage with various databases in our product.

I initiated this project with a prototype solution you can see here: [https://blog.streamlit.io/snowchat-leveraging-openais-gpt-for-sql-queries/]. While this prototype serves as a functional model, the true challenge lies in scaling it to accommodate multiple databases, especially starting with SQL server, encompassing hundreds of databases and thousands of tables. I wouldn’t be able to add DDL in the same way as in this project. I’m wondering how to reproduce this solution to make it work for more tables.

I’m looking for something that could help me with this task. I’m not really sure how to approach it. It could be Github repositories, similar projects, posts – anything.