I’m learning LLM and AI. And I’m building a multi-modal full stack LLM chat agent. [0]

Using semantic-router for dynamic conversation routing, and LiteLMM for model providers. It was lots of fun to learn and build.

Here is the full list of large language models. I will update more models in the future. [1]

I will be adding function calling support (tools use) for the models to have it more capable, like an agent, in the future.

Hope this project helps everyone to try out using multi-modalities LLM providers agent!

--

[0] GitHub: https://github.com/vinhnx/VT.ai [1] List of LLM models currently supported: https://github.com/vinhnx/VT.ai/blob/main/src/vtai/llms_conf...

I'm using it integrated with whatsapp so I can send voice messages to it and it run commands in my computer (like creating a social media post, getting info about a hike, etc). Also using this integration to manage whatsapp groups that I'm admin but this is just a WIP.

I'm just using it to generate code snippet. Little scripts and helpers and things.

Some of what it created was edited and put in production.