Open
Description
It would be highly beneficial to support Groq's API as a provider. I attempted to use https://api.groq.com/openai/v1 as an OpenAI-compatible endpoint, but function_tools are not working properly and are not fully supported (sometimes, I got timeout, or loops and / or json text)
GroqCloud offers impressive speed and supports multimodal models, making it a compelling option to integrate. Adding support for Groq's API would allow users to take advantage of its performance benefits.