Skip to content

Groq Implementation #392

Open
Open
@Pascal1132

Description

@Pascal1132

It would be highly beneficial to support Groq's API as a provider. I attempted to use https://api.groq.com/openai/v1 as an OpenAI-compatible endpoint, but function_tools are not working properly and are not fully supported (sometimes, I got timeout, or loops and / or json text)

GroqCloud offers impressive speed and supports multimodal models, making it a compelling option to integrate. Adding support for Groq's API would allow users to take advantage of its performance benefits.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions