Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Support for SambaNova, Google Models + Cloud Version Down #95

Open
mugenyume opened this issue Sep 23, 2024 · 1 comment

Comments

@mugenyume
Copy link

Hi @rashadphz,

I’d like to suggest adding support for the SambaNova API and their models. Since SambaNova is OpenAI compatible, it can be accessed through LiteLLM. I gave it a shot, but I ran into this error:

500: 'Message' object has no attribute 'tool_calls'

Not sure what's causing this, but it would be awesome if SambaNova models could be used just like OpenAI and Groq models in the project.

Also, can we get support for the Google API and Gemini models? They’re accessible through LiteLLM as well, but you’ll need to install the google-generativeai pip package first.

By the way, thanks for setting up the cloud version at farfalle.dev!
However, it seems to be down at the moment. Could you check on that when you get a chance?

Appreciate all the work you’ve put in! <3

@mugenyume
Copy link
Author

Also, it would be nice to add support for OpenRouter models

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant