Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ImageDescriptionService can't get image description from twitter post with images #1668

Open
nusk0 opened this issue Jan 1, 2025 · 4 comments
Labels
bug Something isn't working

Comments

@nusk0
Copy link
Contributor

nusk0 commented Jan 1, 2025

Describe the bug
Agent tries to use ImageDescriptionService but can't get image description from a twitter post, API respond with this error message when trying to send a request : "You uploaded an unsupported image. Please make sure your image has of one the following formats: ['png', 'jpeg', 'gif', 'webp']."

To Reproduce

  1. Download the latest repo and use any character with a twitter client. Make sure to add the fix in this PR.
  2. set ENABLE_ACTION_PROCESSING=true in your .env file to enable your agent to interact with pictures and wait for it.
  3. Once your agent tries to get an image description from a tweet, you get this error :
    `

["◎ Processing images in tweet for context"]

⛔ ERRORS
OpenAI API error:
400

{
"error": {
"message": "You uploaded an unsupported image. Please make sure your image has of one the following formats: ['png', 'jpeg', 'gif', 'webp'].",
"type": "invalid_request_error",
"param": null,
"code": "invalid_image_format"
}
}

⛔ ERRORS
OpenAI request failed (attempt
1
):
{}

⛔ ERRORS
OpenAI API error:
400

{
"error": {
"message": "You uploaded an unsupported image. Please make sure your image has of one the following formats: ['png', 'jpeg', 'gif', 'webp'].",
"type": "invalid_request_error",
"param": null,
"code": "invalid_image_format"
}
}

⛔ ERRORS
OpenAI request failed (attempt
2
):
{}

⛔ ERRORS
OpenAI API error:
400

{
"error": {
"message": "You uploaded an unsupported image. Please make sure your image has of one the following formats: ['png', 'jpeg', 'gif', 'webp'].",
"type": "invalid_request_error",
"param": null,
"code": "invalid_image_format"
}
}

⛔ ERRORS
OpenAI request failed (attempt
3
):
{}

⛔ ERRORS
Error in recognizeWithOpenAI:
{}

⛔ ERRORS
Error in handleTextOnlyReply:
{}

`

Expected behavior

Screenshots

Additional context
I will be adding a PR to solve this issue shortly

@nusk0 nusk0 added the bug Something isn't working label Jan 1, 2025
@monilpat
Copy link
Collaborator

monilpat commented Jan 2, 2025

Thanks for creating this will review the PR :)

@AIFlowML
Copy link
Contributor

AIFlowML commented Jan 2, 2025

What is the version of ElizaOS you running ? Any other details of the configuration to inspect the issue ?

@nusk0
Copy link
Contributor Author

nusk0 commented Jan 2, 2025

What is the version of ElizaOS you running ? Any other details of the configuration to inspect the issue ?
1.7 release.
I solved this issue with this PR

@tcm390 tcm390 assigned tcm390 and unassigned tcm390 Jan 3, 2025
@AIFlowML
Copy link
Contributor

AIFlowML commented Jan 3, 2025

What is the version of ElizaOS you running ? Any other details of the configuration to inspect the issue ?
1.7 release.
I solved this issue with this PR

I had to fix another part and i was getting errors so i wil push probably a different version.
tnks mate to contribute.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants