Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check raw openai response #94

Open
arisliang opened this issue Nov 23, 2023 · 2 comments
Open

Check raw openai response #94

arisliang opened this issue Nov 23, 2023 · 2 comments

Comments

@arisliang
Copy link

Is it possible to check what the raw openai response is? It contains useful information, such as token usage:

"usage": {
    "completion_tokens": 17,
    "prompt_tokens": 57,
    "total_tokens": 74
  }
@minimaxir
Copy link
Owner

The token counts are already saved as objects in the messages themselves. I don't think there is anything else useful in the raw response, unless you had something in mind.

@arisliang
Copy link
Author

When custom output_schema is specified, response message won't include token counts. In this case, where do we see the token usage?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants