New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Getting an error while generating quantized tiny llama model due to AI-edge-quantizer #153

Open

pallaviNNT opened this issue Oct 4, 2024 · 0 comments

pallaviNNT commented Oct 4, 2024

AttributeError: module 'ai_edge_quantizer.qtyping' has no attribute 'ComputePrecision'

Steps followed:
Ran requirements.txt from AI-edge-torch repo
https://github.com/google-ai-edge/ai-edge-torch/blob/main/requirements.txt

Cloned the Ai-edge-torch

cd ai_edge_torch/generative/examples/tiny_llama

ran command "python3.10 convert_to_tflite.py"

Error:

AttributeError: module 'ai_edge_quantizer.qtyping' has no attribute 'ComputePrecision'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment