You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello thank you for your project I'm trying to learn how to use it
from transformers import AutoTokenizer
from onnxllm import AutoModelForCausalLM
model_path = 'h2oai/h2ovl-mississippi-800m'
# you should download onnx models from https://huggingface.co/inisis-me first
tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(model_path, trust_remote_code=True)
image_path = 'dni_frente.jpg'
question = "<image>\nExtract the text from the image and fill the following json {'Document':'','Document_number':'','Surname':'','Name':'','date_of_birth':'','Nationality':'','issue_date':'','expiration_date':'',}"
inputs = tokenizer(prompt, return_tensors='pt')
# Perform inference
response, history = model.chat(tokenizer, image_path, question, generation_config, history=None, return_history=True)
but i get errors
Traceback (most recent call last):
File "/home/kpalacio/Documentos/kiut-ld-message-processing/ocr_data_extraction/test.py", line 7, in <module>
model = AutoModelForCausalLM.from_pretrained(model_path, trust_remote_code=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/kpalacio/micromamba/envs/llms/lib/python3.11/site-packages/onnxllm/models/auto_factory.py", line 57, in from_pretrained
model_class = _get_model_class(config, cls._model_mapping)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/kpalacio/micromamba/envs/llms/lib/python3.11/site-packages/onnxllm/models/auto_factory.py", line 35, in _get_model_class
supported_models = model_mapping[type(config)]
~~~~~~~~~~~~~^^^^^^^^^^^^^^
File "/home/kpalacio/micromamba/envs/llms/lib/python3.11/site-packages/onnxllm/models/auto_factory.py", line 87, in __getitem__
model_type = self._reverse_config_mapping[key.__name__]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^
KeyError: 'H2OVLChatConfig'
am i missing something?
I'm guessing I'm missing a step like exporting the model to onnx? I'm new to the onnx ecosystem.
thank you in advance
The text was updated successfully, but these errors were encountered:
Hello thank you for your project I'm trying to learn how to use it
but i get errors
am i missing something?
I'm guessing I'm missing a step like exporting the model to onnx? I'm new to the onnx ecosystem.
thank you in advance
The text was updated successfully, but these errors were encountered: