unable to convert llama 3.3 weights to hf.py

[AshishMulupuri]

System Info

python == 3.10.12
transformers == 4.45.1

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

I ran the convert_llama_weightsto_hf.py script on the llama-3.3-70B-Instruct checkpoint weights
!python convert_llama_weights_to_hf.py --input_dir "llama_3_3_model/Llama-3.3-70B-Instruct/original" --model_size 70B --output_dir "llama_3_3_model/Llama-3.3-70B-Instruct/hf-converted",
and got the
ValueError: Failed to instantiate tokenizer.Pleae, make sure you have sentencepiece and protobuf.
I tried upgrading both sentencepiece and protobuf but same error is occurring again

Expected behavior

downloaded from HuggingFace Files.

[Ulton321]

I think the issue here is with your dependencies

1. Upgrade Dependencies

Ensure that the necessary dependencies are installed and up-to-date. Run the following command:

pip install --upgrade sentencepiece protobuf

pip show sentencepiece protobuf

I think it should run like normal

[AshishMulupuri]

I tried it, upgraded versions protobuf-5.29.2 and sentencepiece-0.2.0
but still got the same error.

[hvaara]

Were you using a notebook? Did you remember to restart the notebook session after installing the dependencies? I was able to convert the llama weights by using a dev install of transformers.