Script to run the original model/exported model

[alphaversedev]

Hi,
Would appreciate if someone could point me to a script that can run against the original model (not from HuggingFace remotely but from a local path) - this is for comparison before and after the finetuning, and a script to run against the model after running the export_model script ?

many thanks !

[hiyouga]

You could use the inference script without the adapter_name_or_path to infer the original model or exported model