'do_sample' model default cannot be overridden

[Zoher15]

System Info

transformers 4.47.1, python 3.10.

Basically while using Qwen-2-VL-Instruct (default config sets do_sample=True), if I set the model_kwargs with do_sample=False, I am unable to override the model_config. I had to make changes to the generations/utils.py to override....

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

1. Use a model like Qwen2-VL-Instruct with default config using do_sample = True
2. Try to override the behavior through kwargs used during model.generate

Expected behavior

If I set do_sample=False during generation, the default config of the model should be overridden

[Rocketknight1]

cc @zucchini-nlp @gante