Fine-tuning time consumption

[czczccz]

Hi! I found the model infers extremely fast but takes a long time when being fine-tuned. Training on hundreds of samples could take 1 hour. Is this normal?

[wgifford]

Can you provide more information about what dataset you are training on, what hardware, and general details of the trainer config? If the dataset is multivariate with many dimensions training will take longer. For example:

The fine-tuning in this example: https://github.com/ibm-granite-community/granite-timeseries-cookbook/blob/main/recipes/Time_Series/Few-shot_Finetuning_and_Evaluation.ipynb

For that notebook, with batch size = 64, it takes about 26s (on my MacBook Pro) per epoch. For reference this dataset has 12 inputs and 931 records.