Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upload the ML Model on Hugging Face Hub #54

Open
4 tasks done
tztsai opened this issue Jan 30, 2024 · 4 comments
Open
4 tasks done

Upload the ML Model on Hugging Face Hub #54

tztsai opened this issue Jan 30, 2024 · 4 comments

Comments

@tztsai
Copy link
Collaborator

tztsai commented Jan 30, 2024

For enhancing accessibility and collaboration, we can upload the CAM model and its weights to the Hugging Face Hub. This requires converting the model weights into PyTorch's .pt format to ensure compatibility with the Hub's infrastructure, thus necessitating the adoption of ftorch. The conversion process will enable the broader climate science and machine learning communities to easily access, utilize, and contribute to the model's development. This task involves:

  • Converting Weights: Develop a script or utilize existing tools to convert the Fortran model weights into .pt format.
  • Documentation: Provide detailed documentation on the model architecture, conversion process, and instructions for use, ensuring that users can effectively leverage the model.
  • Testing and Validation: Before uploading, test the converted weights in PyTorch to verify their integrity and performance.
  • Hugging Face Upload: Create a repository on the Hugging Face Hub and upload the .pt formatted weights, along with the necessary documentation.
@tztsai tztsai self-assigned this Feb 21, 2024
@tztsai tztsai changed the title Upload the model weights on Hugging Face Hub Upload the model on Hugging Face Hub Feb 27, 2024
@tztsai tztsai changed the title Upload the model on Hugging Face Hub Upload the ML Model on Hugging Face Hub Feb 28, 2024
@tztsai
Copy link
Collaborator Author

tztsai commented May 2, 2024

I've uploaded the ML model (as an initial commit) on the Hugging Face Hub.

@jatkinson1000
Copy link
Member

This should be added to the documentation to close this issue.
Note also that the weights have changed (see #66) so would need re-uploading.

@MarionBWeinzierl perhaps this is related to #65 but can be considered of lower priority?

@MarionBWeinzierl
Copy link
Collaborator

This should be added to the documentation to close this issue. Note also that the weights have changed (see #66) so would need re-uploading.

@MarionBWeinzierl perhaps this is related to #65 but can be considered of lower priority?

I would leave this as a separate issue (maybe mentioned in #65), but agree that it should be added to the documentation.

@tztsai
Copy link
Collaborator Author

tztsai commented Sep 10, 2024

I've updated the NN weights (from qobs...nc to NN_weights_YOG_convection.nc) and updated the documentation on https://huggingface.co/ICCS/cam-ml-yog-v0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants