Skip to content

Issues: NVIDIA/NeMo-Skills

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

23 Open 14 Closed
23 Open 14 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Change metrics logic to always report all available aggregations
#184 opened Oct 10, 2024 by Kipok
@wedu-nvidia
Expose data preparation commands through ns interface
#174 opened Oct 8, 2024 by Kipok
@wedu-nvidia
Upgrade our stack to trtllm 0.13
#173 opened Oct 7, 2024 by Kipok
Add unittests for cluster config logic
#171 opened Oct 7, 2024 by Kipok
Properly integrate OpenAI's batch api into all generation scripts
#170 opened Oct 7, 2024 by Kipok
Set a good default validation batch size or find a way to disable it
#167 opened Oct 7, 2024 by Kipok
Verify that we can use NIM containers on slurm and locally in a convenient way
#166 opened Oct 7, 2024 by Kipok
Have a way to use only part of a slurm node
#165 opened Oct 7, 2024 by Kipok
Add some simple cli to upload/download data from slurm clusters by using mounts in our configs
#162 opened Oct 3, 2024 by Kipok
Add checks for extra arguments correctness to some of the scripts
#161 opened Oct 3, 2024 by Kipok
Add an option to prepare data in the DPO format (or a separate script)
#160 opened Oct 3, 2024 by Kipok
Add some helper functions to create new pipeline scripts
#159 opened Oct 3, 2024 by Kipok
@wedu-nvidia
Expose nemo_skills/training/prepare_sft_data.py as a pipeline script
#158 opened Oct 3, 2024 by Kipok
Expose nemo_skills/evaluation/fill_majority_answer.py as a pipeline script
#157 opened Oct 3, 2024 by Kipok
Expose nemo_skills/inference/retrieve_similar.py as a pipeline script
#156 opened Oct 3, 2024 by Kipok
It's not possible to run multiple tasks at the same time locally
#155 opened Oct 3, 2024 by Kipok
1
Add another test(s) with pip installable library without -e flag
#154 opened Oct 3, 2024 by Kipok
Add a check that benchmarks parameter in eval is properly formatted
#153 opened Oct 3, 2024 by Kipok
Make all pipeline scripts easily importable
#151 opened Oct 3, 2024 by Kipok
Raise an error in input files are empty
#150 opened Oct 3, 2024 by Kipok
Skip conversion to a tmp model for trtllm if it's present. Add a way to pass parameters to the first stage
#149 opened Oct 3, 2024 by Kipok
Change all scripts in pipeline to explicitly accept any parameters that need to exist on filesystem and check that
#148 opened Oct 3, 2024 by Kipok
Use SSHTunnel for slurm-based start_server requests
#146 opened Oct 3, 2024 by Kipok
ProTip! Adding no:label will show everything without a label.