Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] Training for conformer model #291

Open
SEOLJINYOUNG opened this issue Nov 11, 2024 · 2 comments
Open

[Question] Training for conformer model #291

SEOLJINYOUNG opened this issue Nov 11, 2024 · 2 comments

Comments

@SEOLJINYOUNG
Copy link

I'm trying to learn a Conformer model using data and a custom word dictionary.
My learning environment uses two GPUs, and the dataset uses commonvoice data.

Looking at this log, can i see that learning is progressing normally?

image

image

And do I need to see the log below?
INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 2, group_size = 2, implementation = CommunicationImplementation.AUTO, num_packs = 1

Thank you in advance for your response.

@Aegon007
Copy link

Aegon007 commented Nov 11, 2024 via email

@nglehuy
Copy link
Collaborator

nglehuy commented Nov 13, 2024

@SEOLJINYOUNG I see you use conformer-ctc, the conformer-ctc are currently suffering the nan loss problem and I'm still investigating that
Meanwhile, you can try conformer-transducer model

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants