Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is the OntoNotes5.0 dataset marked by Spacy? #42

Open
zhanghanweii opened this issue Dec 5, 2022 · 5 comments
Open

Is the OntoNotes5.0 dataset marked by Spacy? #42

zhanghanweii opened this issue Dec 5, 2022 · 5 comments

Comments

@zhanghanweii
Copy link

Is the OntoNotes5.0 dataset marked by Spacy?

@asahi417
Copy link
Owner

asahi417 commented Dec 5, 2022

Hi, what would that mean to get mark by Spacy?

@zhanghanweii
Copy link
Author

Hello, Because I downloaded your dataset from huggingface, the wasn't in the tokens of the data became "was", "n't". This is the same as Spacy's word segmentation, so I have this question.
I want to label the data according to your data format in the actual data

@zhanghanweii
Copy link
Author

zhanghanweii commented Dec 5, 2022 via email

@asahi417
Copy link
Owner

asahi417 commented Dec 5, 2022

I am not sure whether we used Spacy tokenizer to process the data, but I think I did according to that.

@zhanghanweii
Copy link
Author

Thanks a lot for your answer! !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants