Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add techforpalestine datasets #36

Merged
merged 2 commits into from
Feb 6, 2024
Merged

add techforpalestine datasets #36

merged 2 commits into from
Feb 6, 2024

Conversation

sterlingwes
Copy link
Contributor

👋🏻 thanks for the great resource

TFP offers three JSON datasets via our website:

  • list of those killed in gaza (14k names as of writing and we're improving the english name translations)
  • daily reports on those killed, injured
  • summary JSON of the latest values from the daily report dataset

README.md Outdated Show resolved Hide resolved
Co-authored-by: Sentientist <[email protected]>
@aborazmeh
Copy link
Owner

Thank you,
I was working on something similar, and I translated many of the names.
I will attach my work here, so you can use it if you found it useful.
martyrs.json

  • Please note that these lists, despite being official (by the Palestinian Ministry of Health), are in no way complete. Even people who lost their lives in October 2023 are not in the lists, as their bodies are still unfound or under the rubble. Maybe we should add a note explaining that.

@aborazmeh aborazmeh merged commit 313aca0 into aborazmeh:main Feb 6, 2024
1 check passed
@sterlingwes sterlingwes deleted the add-tfp-datasets branch February 14, 2024 16:04
@sterlingwes
Copy link
Contributor Author

Thank you @aborazmeh , yes we included the caveats from the ministry under Sources: https://data.techforpalestine.org/docs/killed-in-gaza/#source if you think that's not enough let me know. We'll work on improving how we describe the data though.

Thank you for your list! I'll compare and see if we can improve our translation setup. Can I assume that the ones you've translated are those with a name field without any arabic showing up in it?

@aborazmeh
Copy link
Owner

aborazmeh commented Feb 20, 2024

Can I assume that the ones you've translated are those with a name field without any arabic showing up in it?

Not really. For the sake of consistency, I used regex to replace whole words, so you might find some names partly translated, as the authorities in Palestine uses the quadruple naming system for official documents.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants