Releases: MITLibraries/geo-harvester
Releases · MITLibraries/geo-harvester
v1.3.1 Python 3.12 and dependency updates
v1.3.0 Skip OGM suppressed records
What's Changed
Full Changelog: v1.2.1...v1.3.0
v1.2.1 Minimize memory usage preparing EventBridge queues
What's Changed
- Save only record fields required for EventBridge events by @jonavellecuerdo in #314
Full Changelog: v1.2.0...v1.2.1
v1.2.0 Alma MARC CLI and Improved Incremental Harvest Error Handling
What's Changed
- Add CLI command and workflow for Alma harvests by @jonavellecuerdo in #271
- GDT 290 - Queue and Dedupe EventBridge Events for Incremental MIT Harvests by @ghukill in #283
- Gdt 275 sqs missing file by @ehanson8 in #286
- Handle missing source record for logging by @ghukill in #289
Full Changelog: v1.1.0...v1.2.0
v1.1.0 - Graceful zero record handle and Atom RSS for incremental OGM harvests
What's Changed
- GDT 267 - Exit harvest early if no records by @ghukill in #254
- GDT 269 - Incremental OGM harvests use Github RSS feed vs API by @ghukill in #257
Full Changelog: v1.0.0...v1.1.0
v1.0.0 Initial Release
First production release.
What's Changed
- GDT 77 initial CLI scaffold and documentation by @ghukill in #1
- MIT full and incremental harvest fetch records by @ghukill in #5
- Gdt 94 config and iterator refactor by @ghukill in #6
- GDT-38: Makefile and GitHub Actions Workflows by @cabutlermit in #2
- Metadata normalization documentation by @ghukill in #13
- Skip refetching same SQS message in single harvest by @ghukill in #17
- Rework ruff noqa linting ignores by @ghukill in #18
- Scaffold SourceRecord normalization by @ghukill in #16
- Add normalize step to harvest by @ghukill in #21
- FGDC and SourceRecord required field methods by @ghukill in #28
- FGDC optional fields and tests by @ghukill in #38
- ISO19139 required and optional field normalization by @ghukill in #46
- Set gbl_suppressed_b from SourceRecord event by @ghukill in #48
- Harvester write output files by @ghukill in #49
- Implement JSON schema validation for MITAardvark records by @jonavellecuerdo in #47
- Re-add CI yaml for Github actions and fix broken tests by @ghukill in #54
- Fix mapping for FGDC gbl_resourceClass by @ghukill in #60
- Send EventBridge Events for MIT Harvests by @ghukill in #61
- Fix CDN host for Dev1 by @ghukill in #84
- Fix order of coordinates in WKT string by @ghukill in #99
- Gdt 149 updates from full mit harvest by @ghukill in #111
- Adjustment for memory constraints by @ghukill in #112
- OGM Harvester - fetch records by @ghukill in #122
- Use pygit2 instead of GitPython and OS git binary by @ghukill in #129
- Quick check for commits via Github API for OGM incremental harvests by @ghukill in #130
- Add OGM harvest to CLI commands by @ghukill in #134
- Set single URL for part of dct_references_s by @ghukill in #139
- Remove SQS check by @ehanson8 in #143
- Remove bbox requirement from MITAardvark and add WKT validator by @jonavellecuerdo in #138
- Normalize GBL1 and Aardvark records for OGM harvests by @ghukill in #151
- OGM harvests do not write metadata to S3 Public CDN by @ghukill in #154
- Normalize to controlled terms for
dct_format_s
andgbl_resourceType_sm
by @ghukill in #171 - Fetch and filter records for Alma MARC harvest by @ghukill in #205
- Encapsulate SourceRecord source and metadata format logic by @ghukill in #221
- Post normalize data cleanup methods by @ghukill in #233
- Required fields for MARC normalization by @ghukill in #228
- Gdt 227 transform alma marc optional fields by @ghukill in #237
- Prevent error logging for handled OGM harvest errors by @ghukill in #246
New Contributors
- @ghukill made their first contribution in #1
- @cabutlermit made their first contribution in #2
- @jonavellecuerdo made their first contribution in #47
- @ehanson8 made their first contribution in #143
Full Changelog: https://github.com/MITLibraries/geo-harvester/commits/v1.0.0