Skip to content

Releases: MITLibraries/geo-harvester

v1.3.1 Python 3.12 and dependency updates

27 Nov 14:08
cb2977d
Compare
Choose a tag to compare

What's Changed

Full Changelog: v1.3.0...v1.3.1

v1.3.0 Skip OGM suppressed records

24 May 18:16
6a9cd36
Compare
Choose a tag to compare

What's Changed

  • GDT 329 - Skip suppressed OGM records during harvest by @ghukill in #315

Full Changelog: v1.2.1...v1.3.0

v1.2.1 Minimize memory usage preparing EventBridge queues

21 May 20:20
e6b7e62
Compare
Choose a tag to compare

What's Changed

Full Changelog: v1.2.0...v1.2.1

v1.2.0 Alma MARC CLI and Improved Incremental Harvest Error Handling

24 Apr 15:01
85b778d
Compare
Choose a tag to compare

What's Changed

Full Changelog: v1.1.0...v1.2.0

v1.1.0 - Graceful zero record handle and Atom RSS for incremental OGM harvests

05 Apr 13:14
0fd059d
Compare
Choose a tag to compare

What's Changed

  • GDT 267 - Exit harvest early if no records by @ghukill in #254
  • GDT 269 - Incremental OGM harvests use Github RSS feed vs API by @ghukill in #257

Full Changelog: v1.0.0...v1.1.0

v1.0.0 Initial Release

03 Apr 13:44
e727587
Compare
Choose a tag to compare

First production release.

What's Changed

  • GDT 77 initial CLI scaffold and documentation by @ghukill in #1
  • MIT full and incremental harvest fetch records by @ghukill in #5
  • Gdt 94 config and iterator refactor by @ghukill in #6
  • GDT-38: Makefile and GitHub Actions Workflows by @cabutlermit in #2
  • Metadata normalization documentation by @ghukill in #13
  • Skip refetching same SQS message in single harvest by @ghukill in #17
  • Rework ruff noqa linting ignores by @ghukill in #18
  • Scaffold SourceRecord normalization by @ghukill in #16
  • Add normalize step to harvest by @ghukill in #21
  • FGDC and SourceRecord required field methods by @ghukill in #28
  • FGDC optional fields and tests by @ghukill in #38
  • ISO19139 required and optional field normalization by @ghukill in #46
  • Set gbl_suppressed_b from SourceRecord event by @ghukill in #48
  • Harvester write output files by @ghukill in #49
  • Implement JSON schema validation for MITAardvark records by @jonavellecuerdo in #47
  • Re-add CI yaml for Github actions and fix broken tests by @ghukill in #54
  • Fix mapping for FGDC gbl_resourceClass by @ghukill in #60
  • Send EventBridge Events for MIT Harvests by @ghukill in #61
  • Fix CDN host for Dev1 by @ghukill in #84
  • Fix order of coordinates in WKT string by @ghukill in #99
  • Gdt 149 updates from full mit harvest by @ghukill in #111
  • Adjustment for memory constraints by @ghukill in #112
  • OGM Harvester - fetch records by @ghukill in #122
  • Use pygit2 instead of GitPython and OS git binary by @ghukill in #129
  • Quick check for commits via Github API for OGM incremental harvests by @ghukill in #130
  • Add OGM harvest to CLI commands by @ghukill in #134
  • Set single URL for part of dct_references_s by @ghukill in #139
  • Remove SQS check by @ehanson8 in #143
  • Remove bbox requirement from MITAardvark and add WKT validator by @jonavellecuerdo in #138
  • Normalize GBL1 and Aardvark records for OGM harvests by @ghukill in #151
  • OGM harvests do not write metadata to S3 Public CDN by @ghukill in #154
  • Normalize to controlled terms for dct_format_s and gbl_resourceType_sm by @ghukill in #171
  • Fetch and filter records for Alma MARC harvest by @ghukill in #205
  • Encapsulate SourceRecord source and metadata format logic by @ghukill in #221
  • Post normalize data cleanup methods by @ghukill in #233
  • Required fields for MARC normalization by @ghukill in #228
  • Gdt 227 transform alma marc optional fields by @ghukill in #237
  • Prevent error logging for handled OGM harvest errors by @ghukill in #246

New Contributors

Full Changelog: https://github.com/MITLibraries/geo-harvester/commits/v1.0.0