Romancal 0.12.0 (DMS build 23Q4_B11)

This release includes updates for association processing in the pipeline, added the reference pixel step, and some improvements in memory usage. It also includes updates for roman_datamodels for additional unit checking. The input data files now include updated quantities and the CRDS context is now at roman_0051.

What's Changed

• Update the CI by @WilliamJamieson in #706
• More CI updates by @WilliamJamieson in #709
• Fix returned result from SourceDetectionStep. by @mairanteodoro in #700
• Documentation update for rtd and the contrib by @sosey in #674
• Initial sky matching implementation by @bmorris3 in #687
• Move skymatch changelog entry to correct version by @WilliamJamieson in #713
• Replace add_ref_common with mk_ref_common by @WilliamJamieson in #712
• Add ModelContainer to romancal.datamodels. by @mairanteodoro in #710
• RCAL-590: add fit results to datamodel's meta. by @mairanteodoro in #714
• Update reference pixel docs. by @schlafly in #716
• Add a pip list step after the overrides are injected by @WilliamJamieson in #711
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #715
• add sdpdeps toxenv by @zacharyburnett in #708
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #718
• Move is_assocation to romancal by @WilliamJamieson in #719
• Fix typo in S_REGION string. by @mairanteodoro in #720
• Updates for maker_utils API changes by @WilliamJamieson in #717
• revert astropy prerelease wheel spec and use nightly Scipy wheel index by @zacharyburnett in #696
• Add regression test for TweakReg. by @mairanteodoro in #707
• update jump detection for stcal changes by @braingram in #723
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #722
• RCAL-604 update ramp fitting unit test for stcal 1.4.0 by @ddavis-stsci in #725
• RCAL-432 Update info string to use the same syntax by @ddavis-stsci in #721
• Increase code coverage for TweakReg. by @mairanteodoro in #724
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #766
• Remove myst parser from docs config by @WilliamJamieson in #773
• Add jquery sphinx to fix doc search by @WilliamJamieson in #768
• Register skymatch with stpipe by @WilliamJamieson in #770
• Use same changelog workflow as the rest of the roman repositories by @WilliamJamieson in #772
• Remove AWS install option by @WilliamJamieson in #767
• Update asdf dependency by @WilliamJamieson in #777
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #776
• remove unused extras by @zacharyburnett in #784
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #782
• Make test randomness deterministic by @WilliamJamieson in #771
• Try to avoid copying data models. by @schlafly in #774
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #788
• update build instructions in README by @zacharyburnett in #790
• RCAL-485, RCAL-558: Implement the reference pixel correction by @WilliamJamieson in #704
• BOT: Changelog check has moved by @pllim in #792
• Actually use the astropy nightly wheel. by @WilliamJamieson in #795
• rcal-606 Have source detection and tweakreg skip spectral data by @ddavis-stsci in #798
• RCAL-617 Update readme for release 11 (23Q3_B10) & placeholders for 12 (23Q4_B11) by @ddavis-stsci in #799
• pin numpy to >=1.22 by @zacharyburnett in #800
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #801
• Remove numpy 2.0 hack by @WilliamJamieson in #797
• pin sphinx_rtd_theme to newer version by @zacharyburnett in #803
• Use CRDS public server by @nden in #805
• Rcal 596 Add association processing to the pipeline code by @ddavis-stsci in #802
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #806
• RCAL-631 Update saturation logic for spectral data by @ddavis-stsci in #824
• Remove usage of pkg_resources by @WilliamJamieson in #829
• Rcal 624 regtest updates for B11, rad & roman_datamodels pin by @ddavis-stsci in #834
• rcal-627 Add metrics logger to regtests by @ddavis-stsci in #831
• metadata for 0.12.0 release by @zacharyburnett in #839

New Contributors

• @sosey made their first contribution in #674
• @schlafly made their first contribution in #716
• @pllim made their first contribution in #792

Full Changelog: 0.11.0...0.12.0

Romancal 0.11.0 (DMS build 23Q3_B10)

Summary

This release includes updates to support python 3.11, the tweakreg and source catalog steps, initial associations for survey data, the data files now include updated quantities, the CRDS context is now at roman_0047, and we’ve updated and added documentation for the pipeline steps.

What's Changed

• move pytest markers to pyproject.toml by @braingram in #647
• cache packages in CI workflow by @zacharyburnett in #618
• use ruff in place of flake8 by @zacharyburnett in #570
• Bug fix: make sure ASDF is not closed prematurely. by @mairanteodoro in #651
• Clean up and small refactoring. by @mairanteodoro in #652
• Raise exception whenever tweakreg_catalog is missing. by @mairanteodoro in #653
• RCAL-486: Update Maker Utlity Imports by @PaulHuwe in #654
• remove upper pins from dependencies by @zacharyburnett in #656
• Start using code formatters by @WilliamJamieson in #645
• refactor toxenvs, use OpenAstronomy workflows, and move MacOS jobs to schedule by @zacharyburnett in #612
• RCAL-482 by @WilliamJamieson in #658
• RCAL-467: Implement tests for Roman's TweakReg and ModelContainer. by @mairanteodoro in #655
• run tests on minimum dependencies by @zacharyburnett in #664
• Adding source detection step by @cshanahan1 in #608
• Bugfix for source_detection's test_outputs by @WilliamJamieson in #665
• RCAL-481: Remove use of pytest-openfiles by @WilliamJamieson in #666
• add seed for random noise/gaussian generation in tests by @cshanahan1 in #668
• import tomli as tomllib for docs builds before Python 3.11 by @zacharyburnett in #657
• Fix source detection object instantiation. by @PaulHuwe in #669
• add code owners file by @zacharyburnett in #670
• use built-in concurrency configuration for duplicate workflows by @zacharyburnett in #672
• TweakReg: update method to fetch catalog data. by @mairanteodoro in #671
• Remove codecov test dependency by @WilliamJamieson in #677
• TweakReg: update to use VO instead of astroquery. by @mairanteodoro in #678
• Update installation command for macOS system. by @mairanteodoro in #679
• RCAL-490 by @WilliamJamieson in #676
• TweakReg: doc updates. by @mairanteodoro in #673
• SCSB-63 inject dependency overrides after build by @zacharyburnett in #680
• remove stdatamodels ValidationWarning from test by @braingram in #682
• fix output catalog attribute by @cshanahan1 in #684
• override package dependencies with requirements file when requested by @zacharyburnett in #685
• explicitly call binary path in codecov upload by @zacharyburnett in #683
• Rcal-476 Add GBTDS associations for Full, Pass, and segment by @ddavis-stsci in #661
• enable step summary for pytest results by @zacharyburnett in #691
• set source detection cal_step to complete by @cshanahan1 in #690
• Add epoch parameter to fetch catalog data. by @mairanteodoro in #686
• TweakReg: handle new source_detection attribute. by @mairanteodoro in #681
• drop support for Python 3.8 by @zacharyburnett in #694
• test against nightly builds of astropy, scipy, and numpy by @zacharyburnett in #695
• Upgrade romancal python to python-3.11, update crds context by @ddavis-stsci in #693
• Compatibility fix in tweakreg test for rdm#164 by @bmorris3 in #697
• Added simple outlier detection step. by @PaulHuwe in #689
• RCAL-561: improve error-handling for TweakReg when fetching data from VO API service. by @mairanteodoro in #698
• RCAL-567 Update unit tests to add tmpdir for test files by @ddavis-stsci in #702
• RCAL-548 Include dq flag for GW_AFFECTED_DATA by @ddavis-stsci in #699
• Update CRDS context for 23Q3_B10 by @ddavis-stsci in #703
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #662
• Update roman crds server to test so that the latest updates are used by @ddavis-stsci in #705

New Contributors

• @braingram made their first contribution in #647
• @bmorris3 made their first contribution in #697
• @pre-commit-ci made their first contribution in #662

Full Changelog: 0.10.0...0.11.0

Romancal v 0.10.0 (DMS Build 9)

What's Changed

• open for post-0.9.0 development by @nden in #603
• Rcal-402 Add Flags for science data affected by guide window reads by @ddavis-stsci in #599
• use tox and set up CRDS caching when server is accessible by @zacharyburnett in #551
• move build configuration into pyproject.toml by @zacharyburnett in #512
• rename toxenvs to be more explicit by @zacharyburnett in #605
• change duplicate numpy120 to numpy122 by @zacharyburnett in #604
• add freetds to packages to provide sqlfront.h for building pymssql by @zacharyburnett in #607
• changes for tox>=4.0 release by @zacharyburnett in #610
• consolidate CI jobs into include: in initial test matrix by @zacharyburnett in #611
• RCAL-431 Update suffix and CRDS context by @ddavis-stsci in #609
• Rcal 406 science array quantities by @PaulHuwe in #613
• Revert "Rcal 406 science array quantities" by @PaulHuwe in #614
• add Datadog CI agent by @zacharyburnett in #615
• [hotfix] fix CI on PRs from forks by @zacharyburnett in #617
• fix deprecation warnings ahead of Pytest 8.0 by @zacharyburnett in #597
• move scripts into subpackage to make them entry points by @zacharyburnett in #620
• fix branch filter to trigger on release branches by @zacharyburnett in #619
• update conda in Jenkins environment by @zacharyburnett in #621
• add environment variables to Datadog run by @zacharyburnett in #623
• RCAL-460 Update default CR rejections in jump_step by @ddavis-stsci in #625
• RCAL-440 Add support for Reference File Quantities by @PaulHuwe in #624
• Rcal 406 science array quantities by @PaulHuwe in #616
• Start using pre-commit by @WilliamJamieson in #622
• RCAL-471 Update crds context and output units for the linearity step by @ddavis-stsci in #646
• Rcal 444 Initial association code with asn_from_list and some basic rules by @ddavis-stsci in #642
• RCAL-451: Implement TweakRegStep. by @mairanteodoro in #643
• RCAL-479 Test for PSF keywords (DMS-136) by @ddavis-stsci in #648

Full Changelog: 0.9.0...0.10.0

Romancal v 0.9.0 (DMS Build 8)

• Additional changes to Roman's RTD page content [#600]
• New Roman's RTD page layout [#596]
• pin numpy to >=1.20 [#592]
• jump
• Changes for new keywords (currently unused by Roman) to control snowball and shower flagging in jump detection. [#593]
• photom
• Updates so that the default suffix is used for spectroscopic data. [#594]
• Change photom step to forcibly set the photometric keywords to None for spectroscopic data. [#591]

Romancal release 0.8.1 to support DMS build 22Q4_B7 (build 0.7) for Sept 15

What's Changed

• pin asdf to newest patch version to fix dependency for newest jsonschema release by @zacharyburnett in #562
• pin roman_datamodels to newest feature release by @zacharyburnett in #563

Full Changelog: 0.8.0...0.8.1

Romancal release 0.8.0 to support DMS build 22Q4_B7 (build 0.7) for Sept 15

What's Changed

• Clean up file generated when running tests by @WilliamJamieson in #509
• Rcal 346 spec photom by @PaulHuwe in #513
• Add distortion transform to assign_wcs by @WilliamJamieson in #510
• RCAL-330: Change Reference Datamodel Storage Type in Steps by @PaulHuwe in #514
• RCAL-349: Update RomanCal For Error Dimensionality Fix by @PaulHuwe in #520
• RCAL-309: Ramp Fit Multiprocessing IndexError by @PaulHuwe in #523
• rcal-310 Update code to update suffixes, update regtests for the new names by @ddavis-stsci in #521
• update pull request template to be more explicit by @zacharyburnett in #527
• RCAL-341: Update Flat field code and tests to use N/A from CRDS by @PaulHuwe in #528
• Rcal 295 compute s region by @mairanteodoro in #539
• copy changelog workflow from asdf by @zacharyburnett in #522
• Docs update on the distortion file. by @mairanteodoro in #542
• Make add_s_region private and reformat docstring. by @mairanteodoro in #543
• release numpy requirement by @zacharyburnett in #544
• use GitHub Actions to cache environments and use dependent CI workflow structure by @zacharyburnett in #511
• RCAL-353: Saturation effects in the rcal pipeline by @PaulHuwe in #541
• freeze action versions by @zacharyburnett in #546
• RCAL-368 Changed optical element W146 to F146. by @PaulHuwe in #552
• update stpipe requirement to >=0.4.1 by @zacharyburnett in #545
• RCAL-332 populate meta.ref_file by @cshanahan1 in #492
• automatically add labels to pull requests based on changed files by @zacharyburnett in #550
• fix input file by @cshanahan1 in #553
• update version of roman_datamodels by @nden in #555
• Unpin stpipe version in development requirements by @ddavis-stsci in #556
• fix flake8 warnings by @zacharyburnett in #557
• Update CRDS Context by @ddavis-stsci in #559
• Fix photom test by @ddavis-stsci in #560
• fix README badge, remove redundant section by @zacharyburnett in #561
• Add tests for SOC-587. by @mairanteodoro in #549

New Contributors

• @WilliamJamieson made their first contribution in #509
• @mairanteodoro made their first contribution in #539

Full Changelog: 0.7.1...0.8.0

Romancal release 0.7.1 to support DMS build 22Q3_B6 (build 0.6) for June 15, 2022

What's Changed

• Prepare main branch for further development by @ddavis-stsci in #454
• Rcal-304 Add JenkinsfileRT_dev and requirements-dev.txt in preperation for SPB creating a develop Jenkins Job by @ddavis-stsci in #451
• RCAL-289 Updates for DMS release 0.5 by @ddavis-stsci in #457
• add mask model by @cshanahan1 in #438
• GH464 Update reqirements-dev.txt by @ddavis-stsci in #465
• 464 update requirements dev for rad by @ddavis-stsci in #466
• Rcal 46 Initial documentation for error propagation by @ddavis-stsci in #476
• RCAL-112: Update photom step for WFI data by @PaulHuwe in #469
• RCAL-327 Allow Nan's in linearity ref file remove romanad from setup. by @ddavis-stsci in #484
• RCAL-322: Tests for SOC-588 (Absolute photometric calibration) by @PaulHuwe in #479
• new param for saturation, continute to not flag adjacent pixels for now by @cshanahan1 in #483
• rcal-329 Removal of copy commands that are not required by @ddavis-stsci in #487
• RCAL-324: Update documentation for photom step by @PaulHuwe in #488
• Update CRDS context to roman_0031.pmap by @ddavis-stsci in #491
• RCAL-318: Update the reference file document for reftype "distortion" by @PaulHuwe in #493
• Update crds context to 0032 by @ddavis-stsci in #494
• Update okify script to work with Roman artifactory data by @ddavis-stsci in #495
• RCAL-315 Updates for regression tests, current input files and data m… by @ddavis-stsci in #496
• RCAL-339 Update photom step to skip spectroscopic data by @ddavis-stsci in #498
• Pin b06 requirements by @ddavis-stsci in #499
• Updates for further development by @ddavis-stsci in #501
• JP-374: ZEROFRAME processing to STCAL changed function signatures. by @kmacdonald-stsci in #500
• Rcal-340 Updates to flat field code to handle no flat for grism data & remove skip by @ddavis-stsci in #504
• JP-2581: enable multiprocessing for jump by @cshanahan1 in #503
• Account for possible zero frame in linearity by @nden in #506
• Updates for stcal by @ddavis-stsci in #507
• prepare main branch for 0.7.1 release by @zacharyburnett in #508

New Contributors

• @zacharyburnett made their first contribution in #508

Full Changelog: 0.6.0...0.7.1

Romancal release 0.7.0 to support DMS build 22Q3_B6 (build 0.6) for June 15, 2022

Romancal release 0.7.0 includes support for MA table numbers, added the photom step for imaging data, updated the linearity correction, and made improvements for memory management.

Romancal release 0.6.0 to support DMS build 0.5 for March 15, 2022

This release includes support for new roman datamodels, reference pixel schemas, and the exposure level pipeline.

romancal release 0.5.0

Romancal release 0.5.0 to support DMS build 0.4 for Dec 15, 2021