Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DRP not finding master bias, etc #160

Open
shawnknabel opened this issue Nov 27, 2023 · 5 comments
Open

DRP not finding master bias, etc #160

shawnknabel opened this issue Nov 27, 2023 · 5 comments

Comments

@shawnknabel
Copy link

Hello! I am trying to run the KCWI_DRP on my ubuntu machine. I have a conda environment with python3.7 and up to date packages. I got the proprietary data from the KOA under my program, and the "raw" files are split into two subdirectories "cal" and "sci". I am getting an error that appears to be saying it can't find any of the calibration files. I had a similar-ish problem last year and submitted an issue #126 and have consulted those responses in my troubleshooting efforts.

I would appreciate any assistance. Thank you very much!
With warmest regards,
Shawn

Terminal commands and output below.

(kcwidrp) shawnknabel@mikado:/data/raw_data/KECK_2023_08_23_KCWI/KOA_56810/KCWI/raw$ ls
cal  sci
(kcwidrp) shawnknabel@mikado:/data/raw_data/KECK_2023_08_23_KCWI/KOA_56810/KCWI/raw$ reduce_kcwi -b -f **/KB*.fits -g -c /usr/local/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/kcwidrp/configs/kcwi.cfg
Directory logs has been ### created
Directory plots has been created
Directory redux has been created
2023-11-27 14:17:05:KCWI:INFO: Using proc table file kcwib.proc
2023-11-27 14:17:05:KCWI:INFO: proc table file not found: kcwib.proc
2023-11-27 14:17:05:DRPF:INFO: Framework initialized
2023-11-27 14:17:09:DRPF:INFO: Framework main loop started
2023-11-27 14:17:09:DRPF:ERROR: Exception Cannot pull session document because we failed to connect to the server (to start the server, try the 'bokeh serve' command) while invoking StartBokeh
Traceback (most recent call last):
  File "/usr/local/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/core/framework.py", line 229, in execute
    action_output = pipeline.get_action(action_name)(action, context)
  File "/usr/local/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/pipelines/base_pipeline.py", line 84, in f
    return obj.apply()
  File "/usr/local/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/primitives/base_primitive.py", line 57, in apply
    self.output = self._perform()
  File "/usr/local/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/kcwidrp/primitives/StartBokeh.py", line 27, in _perform
    session = pull_session()
  File "/usr/local/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/bokeh/client/session.py", line 119, in pull_session
    session.pull()
  File "/usr/local/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/bokeh/client/session.py", line 348, in pull
    raise IOError("Cannot pull session document because we failed to connect to the server (to start the server, try the 'bokeh serve' command)")
OSError: Cannot pull session document because we failed to connect to the server (to start the server, try the 'bokeh serve' command)
2023-11-27 14:17:09:DRPF:INFO: Event failed: name start_bokeh, action StartBokeh, arg name undef, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: cal/KB.20230824.54257.90.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name cal/KB.20230824.54257.90.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: cal/KB.20230824.54943.55.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name cal/KB.20230824.54943.55.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: cal/KB.20230824.55243.43.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name cal/KB.20230824.55243.43.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: cal/KB.20230824.55514.75.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name cal/KB.20230824.55514.75.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: cal/KB.20230824.55797.29.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name cal/KB.20230824.55797.29.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: cal/KB.20230824.56082.89.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name cal/KB.20230824.56082.89.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: cal/KB.20230824.56366.45.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name cal/KB.20230824.56366.45.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: cal/KB.20230824.56623.49.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name cal/KB.20230824.56623.49.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.39415.75.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.39415.75.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.40694.84.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.40694.84.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.41950.49.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.41950.49.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.43213.30.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.43213.30.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.44412.86.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.44412.86.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.46825.17.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.46825.17.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.48033.94.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.48033.94.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.49238.56.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.49238.56.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.50442.17.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.50442.17.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.51659.70.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.51659.70.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.52864.74.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.52864.74.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.53349.24.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.53349.24.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.53523.69.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.53523.69.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.53813.39.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.53813.39.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ******* ADD to DATAFRAME ONLY: sci/KB.20230824.53990.87.fits
2023-11-27 14:17:09:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name sci/KB.20230824.53990.87.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ------------------- Ingesting file cal/KB.20230824.54257.90.fits -------------------
2023-11-27 14:17:09:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in cal/KB.20230824.54257.90.fits
2023-11-27 14:17:09:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:09:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:09:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:09:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:09:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:09:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:09:KCWI:INFO: Target type is MARC
2023-11-27 14:17:09:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:09:KCWI:WARNING: Cannot reduce TWIFLAT frame.
2023-11-27 14:17:09:KCWI:WARNING: Missing master bias.
2023-11-27 14:17:09:KCWI:WARNING: Missing master arc
2023-11-27 14:17:09:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:09:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name cal/KB.20230824.54257.90.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ------------------- Ingesting file cal/KB.20230824.54943.55.fits -------------------
2023-11-27 14:17:09:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in cal/KB.20230824.54943.55.fits
2023-11-27 14:17:09:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:09:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:09:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:09:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:09:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:09:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:09:KCWI:INFO: Target type is MARC
2023-11-27 14:17:09:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:09:KCWI:WARNING: Cannot reduce TWIFLAT frame.
2023-11-27 14:17:09:KCWI:WARNING: Missing master bias.
2023-11-27 14:17:09:KCWI:WARNING: Missing master arc
2023-11-27 14:17:09:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:09:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name cal/KB.20230824.54943.55.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ------------------- Ingesting file cal/KB.20230824.55243.43.fits -------------------
2023-11-27 14:17:09:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in cal/KB.20230824.55243.43.fits
2023-11-27 14:17:09:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:09:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:09:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:09:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:09:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:09:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:09:KCWI:INFO: Target type is MARC
2023-11-27 14:17:09:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:09:KCWI:WARNING: Cannot reduce TWIFLAT frame.
2023-11-27 14:17:09:KCWI:WARNING: Missing master bias.
2023-11-27 14:17:09:KCWI:WARNING: Missing master arc
2023-11-27 14:17:09:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:09:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name cal/KB.20230824.55243.43.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ------------------- Ingesting file cal/KB.20230824.55514.75.fits -------------------
2023-11-27 14:17:09:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in cal/KB.20230824.55514.75.fits
2023-11-27 14:17:09:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:09:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:09:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:09:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:09:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:09:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:09:KCWI:INFO: Target type is MARC
2023-11-27 14:17:09:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:09:KCWI:WARNING: Cannot reduce TWIFLAT frame.
2023-11-27 14:17:09:KCWI:WARNING: Missing master bias.
2023-11-27 14:17:09:KCWI:WARNING: Missing master arc
2023-11-27 14:17:09:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:09:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name cal/KB.20230824.55514.75.fits, recurr False
2023-11-27 14:17:09:KCWI:INFO: ------------------- Ingesting file cal/KB.20230824.55797.29.fits -------------------
2023-11-27 14:17:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in cal/KB.20230824.55797.29.fits
2023-11-27 14:17:10:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:10:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MARC
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:WARNING: Cannot reduce TWIFLAT frame.
2023-11-27 14:17:10:KCWI:WARNING: Missing master bias.
2023-11-27 14:17:10:KCWI:WARNING: Missing master arc
2023-11-27 14:17:10:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name cal/KB.20230824.55797.29.fits, recurr False
2023-11-27 14:17:10:KCWI:INFO: ------------------- Ingesting file cal/KB.20230824.56082.89.fits -------------------
2023-11-27 14:17:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in cal/KB.20230824.56082.89.fits
2023-11-27 14:17:10:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:10:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MARC
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:WARNING: Cannot reduce TWIFLAT frame.
2023-11-27 14:17:10:KCWI:WARNING: Missing master bias.
2023-11-27 14:17:10:KCWI:WARNING: Missing master arc
2023-11-27 14:17:10:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name cal/KB.20230824.56082.89.fits, recurr False
2023-11-27 14:17:10:KCWI:INFO: ------------------- Ingesting file cal/KB.20230824.56366.45.fits -------------------
2023-11-27 14:17:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in cal/KB.20230824.56366.45.fits
2023-11-27 14:17:10:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:10:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MARC
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:WARNING: Cannot reduce TWIFLAT frame.
2023-11-27 14:17:10:KCWI:WARNING: Missing master bias.
2023-11-27 14:17:10:KCWI:WARNING: Missing master arc
2023-11-27 14:17:10:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name cal/KB.20230824.56366.45.fits, recurr False
2023-11-27 14:17:10:KCWI:INFO: ------------------- Ingesting file cal/KB.20230824.56623.49.fits -------------------
2023-11-27 14:17:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in cal/KB.20230824.56623.49.fits
2023-11-27 14:17:10:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:10:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MARC
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:WARNING: Cannot reduce TWIFLAT frame.
2023-11-27 14:17:10:KCWI:WARNING: Missing master bias.
2023-11-27 14:17:10:KCWI:WARNING: Missing master arc
2023-11-27 14:17:10:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name cal/KB.20230824.56623.49.fits, recurr False
2023-11-27 14:17:10:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.53523.69.fits -------------------
2023-11-27 14:17:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.53523.69.fits
2023-11-27 14:17:10:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:10:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MARC
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:10:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:10:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:10:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:10:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:10:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:10:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.53523.69.fits, recurr False
2023-11-27 14:17:10:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.53813.39.fits -------------------
2023-11-27 14:17:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.53813.39.fits
2023-11-27 14:17:10:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:10:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MARC
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:10:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:10:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:10:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:10:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:10:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:10:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.53813.39.fits, recurr False
2023-11-27 14:17:10:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.53990.87.fits -------------------
2023-11-27 14:17:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.53990.87.fits
2023-11-27 14:17:10:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:10:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MARC
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:10:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:10:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:10:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:10:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:10:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:10:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.53990.87.fits, recurr False
2023-11-27 14:17:10:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.39415.75.fits -------------------
2023-11-27 14:17:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.39415.75.fits
2023-11-27 14:17:10:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:10:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MARC
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:10:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:10:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:10:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:10:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:10:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:10:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.39415.75.fits, recurr False
2023-11-27 14:17:10:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.40694.84.fits -------------------
2023-11-27 14:17:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.40694.84.fits
2023-11-27 14:17:10:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:10:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MARC
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:10:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:10:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:10:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:10:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:10:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:10:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.40694.84.fits, recurr False
2023-11-27 14:17:10:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.41950.49.fits -------------------
2023-11-27 14:17:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.41950.49.fits
2023-11-27 14:17:10:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:10:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MARC
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:10:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:10:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:10:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:10:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:10:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:10:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:10:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:10:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:10:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:10:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.41950.49.fits, recurr False
2023-11-27 14:17:10:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.43213.30.fits -------------------
2023-11-27 14:17:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.43213.30.fits
2023-11-27 14:17:11:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:11:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MARC
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:11:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:11:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:11:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:11:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:11:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:11:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.43213.30.fits, recurr False
2023-11-27 14:17:11:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.44412.86.fits -------------------
2023-11-27 14:17:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.44412.86.fits
2023-11-27 14:17:11:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:11:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MARC
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:11:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:11:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:11:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:11:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:11:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:11:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.44412.86.fits, recurr False
2023-11-27 14:17:11:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.46825.17.fits -------------------
2023-11-27 14:17:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.46825.17.fits
2023-11-27 14:17:11:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:11:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MARC
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:11:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:11:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:11:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:11:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:11:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:11:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.46825.17.fits, recurr False
2023-11-27 14:17:11:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.48033.94.fits -------------------
2023-11-27 14:17:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.48033.94.fits
2023-11-27 14:17:11:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:11:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MARC
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:11:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:11:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:11:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:11:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:11:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:11:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.48033.94.fits, recurr False
2023-11-27 14:17:11:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.49238.56.fits -------------------
2023-11-27 14:17:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.49238.56.fits
2023-11-27 14:17:11:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:11:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MARC
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:11:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:11:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:11:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:11:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:11:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:11:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.49238.56.fits, recurr False
2023-11-27 14:17:11:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.50442.17.fits -------------------
2023-11-27 14:17:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.50442.17.fits
2023-11-27 14:17:11:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:11:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MARC
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:11:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:11:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:11:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:11:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:11:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:11:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.50442.17.fits, recurr False
2023-11-27 14:17:11:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.51659.70.fits -------------------
2023-11-27 14:17:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.51659.70.fits
2023-11-27 14:17:11:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:11:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MARC
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:11:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:11:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:11:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:11:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:11:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:11:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.51659.70.fits, recurr False
2023-11-27 14:17:11:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.52864.74.fits -------------------
2023-11-27 14:17:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.52864.74.fits
2023-11-27 14:17:11:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:11:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MARC
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:11:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:11:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:11:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:11:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:11:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:11:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.52864.74.fits, recurr False
2023-11-27 14:17:11:KCWI:INFO: ------------------- Ingesting file sci/KB.20230824.53349.24.fits -------------------
2023-11-27 14:17:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in sci/KB.20230824.53349.24.fits
2023-11-27 14:17:11:KCWI:INFO: Looking for MBIAS frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MBIAS
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009
2023-11-27 14:17:11:KCWI:INFO: Looking for MARC frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MARC
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MFLAT frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MFLAT
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MDOME frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MDOME
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:INFO: Looking for MTWIF frames
2023-11-27 14:17:11:KCWI:INFO: Camera is BLUE
2023-11-27 14:17:11:KCWI:INFO: Target type is MTWIF
2023-11-27 14:17:11:KCWI:INFO: Looking for frames with STATEID = 64e6b7c46522234a6092fdd0 (Knabel23AugConfig)
2023-11-27 14:17:11:KCWI:WARNING: Cannot reduce OBJECT frame. Found:
2023-11-27 14:17:11:KCWI:WARNING:       MBIAS: 0
2023-11-27 14:17:11:KCWI:WARNING:       MARC: 0
2023-11-27 14:17:11:KCWI:WARNING:       MFLAT: 0
2023-11-27 14:17:11:KCWI:WARNING:       MDOME: 0
2023-11-27 14:17:11:KCWI:WARNING:       MTWIF: 0
2023-11-27 14:17:11:KCWI:WARNING: Input frame cannot be reduced. Exiting
2023-11-27 14:17:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name sci/KB.20230824.53349.24.fits, recurr False
2023-11-27 14:17:12:DRPF:INFO: No new events - do nothing
2023-11-27 14:17:12:DRPF:INFO: Exiting main loop
@MNBrod
Copy link
Contributor

MNBrod commented Dec 20, 2023

Apologies for the late reply. The pipeline expects all of your data to be in the same directory, not split into raw and cals.

@shawnknabel
Copy link
Author

@MNBrod No problem! Sorry to bother you with mundane stuff. I've moved all the files to the same level and am trying it again. The .tar files from KOA unpacked into separate subdirectories, so I expected the pipeline would expect that.

@shawnknabel
Copy link
Author

shawnknabel commented Dec 21, 2023 •
edited
Loading

Hi Max,

I've tried to run the cal files from a list with "reduce_kcwi -b -l calib_files.txt" in the directory that holds all the fits files from the night (cal and sci). It looks like it isn't processing the blue bias files and is looping through all the files indefinitely. I've attached the log files and will paste the kcwib.proc below:

DRPF.log
KCWI.log

| FRAMENO | CID | DID | TYPE | GRPID | TTIME | CAM | IFU | GRAT | GANG | CWAVE | BIN | FILT | MJD | STAGE | SUFF | OFNAME | TARGNAME | filename |
| 1 | 6503b422da14e3cd53bcbacc | 2201009 | DARK | 2023-11-07-1 | 1.0 | BLUE | FPCam | RM2 | 0.00 | 3370.30 | 2,2 | None | 60255.954446 | 1 | int | kb231108_00001.fits | HORIZONSTOW | KB.20231107.82464.13.fits.gz |
| 11 | NONE | 1100101 | BIAS | 2023-11-07-11 | 0.0 | RED | Small | RL | 138.93 | 7849.95 | 1,1 | None | 60255.082010 | 9 | intb | kr231107_00011.fits | unknown | kr231107_00011.fits |
| 12 | NONE | 1100101 | BIAS | 2023-11-07-11 | 0.0 | RED | Small | RL | 138.93 | 7849.95 | 1,1 | None | 60255.083179 | 9 | intb | kr231107_00012.fits | unknown | kr231107_00012.fits |
| 13 | NONE | 1100101 | BIAS | 2023-11-07-11 | 0.0 | RED | Small | RL | 138.93 | 7849.95 | 1,1 | None | 60255.084359 | 9 | intb | kr231107_00013.fits | unknown | kr231107_00013.fits |
| 14 | NONE | 1100101 | BIAS | 2023-11-07-11 | 0.0 | RED | Small | RL | 138.93 | 7849.95 | 1,1 | None | 60255.085540 | 9 | intb | kr231107_00014.fits | unknown | kr231107_00014.fits |
| 15 | NONE | 1100101 | BIAS | 2023-11-07-11 | 0.0 | RED | Small | RL | 138.93 | 7849.95 | 1,1 | None | 60255.086720 | 9 | intb | kr231107_00015.fits | unknown | kr231107_00015.fits |
| 16 | NONE | 1100101 | BIAS | 2023-11-07-11 | 0.0 | RED | Small | RL | 138.93 | 7849.95 | 1,1 | None | 60255.087889 | 9 | intb | kr231107_00016.fits | unknown | kr231107_00016.fits |
| 17 | NONE | 1100101 | BIAS | 2023-11-07-11 | 0.0 | RED | Small | RL | 138.93 | 7849.95 | 1,1 | None | 60255.089070 | 9 | intb | kr231107_00017.fits | unknown | kr231107_00017.fits |
| 18 | 64e6b7c46522234a6092fdd0 | 1110100 | CONTBARS | 2023-11-07-18 | 40.0 | RED | Small | RL | 138.93 | 7849.95 | 1,1 | None | 60255.097109 | 1 | int | kr231107_00018.fits | unknown | KR.20231107.08390.24.fits.gz |
| 18 | 64e6b7c46522234a6092fdd0 | 1111000 | MCBARS | 2023-11-07-18 | 5.6 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.096637 | 3 | mcbars | kb231107_00018.fits | unknown | KB.20231107.08349.44.fits.gz |
| 19 | 64e6b7c46522234a6092fdd0 | 1110100 | CONTBARS | 2023-11-07-18 | 40.0 | RED | Small | RL | 138.93 | 7849.95 | 1,1 | None | 60255.098077 | 1 | int | kr231107_00019.fits | unknown | KR.20231107.08473.88.fits.gz |
| 20 | 64e6b7c46522234a6092fdd0 | 1111000 | MARC | 2023-11-07-20 | 80.0 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.102752 | 3 | marc | kb231107_00020.fits | unknown | KB.20231107.08877.80.fits.gz |
| 20 | 64e6b7c46522234a6092fdd0 | 1110100 | CONTBARS | 2023-11-07-18 | 40.0 | RED | Small | RL | 138.93 | 7849.95 | 1,1 | None | 60255.099022 | 1 | int | kr231107_00020.fits | unknown | KR.20231107.08555.48.fits.gz |
| 20 | 64e6b7c46522234a6092fdd0 | 1111000 | ARCLAMP | 2023-11-07-20 | 80.0 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.102752 | 1 | int | kb231107_00020.fits | unknown | KB.20231107.08877.80.fits.gz |
| 79 | 6503b422da14e3cd53bcbacc | 1111000 | CONTBARS | 2023-11-07-79 | 5.6 | BLUE | Small | RL | 28.76 | 4599.90 | 1,1 | KBlue | 60255.673590 | 1 | int | kb231107_00079.fits | HORIZONSTOW | KB.20231107.58198.16.fits.gz |
| 79 | 6503b422da14e3cd53bcbacc | 1111000 | MCBARS | 2023-11-07-79 | 5.6 | BLUE | Small | RL | 28.76 | 4599.90 | 1,1 | KBlue | 60255.673590 | 3 | mcbars | kb231107_00079.fits | HORIZONSTOW | KB.20231107.58198.16.fits.gz |
| 81 | 6503b422da14e3cd53bcbacc | 1111000 | ARCLAMP | 2023-11-07-81 | 80.0 | BLUE | Small | RL | 28.76 | 4599.90 | 1,1 | KBlue | 60255.679682 | 1 | int | kb231107_00081.fits | HORIZONSTOW | KB.20231107.58724.52.fits.gz |
| 81 | 6503b422da14e3cd53bcbacc | 1111000 | MARC | 2023-11-07-81 | 80.0 | BLUE | Small | RL | 28.76 | 4599.90 | 1,1 | KBlue | 60255.679682 | 3 | marc | kb231107_00081.fits | HORIZONSTOW | KB.20231107.58724.52.fits.gz |
| 146 | 6503b422da14e3cd53bcbacc | 1110100 | CONTBARS | 2023-11-07-146 | 40.0 | RED | Small | RL | 139.91 | 7149.89 | 1,1 | None | 60255.674063 | 1 | int | kr231107_00146.fits | HORIZONSTOW | KR.20231107.58239.00.fits.gz |
| 147 | 6503b422da14e3cd53bcbacc | 1110100 | CONTBARS | 2023-11-07-146 | 40.0 | RED | Small | RL | 139.91 | 7149.89 | 1,1 | None | 60255.675007 | 1 | int | kr231107_00147.fits | HORIZONSTOW | KR.20231107.58320.60.fits.gz |
| 148 | 6503b422da14e3cd53bcbacc | 1110100 | CONTBARS | 2023-11-07-146 | 40.0 | RED | Small | RL | 139.91 | 7149.89 | 1,1 | None | 60255.675951 | 1 | int | kr231107_00148.fits | HORIZONSTOW | KR.20231107.58402.20.fits.gz |

@shawnknabel
Copy link
Author

Hi, just a followup here! I'm running the pipeline from a list of just the basic bias, contbars, lamps, and dome flats. The pipeline is now ingesting and processing all the individual calibration files, but it seems it still isn't able to make the master bias. It
might be a filename problem? I've tried it using the KOA filenames and the original telescope filenames.

Thank you for your help!

KCWI.log
DRPF.log

See here from the DRFP.log:

024-01-02 14:20:38:DRPF:INFO: Event completed: name bias_subtract_overscan, action SubtractOverscan, arg name kb231107_00013.fits.gz, recurr False
2024-01-02 14:22:20:DRPF:INFO: Event completed: name bias_trim_overscan, action TrimOverscan, arg name kb231107_00013.fits.gz, recurr False
2024-01-02 14:22:20:DRPF:ERROR: Exception [Errno 2] No such file or directory: '/data/raw_data/KECK_2023_11_07_KCWI/take2_regular_filenames/KOA_59782/KCWI/raw/cal/2023-11-07/redux/kb231107_00011_intb.fits' while invoking MakeMasterBias
2024-01-02 14:22:20:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb231107_00013.fits.gz, recurr False

Below is kcwib.proc

| FRAMENO | CID | DID | TYPE | GRPID | TTIME | CAM | IFU | GRAT | GANG | CWAVE | BIN | FILT | MJD | STAGE | SUFF | OFNAME | TARGNAME | filename |
| 11 | NONE | 1101009 | BIAS | 2023-11-07-11 | 0.0 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.081927 | 9 | intb | kb231107_00011.fits | unknown | kb231107_00011.fits |
| 12 | NONE | 1101009 | BIAS | 2023-11-07-11 | 0.0 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.083958 | 9 | intb | kb231107_00012.fits | unknown | kb231107_00012.fits |
| 13 | NONE | 1101009 | BIAS | 2023-11-07-11 | 0.0 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.085977 | 9 | intb | kb231107_00013.fits | unknown | kb231107_00013.fits |
| 14 | NONE | 1101009 | BIAS | 2023-11-07-11 | 0.0 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.088007 | 9 | intb | kb231107_00014.fits | unknown | kb231107_00014.fits |
| 15 | NONE | 1101009 | BIAS | 2023-11-07-11 | 0.0 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.090025 | 9 | intb | kb231107_00015.fits | unknown | kb231107_00015.fits |
| 16 | NONE | 1101009 | BIAS | 2023-11-07-11 | 0.0 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.092057 | 9 | intb | kb231107_00016.fits | unknown | kb231107_00016.fits |
| 17 | NONE | 1101009 | BIAS | 2023-11-07-11 | 0.0 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.094075 | 9 | intb | kb231107_00017.fits | unknown | kb231107_00017.fits |
| 18 | 64e6b7c46522234a6092fdd0 | 1111000 | CONTBARS | 2023-11-07-18 | 5.6 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.096637 | 1 | int | kb231107_00018.fits | unknown | kb231107_00018.fits.gz |
| 18 | 64e6b7c46522234a6092fdd0 | 1111000 | MCBARS | 2023-11-07-18 | 5.6 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.096637 | 3 | mcbars | kb231107_00018.fits | unknown | kb231107_00018.fits.gz |
| 20 | 64e6b7c46522234a6092fdd0 | 1111000 | ARCLAMP | 2023-11-07-20 | 80.0 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.102752 | 1 | int | kb231107_00020.fits | unknown | kb231107_00020.fits.gz |
| 20 | 64e6b7c46522234a6092fdd0 | 1111000 | MARC | 2023-11-07-20 | 80.0 | BLUE | Small | RL | 138.93 | 4599.90 | 1,1 | KBlue | 60255.102752 | 3 | marc | kb231107_00020.fits | unknown | kb231107_00020.fits.gz |
| 79 | 6503b422da14e3cd53bcbacc | 1111000 | CONTBARS | 2023-11-07-79 | 5.6 | BLUE | Small | RL | 28.76 | 4599.90 | 1,1 | KBlue | 60255.673590 | 1 | int | kb231107_00079.fits | HORIZONSTOW | kb231107_00079.fits.gz |
| 79 | 6503b422da14e3cd53bcbacc | 1111000 | MCBARS | 2023-11-07-79 | 5.6 | BLUE | Small | RL | 28.76 | 4599.90 | 1,1 | KBlue | 60255.673590 | 3 | mcbars | kb231107_00079.fits | HORIZONSTOW | kb231107_00079.fits.gz |
| 81 | 6503b422da14e3cd53bcbacc | 1111000 | ARCLAMP | 2023-11-07-81 | 80.0 | BLUE | Small | RL | 28.76 | 4599.90 | 1,1 | KBlue | 60255.679682 | 1 | int | kb231107_00081.fits | HORIZONSTOW | kb231107_00081.fits.gz |
| 81 | 6503b422da14e3cd53bcbacc | 1111000 | MARC | 2023-11-07-81 | 80.0 | BLUE | Small | RL | 28.76 | 4599.90 | 1,1 | KBlue | 60255.679682 | 3 | marc | kb231107_00081.fits | HORIZONSTOW | kb231107_00081.fits.gz |

@shawnknabel
Copy link
Author

Hello,

Please see my above message for a more thorough record of my issue.
Best I can tell, I think I am having trouble with filenames or locations where processed bias frames are saved and then accessed during the MakeMasterBias.py routine.

From KCWI.log, this is where the 7th bias frame has been processed and the precondition for MakeMasterBias is satisfied.

2024-01-02 14:22:20:KCWI:INFO:MakeMasterBias.py: Checking precondition for MakeMasterBias
2024-01-02 14:22:20:KCWI:INFO:kcwi_proctab.py: Looking for BIAS frames
2024-01-02 14:22:20:KCWI:INFO:kcwi_proctab.py: Camera is BLUE
2024-01-02 14:22:20:KCWI:INFO:kcwi_proctab.py: Target type is BIAS
2024-01-02 14:22:20:KCWI:INFO:kcwi_proctab.py: Looking for frames with CCDCFG = 1101009
2024-01-02 14:22:20:KCWI:INFO:kcwi_proctab.py: Looking for frames with GRPID = 2023-11-07-11
2024-01-02 14:22:20:KCWI:INFO:MakeMasterBias.py: pre condition got 7, expecting 7

From DRFP.log, the MakeMasterBias fails while trying to find the file for frame 11 (the first bias file).

2024-01-02 14:22:20:DRPF:ERROR: Exception [Errno 2] No such file or directory: '/data/raw_data/KECK_2023_11_07_KCWI/take2_regular_filenames/KOA_59782/KCWI/raw/cal/2023-11-07/redux/kb231107_00011_intb.fits' while invoking MakeMasterBias
2024-01-02 14:22:20:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb231107_00013.fits.gz, recurr False

Here are the files that have been created in my redux directory.

shawnknabel@pingui:/data/raw_data/KECK_2023_11_07_KCWI/take2_regular_filenames/KOA_59782/KCWI/raw/cal/2023-11-07/redux$ ls
kb231107_00011.fits_intb.gz kb231107_00018_trace.fits
kb231107_00012.fits_intb.gz kb231107_00020.fits_int.gz
kb231107_00013.fits_intb.gz kb231107_00020.fits_marc.fits
kb231107_00014.fits_intb.gz kb231107_00079.fits_int.gz
kb231107_00015.fits_intb.gz kb231107_00079.fits_mcbars.fits
kb231107_00016.fits_intb.gz kb231107_00079_trace.fits
kb231107_00017.fits_intb.gz kb231107_00081.fits_int.gz
kb231107_00018.fits_int.gz kb231107_00081.fits_marc.fits
kb231107_00018.fits_mcbars.fits

Looking back at KCWI.log, where frame 11 was ingested, it appears to save a different file name.

2024-01-02 14:12:05:KCWI:INFO:kcwi_file_primitives.py: ------------------- Ingesting file kb231107_00011.fits.gz -------------------
2024-01-02 14:12:06:KCWI:INFO:kcwi_file_primitives.py: <<< read 1 imgs and 1 tables out of 2 hdus in kb231107_00011.fits.gz
2024-01-02 14:12:06:KCWI:INFO:kcwi_pipeline.py: ******* FILE TYPE DETERMINED AS BIAS
2024-01-02 14:12:06:KCWI:INFO:kcwi_pipeline.py: ******* GROUPID is 2023-11-07-11
2024-01-02 14:12:06:KCWI:INFO:kcwi_pipeline.py: ******* STATEID is Shared Bias (0)
2024-01-02 14:12:06:KCWI:INFO:kcwi_pipeline.py: ******* CAMERA is BLUE
2024-01-02 14:12:06:KCWI:INFO:SubtractOverscan.py: Img # 00011, Amp 1 [2122:2279, 0:4112]
2024-01-02 14:12:06:KCWI:INFO:SubtractOverscan.py: Amp1 oscan counts (DN): 9944
2024-01-02 14:12:06:KCWI:INFO:SubtractOverscan.py: Amp1 Read noise from oscan in e-: 2.607
2024-01-02 14:12:06:KCWI:INFO:SubtractOverscan.py: Img # 00011, Amp 2 [2320:2477, 0:4112]
2024-01-02 14:12:06:KCWI:INFO:SubtractOverscan.py: Amp2 oscan counts (DN): 9877
2024-01-02 14:12:06:KCWI:INFO:SubtractOverscan.py: Amp2 Read noise from oscan in e-: 2.998
2024-01-02 14:12:06:KCWI:INFO:SubtractOverscan.py: kcwidrp.primitives.SubtractOverscan
2024-01-02 14:12:06:KCWI:INFO:TrimOverscan.py: kcwidrp.primitives.TrimOverscan
2024-01-02 14:12:06:KCWI:INFO:kcwi_file_primitives.py: >>> Saving 1 hdus to redux/kb231107_00011.fits_intb.gz
2024-01-02 14:13:43:KCWI:INFO:kcwi_proctab.py: proctable updated with kb231107_00011.fits and kb231107_00011.fits
2024-01-02 14:13:43:KCWI:INFO:kcwi_proctab.py: writing proc table file: kcwib.proc
2024-01-02 14:13:43:KCWI:INFO:MakeMasterBias.py: Checking precondition for MakeMasterBias
2024-01-02 14:13:43:KCWI:INFO:kcwi_proctab.py: Looking for BIAS frames
2024-01-02 14:13:43:KCWI:INFO:kcwi_proctab.py: Camera is BLUE
2024-01-02 14:13:43:KCWI:INFO:kcwi_proctab.py: Target type is BIAS
2024-01-02 14:13:43:KCWI:INFO:kcwi_proctab.py: Looking for frames with CCDCFG = 1101009
2024-01-02 14:13:43:KCWI:INFO:kcwi_proctab.py: Looking for frames with GRPID = 2023-11-07-11
2024-01-02 14:13:43:KCWI:INFO:MakeMasterBias.py: pre condition got 2, expecting 7

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@MNBrod @shawnknabel