[BUG]: DFP file_batcher module does not allow override of all default batching_options with control message

[efajardo-nv]

Version

23.11

Which installation method(s) does this occur on?

Conda

Describe the bug.

• In FileBatcher, the iso_date_regex object is created based on the configuration value retrieved at the start of the loader (code is displayed in 5).
• This happens before the batching_options are merged.

def build_processing_params(control_message) -> typing.Dict[any, any]:
        batching_opts = {}
        if (control_message.has_metadata("batching_options")):
            batching_opts = control_message.get_metadata("batching_options")

        return merge_dictionaries(batching_opts, default_batching_opts)

As a result, any batching_options set in the input control message or in are not reflected at runtime.

Minimum reproducible example

No response

Relevant log output

Click here to see error details

[Paste the error here, it will be hidden by default]

Full env printout

Click here to see environment details

[Paste the results of print_env.sh here, it will be hidden by default]

Other/Misc.

No response

Code of Conduct

• I agree to follow Morpheus' Code of Conduct
• I have searched the open bugs and have found no duplicates for this bug report