Skip to content

IDEX l1b-sci-1week job failing #2658

@greglucas

Description

@greglucas

There is an l1b sci-1week job that failed. It looks like it is trying to merge duplicate values somewhere along the line.

INFO:imap_processing.idex.idex_l1b:Running IDEX L1B processing on dataset: imap_idex_l1a_sci-1week
/usr/local/lib/python3.12/site-packages/imap_processing/spice/spin.py:210: SettingWithCopyWarning: 
A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead
See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
  out_df["sc_spin_phase"] = spin_phases
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/imap_processing/idex/idex_l1b.py", line 313, in get_trigger_mode_and_level
Processing IDEX l1b
    merged_modes = xr.merge([trigger_modes[0], xr.merge(trigger_modes[1:])])
                                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/xarray/structure/merge.py", line 1041, in merge
    merge_result = merge_core(
                   ^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/xarray/structure/merge.py", line 763, in merge_core
    variables, out_indexes = merge_collected(
                             ^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/xarray/structure/merge.py", line 315, in merge_collected
    equals_this_var, merged_vars[name] = unique_variable(
                                         ^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/xarray/structure/merge.py", line 168, in unique_variable
    raise MergeError(
xarray.structure.merge.MergeError: conflicting values for variable 'trigger_mode' on objects to be combined. You can skip this check by specifying compat='override'.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/bin/imap_cli", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/usr/local/lib/python3.12/site-packages/imap_processing/cli.py", line 1511, in main
    instrument.process()
  File "/usr/local/lib/python3.12/site-packages/imap_processing/cli.py", line 444, in process
    products = self.do_processing(dependencies)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/imap_processing/cli.py", line 954, in do_processing
    datasets = [idex_l1b(dependency)]
                ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/imap_processing/idex/idex_l1b.py", line 120, in idex_l1b
    trigger_settings = get_trigger_mode_and_level(l1a_dataset)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/imap_processing/idex/idex_l1b.py", line 322, in get_trigger_mode_and_level
    raise ValueError(
ValueError: Only one channel can trigger a dust event. Please make sure there is only one valid trigger value per event. This caused Merge Error: conflicting values for variable 'trigger_mode' on objects to be combined. You can skip this check by specifying compat='override'.

Command to reproduce

imap_cli --instrument idex --data-level l1b --descriptor sci-1week --start-date 20260130 --version v001 --dependency imap_idex_l1b_sci-1week-13166d03_20260130_v001.json

Metadata

Metadata

Assignees

Labels

Ins: IDEXRelated to the IDEX instrumentLevel: L1Level 1 processing

Type

No type

Projects

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions