Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Features] Paso de features multistream con ATLAS #319

Open
Tracked by #327 ...
dirodriguezm opened this issue Dec 6, 2023 · 2 comments · May be fixed by #325
Open
Tracked by #327 ...

[Features] Paso de features multistream con ATLAS #319

dirodriguezm opened this issue Dec 6, 2023 · 2 comments · May be fixed by #325
Assignees

Comments

@dirodriguezm
Copy link
Contributor

Traceback (most recent call last):
  File "/app/.venv/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 3652, in get_loc
warning in stationary: failed to import cython module: falling back to numpy
warning in choleskies: failed to import cython module: falling back to numpy
    return self._engine.get_loc(casted_key)
  File "pandas/_libs/index.pyx", line 147, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/index.pyx", line 176, in pandas._libs.index.IndexEngine.get_loc
  File "pandas/_libs/hashtable_class_helper.pxi", line 7080, in pandas._libs.hashtable.PyObjectHashTable.get_item
  File "pandas/_libs/hashtable_class_helper.pxi", line 7088, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'corrected'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/app/scripts/run_step.py", line 46, in <module>
    step.start()
  File "/libs/apf/apf/metrics/pyroscope/profile.py", line 16, in pyroscope_context
    func(*args, **kwargs)
  File "/libs/apf/apf/core/step.py", line 440, in start
    raise error
  File "/libs/apf/apf/core/step.py", line 436, in start
    result = self.execute(preprocessed_msg)
  File "/app/features/step.py", line 84, in execute
    features_extractor = self.features_extractor(
  File "/app/features/core/ztf.py", line 66, in __init__
    super().__init__(detections, non_detections, xmatches)
  File "/app/features/core/_base.py", line 132, in __init__
    self.detections = DetectionsHandler(
  File "/app/features/core/handlers/_base.py", line 106, in __init__
    self._post_process(alerts=alerts, surveys=surveys, **kwargs)
  File "/app/features/core/handlers/detections.py", line 48, in _post_process
    self._use_corrected()
  File "/app/features/core/handlers/detections.py", line 60, in _use_corrected
    self._alerts["corrected"][idx]
  File "/app/.venv/lib/python3.10/site-packages/pandas/core/frame.py", line 3761, in __getitem__
    indexer = self.columns.get_loc(key)
  File "/app/.venv/lib/python3.10/site-packages/pandas/core/indexes/base.py", line 3654, in get_loc
    raise KeyError(key) from err
KeyError: 'corrected'
@dirodriguezm dirodriguezm moved this to 🆕 New in ALeRCE Project Dec 6, 2023
@AlxEnashi AlxEnashi moved this from 🆕 New to 🏗 In progress in ALeRCE Project Dec 6, 2023
@AlxEnashi
Copy link
Contributor

Se van a crear placeholders de :

  • Extractor de features (retorna df vacio)
  • Parser de output (retorna lista vacia)
  • Parser de scribe (retorna lista vacia)

De atlas.

@AlxEnashi AlxEnashi moved this from 🏗 In progress to 👀 In review in ALeRCE Project Dec 6, 2023
@AlxEnashi AlxEnashi linked a pull request Dec 7, 2023 that will close this issue
@AlxEnashi
Copy link
Contributor

Cambie el constructor del handler de alertas para tener un early exit si no hay alertas usando una excepcion y atrapo esa excepcion en el step.

El extractor de features va a cambiar, ignacio trabaja en otro asi que complicarme mas la vida es innecesario en mi opinion.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: 👀 In review
Development

Successfully merging a pull request may close this issue.

2 participants