Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure on CI #351

Open
jmcarcell opened this issue Feb 22, 2024 · 1 comment
Open

Test failure on CI #351

jmcarcell opened this issue Feb 22, 2024 · 1 comment

Comments

@jmcarcell
Copy link
Contributor

On the CI (https://github.com/key4hep/EDM4hep/actions/runs/7993622216/job/21829835880?pr=272) of a PR (key4hep/EDM4hep#272) that doesn't do or change anything related to FCCAnalyses there is a test that fails:

2024-02-21T18:38:35.2775252Z Test project /Workarea/07_fccanalyses/build
2024-02-21T18:38:35.2931164Z       Start  1: UT_flavtagging
2024-02-21T18:38:35.2943886Z       Start  2: fccanalysisrun_examples/FCCee/weaver/analysis_inference.py
2024-02-21T18:38:35.2958312Z       Start  3: FCCAnalysis_analysis_example_run_analysis
2024-02-21T18:38:35.2974294Z       Start  4: fccanalysisrun_examples/FCCee/higgs/mH-recoil/mumu/analysis_stage1.py
2024-02-21T18:38:35.9043597Z  1/38 Test  #1: UT_flavtagging .............................................................   Passed    0.61 sec
2024-02-21T18:38:35.9046849Z       Start  5: fccanalysisrun_examples/FCCee/flavour/Bc2TauNu/analysis_B2TauNu_truth.py
2024-02-21T18:39:22.5728840Z  2/38 Test  #3: FCCAnalysis_analysis_example_run_analysis ..................................   Passed   47.28 sec
2024-02-21T18:39:22.5733510Z       Start  6: fccanalysisrun_examples/FCCee/test/jet_constituents.py
2024-02-21T18:39:28.4122321Z  3/38 Test  #5: fccanalysisrun_examples/FCCee/flavour/Bc2TauNu/analysis_B2TauNu_truth.py ...   Passed   52.51 sec
2024-02-21T18:39:28.4126828Z       Start  7: fccanalysisrun_examples/FCCee/vertex_lcfiplus/analysis_V0.py
2024-02-21T18:39:48.1432265Z  4/38 Test  #6: fccanalysisrun_examples/FCCee/test/jet_constituents.py .....................   Passed   25.57 sec
2024-02-21T18:39:48.1439052Z       Start  8: UT_myUtils
2024-02-21T18:39:48.9693881Z  5/38 Test  #8: UT_myUtils .................................................................   Passed    0.83 sec
2024-02-21T18:39:48.9694821Z       Start  9: UT_d0
2024-02-21T18:39:49.4272705Z  6/38 Test  #9: UT_d0 ......................................................................   Passed    0.46 sec
2024-02-21T18:39:49.4273627Z       Start 10: UT_z0
2024-02-21T18:39:49.9552660Z  7/38 Test #10: UT_z0 ......................................................................   Passed    0.53 sec
2024-02-21T18:39:49.9558133Z       Start 11: UT_Npos
2024-02-21T18:39:50.3736699Z  8/38 Test #11: UT_Npos ....................................................................   Passed    0.42 sec
2024-02-21T18:39:50.3801432Z       Start 12: UT_Nneg
2024-02-21T18:39:51.0214543Z  9/38 Test #12: UT_Nneg ....................................................................   Passed    0.65 sec
2024-02-21T18:39:51.0215461Z       Start 13: UT_dPV2DV_min
2024-02-21T18:39:51.6495491Z 10/38 Test #13: UT_dPV2DV_min ..............................................................   Passed    0.63 sec
2024-02-21T18:39:51.6496542Z       Start 14: UT_dPV2DV_max
2024-02-21T18:39:52.0436364Z 11/38 Test  #2: fccanalysisrun_examples/FCCee/weaver/analysis_inference.py .................   Passed   76.75 sec
2024-02-21T18:39:52.0437809Z       Start 15: UT_dPV2DV_ave
2024-02-21T18:39:52.2379633Z 12/38 Test #14: UT_dPV2DV_max ..............................................................   Passed    0.59 sec
2024-02-21T18:39:52.2380588Z       Start 16: UT_PV_ntracks
2024-02-21T18:39:52.5871013Z 13/38 Test #15: UT_dPV2DV_ave ..............................................................   Passed    0.54 sec
2024-02-21T18:39:52.5877110Z       Start 17: UT_hasPV
2024-02-21T18:39:52.7381130Z 14/38 Test #16: UT_PV_ntracks ..............................................................   Passed    0.50 sec
2024-02-21T18:39:52.7387540Z       Start 18: UT_distanceComp
2024-02-21T18:39:53.1315941Z 15/38 Test #17: UT_hasPV ...................................................................   Passed    0.54 sec
2024-02-21T18:39:53.1328680Z       Start 19: UT_distance
2024-02-21T18:39:53.2992503Z 16/38 Test #18: UT_distanceComp ............................................................   Passed    0.56 sec
2024-02-21T18:39:53.2998286Z       Start 20: UT_distanceVertex
2024-02-21T18:39:53.6696228Z 17/38 Test #19: UT_distance ................................................................   Passed    0.54 sec
2024-02-21T18:39:53.6698694Z       Start 21: UT_distanceErrorVertex
2024-02-21T18:39:53.9703225Z 18/38 Test #20: UT_distanceVertex ..........................................................   Passed    0.67 sec
2024-02-21T18:39:53.9705857Z       Start 22: UT_MC_parent
2024-02-21T18:39:54.2774006Z 19/38 Test #21: UT_distanceErrorVertex .....................................................   Passed    0.61 sec
2024-02-21T18:39:54.2781407Z       Start 23: UT_FCCAnalysesComposite_N
2024-02-21T18:39:54.5021218Z 20/38 Test #22: UT_MC_parent ...............................................................   Passed    0.53 sec
2024-02-21T18:39:54.5022679Z       Start 24: UT_FCCAnalysesComposite2_N
2024-02-21T18:39:54.7778554Z 21/38 Test #23: UT_FCCAnalysesComposite_N ..................................................   Passed    0.50 sec
2024-02-21T18:39:54.7779915Z       Start 25: UT_isPV
2024-02-21T18:39:54.9954679Z 22/38 Test #24: UT_FCCAnalysesComposite2_N .................................................   Passed    0.49 sec
2024-02-21T18:39:54.9958956Z       Start 26: UT_get_p
2024-02-21T18:39:55.2636684Z 23/38 Test #25: UT_isPV ....................................................................   Passed    0.49 sec
2024-02-21T18:39:55.2642411Z       Start 27: UT_sphericityFit
2024-02-21T18:39:55.4439457Z 24/38 Test #26: UT_get_p ...................................................................   Passed    0.45 sec
2024-02-21T18:39:55.4441108Z       Start 28: UT_minimize_sphericity
2024-02-21T18:39:55.8116184Z 25/38 Test #27: UT_sphericityFit ...........................................................   Passed    0.55 sec
2024-02-21T18:39:55.8119276Z       Start 29: UT_Mass
2024-02-21T18:39:56.1903185Z 26/38 Test #28: UT_minimize_sphericity .....................................................   Passed    0.75 sec
2024-02-21T18:39:56.1904321Z       Start 30: UT_AxisCosThetaInVec
2024-02-21T18:39:56.4613627Z 27/38 Test #29: UT_Mass ....................................................................   Passed    0.65 sec
2024-02-21T18:39:56.4614559Z       Start 31: UT_AxisCosTheta
2024-02-21T18:39:56.7028286Z 28/38 Test #30: UT_AxisCosThetaInVec .......................................................   Passed    0.51 sec
2024-02-21T18:39:56.7029832Z       Start 32: UT_ThrustPointing
2024-02-21T18:39:56.9751684Z 29/38 Test #31: UT_AxisCosTheta ............................................................   Passed    0.51 sec
2024-02-21T18:39:56.9752659Z       Start 33: UT_calculate_thrust
2024-02-21T18:39:57.2963086Z 30/38 Test #32: UT_ThrustPointing ..........................................................   Passed    0.59 sec
2024-02-21T18:39:57.2968580Z       Start 34: UT_sel_type
2024-02-21T18:39:57.6168387Z 31/38 Test #33: UT_calculate_thrust ........................................................   Passed    0.64 sec
2024-02-21T18:39:57.6176908Z       Start 35: UT_sel_absType
2024-02-21T18:39:58.0060097Z 32/38 Test #34: UT_sel_type ................................................................   Passed    0.71 sec
2024-02-21T18:39:58.0065269Z       Start 36: UT_sel_absType__neg_type
2024-02-21T18:39:58.1644271Z 33/38 Test #35: UT_sel_absType .............................................................   Passed    0.55 sec
2024-02-21T18:39:58.1645296Z       Start 37: B_calculate_thrust
2024-02-21T18:39:58.6801492Z 34/38 Test #36: UT_sel_absType__neg_type ...................................................   Passed    0.67 sec
2024-02-21T18:39:58.6809599Z       Start 38: B_isPV
2024-02-21T18:40:01.4237156Z 35/38 Test #37: B_calculate_thrust .........................................................   Passed    3.26 sec
2024-02-21T18:40:01.8366205Z 36/38 Test #38: B_isPV .....................................................................   Passed    3.16 sec
2024-02-21T18:40:16.5774696Z 37/38 Test  #7: fccanalysisrun_examples/FCCee/vertex_lcfiplus/analysis_V0.py ...............   Passed   48.16 sec
2024-02-21T18:40:35.8988636Z 38/38 Test  #4: fccanalysisrun_examples/FCCee/higgs/mH-recoil/mumu/analysis_stage1.py ......***Exception: SegFault120.60 sec
2024-02-21T18:40:35.8990110Z ----> INFO: Loading analyzers from libFCCAnalyses...
2024-02-21T18:40:35.8990827Z ----> INFO: Loading analysis file:
2024-02-21T18:40:35.9021347Z Errors while running CTest
2024-02-21T18:40:35.9024106Z             /Workarea/07_fccanalyses/examples/FCCee/higgs/mH-recoil/mumu/analysis_stage1.py
2024-02-21T18:40:35.9026114Z ----> INFO: No multithreading enabled. Running in single thread...
2024-02-21T18:40:35.9027248Z ----> INFO: Running over test file...
2024-02-21T18:40:35.9029185Z Warning in <TClass::Init>: no dictionary for class edm4hep::RecoParticleRefData is available
2024-02-21T18:40:35.9030292Z ----> INFO: Creating dataframe object from files:
2024-02-21T18:40:35.9031973Z             	- root://eospublic.cern.ch//eos/experiment/fcc/ee/generation/DelphesEvents/spring2021/IDEA/p8_ee_ZH_ecm240/events_101027117.root	
2024-02-21T18:40:35.9033232Z 
2024-02-21T18:40:35.9033549Z ----> INFO: Number of local events: 100
2024-02-21T18:40:35.9034219Z ----> INFO: Output file path:
2024-02-21T18:40:35.9034999Z             outputs/FCCee/higgs/mH-recoil/mumu/stage1/output.root
2024-02-21T18:40:35.9036643Z Warning in <TFile::Init>: file outputs/FCCee/higgs/mH-recoil/mumu/stage1/output.root probably not closed, cannot read free segments
2024-02-21T18:40:35.9038695Z Warning in <TFile::Init>: file outputs/FCCee/higgs/mH-recoil/mumu/stage1/output.root has no keys
2024-02-21T18:40:35.9039697Z  *** Break *** segmentation violation
2024-02-21T18:40:35.9040091Z 
2024-02-21T18:40:35.9040099Z 
2024-02-21T18:40:35.9040106Z 
2024-02-21T18:40:35.9040303Z ===========================================================
2024-02-21T18:40:35.9040875Z There was a crash.
2024-02-21T18:40:35.9041363Z This is the entire stack trace of all threads:
2024-02-21T18:40:35.9041990Z ===========================================================
2024-02-21T18:40:35.9042416Z 
2024-02-21T18:40:35.9042687Z Thread 15 (Thread 0x7febe128e640 (LWP 4641) "python3"):
2024-02-21T18:40:35.9043599Z #0  0x00007fec1a77739a in __futex_abstimed_wait_common () from /lib64/libc.so.6
2024-02-21T18:40:35.9044699Z #1  0x00007fec1a782838 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
2024-02-21T18:40:35.9046894Z #2  0x00007febee5f6866 in XrdCl::JobManager::RunJobs() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9050370Z #3  0x00007febee5f6919 in RunRunnerThread () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9052178Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9053042Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9053547Z 
2024-02-21T18:40:35.9053826Z Thread 14 (Thread 0x7febe228f640 (LWP 4640) "python3"):
2024-02-21T18:40:35.9054736Z #0  0x00007fec1a77739a in __futex_abstimed_wait_common () from /lib64/libc.so.6
2024-02-21T18:40:35.9055831Z #1  0x00007fec1a782838 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
2024-02-21T18:40:35.9058072Z #2  0x00007febee5f6866 in XrdCl::JobManager::RunJobs() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9060984Z #3  0x00007febee5f6919 in RunRunnerThread () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9062710Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9063504Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9063993Z 
2024-02-21T18:40:35.9064777Z Thread 13 (Thread 0x7febe3290640 (LWP 4638) "python3"):
2024-02-21T18:40:35.9065696Z #0  0x00007fec1a77739a in __futex_abstimed_wait_common () from /lib64/libc.so.6
2024-02-21T18:40:35.9066797Z #1  0x00007fec1a782838 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
2024-02-21T18:40:35.9068991Z #2  0x00007febee5f6866 in XrdCl::JobManager::RunJobs() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9071917Z #3  0x00007febee5f6919 in RunRunnerThread () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9073633Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9074438Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9074930Z 
2024-02-21T18:40:35.9075204Z Thread 12 (Thread 0x7febe4291640 (LWP 4637) "python3"):
2024-02-21T18:40:35.9075891Z #0  0x00007fec1a7ee975 in clock_nanosleep
2024-02-21T18:40:35.9076454Z GLIBC_2.2.5 () from /lib64/libc.so.6
2024-02-21T18:40:35.9077118Z #1  0x00007fec1a7f3527 in nanosleep () from /lib64/libc.so.6
2024-02-21T18:40:35.9079310Z #2  0x00007febee7b6e08 in XrdSysTimer::Wait(int) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9081291Z #3  0x00007febee564509 in XrdCl::TaskManager::RunTasks() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9083691Z #4  0x00007febee564689 in RunRunnerThread () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9085314Z #5  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9086048Z #6  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9086404Z 
2024-02-21T18:40:35.9086646Z Thread 11 (Thread 0x7febe5292640 (LWP 4635) "python3"):
2024-02-21T18:40:35.9087253Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9089261Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9092781Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9095719Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9097067Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9097800Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9098314Z 
2024-02-21T18:40:35.9098596Z Thread 10 (Thread 0x7febe6293640 (LWP 4632) "python3"):
2024-02-21T18:40:35.9099244Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9100650Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9102566Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9104305Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9105524Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9106002Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9106287Z 
2024-02-21T18:40:35.9106452Z Thread 9 (Thread 0x7febe7294640 (LWP 4631) "python3"):
2024-02-21T18:40:35.9106914Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9108247Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9110132Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9111817Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9112794Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9113259Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9113540Z 
2024-02-21T18:40:35.9113697Z Thread 8 (Thread 0x7febe8295640 (LWP 4629) "python3"):
2024-02-21T18:40:35.9114150Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9115469Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9117372Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9119318Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9120306Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9120774Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9121058Z 
2024-02-21T18:40:35.9121217Z Thread 7 (Thread 0x7febe9296640 (LWP 4626) "python3"):
2024-02-21T18:40:35.9121673Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9123201Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9125079Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9126762Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9127734Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9128202Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9128486Z 
2024-02-21T18:40:35.9128646Z Thread 6 (Thread 0x7febea297640 (LWP 4625) "python3"):
2024-02-21T18:40:35.9129107Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9130417Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9132458Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9134157Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9135132Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9135593Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9135876Z 
2024-02-21T18:40:35.9136041Z Thread 5 (Thread 0x7febeb298640 (LWP 4623) "python3"):
2024-02-21T18:40:35.9136498Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9137809Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9139694Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9141375Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9142349Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9142807Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9143093Z 
2024-02-21T18:40:35.9143250Z Thread 4 (Thread 0x7febec299640 (LWP 4621) "python3"):
2024-02-21T18:40:35.9143705Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9145016Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9146896Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9148578Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9149560Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9150149Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9150430Z 
2024-02-21T18:40:35.9150591Z Thread 3 (Thread 0x7febed29a640 (LWP 4619) "python3"):
2024-02-21T18:40:35.9151046Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9152368Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9154244Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9155918Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9156899Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9157352Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9160643Z 
2024-02-21T18:40:35.9160821Z Thread 2 (Thread 0x7febee29b640 (LWP 4618) "python3"):
2024-02-21T18:40:35.9161296Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9162855Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9164778Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9166466Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9167461Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9167925Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9168202Z 
2024-02-21T18:40:35.9168363Z Thread 1 (Thread 0x7fec1a5cc200 (LWP 4560) "python3"):
2024-02-21T18:40:35.9168804Z #0  0x00007fec1a7f330f in wait4 () from /lib64/libc.so.6
2024-02-21T18:40:35.9169250Z #1  0x00007fec1a73c953 in do_system () from /lib64/libc.so.6
2024-02-21T18:40:35.9170544Z #2  0x00007fec15aeea25 in TUnixSystem::Exec (shellcmd=<optimized out>, this=0x19ae1a0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/core/unix/src/TUnixSystem.cxx:2104
2024-02-21T18:40:35.9172289Z #3  TUnixSystem::StackTrace (this=0x19ae1a0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/core/unix/src/TUnixSystem.cxx:2395
2024-02-21T18:40:35.9174164Z #4  0x00007fec1659c053 in (anonymous namespace)::do_trace (sig=1) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/bindings/pyroot/cppyy/cppyy-backend/clingwrapper/src/clingwrapper.cxx:182
2024-02-21T18:40:35.9176434Z #5  (anonymous namespace)::TExceptionHandlerImp::HandleException (this=<optimized out>, sig=1) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/bindings/pyroot/cppyy/cppyy-backend/clingwrapper/src/clingwrapper.cxx:195
2024-02-21T18:40:35.9178663Z #6  0x00007fec15aebc61 in TUnixSystem::DispatchSignals (this=0x19ae1a0, sig=kSigSegmentationViolation) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/core/unix/src/TUnixSystem.cxx:3610
2024-02-21T18:40:35.9179789Z #7  <signal handler called>
2024-02-21T18:40:35.9180149Z #8  TFree::GetBestFree (this=<optimized out>, lfree=lfree
2024-02-21T18:40:35.9180541Z entry=0x14b281d0, nbytes=nbytes
2024-02-21T18:40:35.9181328Z entry=95) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TFree.cxx:133
2024-02-21T18:40:35.9183007Z #9  0x00007fec1517c424 in TKey::Create (this=0xc6ca2b0, nbytes=36, externFile=0x0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TKey.cxx:475
2024-02-21T18:40:35.9184017Z #10 0x00007fec1517f42b in TKey::TKey (this=this
2024-02-21T18:40:35.9184355Z entry=0xc6ca2b0, obj=obj
2024-02-21T18:40:35.9184618Z entry=0x15e61070, name=name
2024-02-21T18:40:35.9184951Z entry=0x14d33df0 "eventsProcessed", bufsize=bufsize
2024-02-21T18:40:35.9185326Z entry=1024, motherDir=motherDir
2024-02-21T18:40:35.9186148Z entry=0x14022300) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TKey.cxx:286
2024-02-21T18:40:35.9187993Z #11 0x00007fec15151145 in TFile::CreateKey (this=<optimized out>, mother=0x14022300, obj=0x15e61070, name=0x14d33df0 "eventsProcessed", bufsize=1024) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TFile.cxx:1014
2024-02-21T18:40:35.9190369Z #12 0x00007fec15142416 in TDirectoryFile::WriteTObject (this=0x14022300, obj=0x15e61070, name=<optimized out>, option=<optimized out>, bufsize=0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TDirectoryFile.cxx:1962
2024-02-21T18:40:35.9192658Z #13 0x00007fec159e3a75 in TObject::Write (this=0x15e61070, name=0x0, option=<optimized out>, bufsize=0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/core/base/src/TObject.cxx:863
2024-02-21T18:40:35.9193747Z #14 0x00007febcbf330c2 in ?? ()
2024-02-21T18:40:35.9194032Z #15 0x00000000145066a0 in ?? ()
2024-02-21T18:40:35.9194312Z #16 0x00007ffed9c84970 in ?? ()
2024-02-21T18:40:35.9194589Z #17 0x0000000015e61070 in ?? ()
2024-02-21T18:40:35.9194956Z #18 0x00007ffed9c849fc in ?? ()
2024-02-21T18:40:35.9195331Z #19 0x0000000000000000 in ?? ()
2024-02-21T18:40:35.9195937Z ===========================================================
2024-02-21T18:40:35.9196254Z 
2024-02-21T18:40:35.9196259Z 
2024-02-21T18:40:35.9196560Z The lines below might hint at the cause of the crash. If you see question
2024-02-21T18:40:35.9197357Z marks as part of the stack trace, try to recompile with debugging information
2024-02-21T18:40:35.9198627Z enabled and export CLING_DEBUG=1 environment variable before running.
2024-02-21T18:40:35.9199705Z You may get help by asking at the ROOT forum https://root.cern/forum
2024-02-21T18:40:35.9200518Z Only if you are really convinced it is a bug in ROOT then please submit a
2024-02-21T18:40:35.9201217Z report at https://root.cern/bugs Please post the ENTIRE stack trace
2024-02-21T18:40:35.9201857Z from above as an attachment in addition to anything else
2024-02-21T18:40:35.9202434Z that might help us fixing this issue.
2024-02-21T18:40:35.9202854Z ===========================================================
2024-02-21T18:40:35.9203420Z #8  TFree::GetBestFree (this=<optimized out>, lfree=lfree
2024-02-21T18:40:35.9203981Z entry=0x14b281d0, nbytes=nbytes
2024-02-21T18:40:35.9204930Z entry=95) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TFree.cxx:133
2024-02-21T18:40:35.9206555Z #9  0x00007fec1517c424 in TKey::Create (this=0xc6ca2b0, nbytes=36, externFile=0x0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TKey.cxx:475
2024-02-21T18:40:35.9207773Z #10 0x00007fec1517f42b in TKey::TKey (this=this
2024-02-21T18:40:35.9208177Z entry=0xc6ca2b0, obj=obj
2024-02-21T18:40:35.9208540Z entry=0x15e61070, name=name
2024-02-21T18:40:35.9209046Z entry=0x14d33df0 "eventsProcessed", bufsize=bufsize
2024-02-21T18:40:35.9209516Z entry=1024, motherDir=motherDir
2024-02-21T18:40:35.9210501Z entry=0x14022300) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TKey.cxx:286
2024-02-21T18:40:35.9212471Z #11 0x00007fec15151145 in TFile::CreateKey (this=<optimized out>, mother=0x14022300, obj=0x15e61070, name=0x14d33df0 "eventsProcessed", bufsize=1024) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TFile.cxx:1014
2024-02-21T18:40:35.9215131Z #12 0x00007fec15142416 in TDirectoryFile::WriteTObject (this=0x14022300, obj=0x15e61070, name=<optimized out>, option=<optimized out>, bufsize=0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TDirectoryFile.cxx:1962
2024-02-21T18:40:35.9217457Z #13 0x00007fec159e3a75 in TObject::Write (this=0x15e61070, name=0x0, option=<optimized out>, bufsize=0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/core/base/src/TObject.cxx:863
2024-02-21T18:40:35.9218637Z #14 0x00007febcbf330c2 in ?? ()
2024-02-21T18:40:35.9219022Z #15 0x00000000145066a0 in ?? ()
2024-02-21T18:40:35.9219481Z #16 0x00007ffed9c84970 in ?? ()
2024-02-21T18:40:35.9219859Z #17 0x0000000015e61070 in ?? ()
2024-02-21T18:40:35.9220249Z #18 0x00007ffed9c849fc in ?? ()
2024-02-21T18:40:35.9220647Z #19 0x0000000000000000 in ?? ()
2024-02-21T18:40:35.9221045Z ===========================================================
2024-02-21T18:40:35.9221374Z 
2024-02-21T18:40:35.9221378Z 
2024-02-21T18:40:35.9221526Z  *** Break *** segmentation violation
2024-02-21T18:40:35.9221838Z 
2024-02-21T18:40:35.9221842Z 
2024-02-21T18:40:35.9221884Z 
2024-02-21T18:40:35.9222036Z ===========================================================
2024-02-21T18:40:35.9222628Z There was a crash.
2024-02-21T18:40:35.9223089Z This is the entire stack trace of all threads:
2024-02-21T18:40:35.9223524Z ===========================================================
2024-02-21T18:40:35.9223846Z 
2024-02-21T18:40:35.9224043Z Thread 15 (Thread 0x7febe128e640 (LWP 4641) "python3"):
2024-02-21T18:40:35.9224731Z #0  0x00007fec1a77739a in __futex_abstimed_wait_common () from /lib64/libc.so.6
2024-02-21T18:40:35.9225464Z #1  0x00007fec1a782838 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
2024-02-21T18:40:35.9226836Z #2  0x00007febee5f6866 in XrdCl::JobManager::RunJobs() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9228615Z #3  0x00007febee5f6919 in RunRunnerThread () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9229667Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9230232Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9230638Z 
2024-02-21T18:40:35.9230834Z Thread 14 (Thread 0x7febe228f640 (LWP 4640) "python3"):
2024-02-21T18:40:35.9231486Z #0  0x00007fec1a77739a in __futex_abstimed_wait_common () from /lib64/libc.so.6
2024-02-21T18:40:35.9232215Z #1  0x00007fec1a782838 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
2024-02-21T18:40:35.9233644Z #2  0x00007febee5f6866 in XrdCl::JobManager::RunJobs() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9235353Z #3  0x00007febee5f6919 in RunRunnerThread () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9236376Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9237028Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9237376Z 
2024-02-21T18:40:35.9237800Z Thread 13 (Thread 0x7febe3290640 (LWP 4638) "python3"):
2024-02-21T18:40:35.9238520Z #0  0x00007fec1a77739a in __futex_abstimed_wait_common () from /lib64/libc.so.6
2024-02-21T18:40:35.9239262Z #1  0x00007fec1a782838 in __new_sem_wait_slow64.constprop.0 () from /lib64/libc.so.6
2024-02-21T18:40:35.9240612Z #2  0x00007febee5f6866 in XrdCl::JobManager::RunJobs() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9242571Z #3  0x00007febee5f6919 in RunRunnerThread () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9243635Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9244193Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9244622Z 
2024-02-21T18:40:35.9244820Z Thread 12 (Thread 0x7febe4291640 (LWP 4637) "python3"):
2024-02-21T18:40:35.9245310Z #0  0x00007fec1a7ee975 in clock_nanosleep
2024-02-21T18:40:35.9245753Z GLIBC_2.2.5 () from /lib64/libc.so.6
2024-02-21T18:40:35.9246264Z #1  0x00007fec1a7f3527 in nanosleep () from /lib64/libc.so.6
2024-02-21T18:40:35.9247498Z #2  0x00007febee7b6e08 in XrdSysTimer::Wait(int) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9249275Z #3  0x00007febee564509 in XrdCl::TaskManager::RunTasks() () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9251045Z #4  0x00007febee564689 in RunRunnerThread () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdCl.so.3
2024-02-21T18:40:35.9252273Z #5  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9252906Z #6  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9253220Z 
2024-02-21T18:40:35.9253447Z Thread 11 (Thread 0x7febe5292640 (LWP 4635) "python3"):
2024-02-21T18:40:35.9253982Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9255474Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9257473Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9259288Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9260433Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9261015Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9261326Z 
2024-02-21T18:40:35.9261552Z Thread 10 (Thread 0x7febe6293640 (LWP 4632) "python3"):
2024-02-21T18:40:35.9262131Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9263569Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9265557Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9267432Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9268510Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9269137Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9269450Z 
2024-02-21T18:40:35.9269692Z Thread 9 (Thread 0x7febe7294640 (LWP 4631) "python3"):
2024-02-21T18:40:35.9270207Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9271894Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9273891Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9275675Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9276844Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9277405Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9277943Z 
2024-02-21T18:40:35.9278188Z Thread 8 (Thread 0x7febe8295640 (LWP 4629) "python3"):
2024-02-21T18:40:35.9278832Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9280250Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9282480Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9284366Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9285460Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9286099Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9286413Z 
2024-02-21T18:40:35.9286642Z Thread 7 (Thread 0x7febe9296640 (LWP 4626) "python3"):
2024-02-21T18:40:35.9287281Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9288722Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9290721Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9292520Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9293663Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9294238Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9294553Z 
2024-02-21T18:40:35.9294781Z Thread 6 (Thread 0x7febea297640 (LWP 4625) "python3"):
2024-02-21T18:40:35.9295396Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9296791Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9298771Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9300631Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9301796Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9302872Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9303206Z 
2024-02-21T18:40:35.9303479Z Thread 5 (Thread 0x7febeb298640 (LWP 4623) "python3"):
2024-02-21T18:40:35.9304033Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9305757Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9307711Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9309467Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9310632Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9311193Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9311503Z 
2024-02-21T18:40:35.9311834Z Thread 4 (Thread 0x7febec299640 (LWP 4621) "python3"):
2024-02-21T18:40:35.9312585Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9314175Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9316269Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9318248Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9319370Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9320015Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9320365Z 
2024-02-21T18:40:35.9320556Z Thread 3 (Thread 0x7febed29a640 (LWP 4619) "python3"):
2024-02-21T18:40:35.9321137Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9322639Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9324641Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9326378Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9327595Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9328173Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9328515Z 
2024-02-21T18:40:35.9328774Z Thread 2 (Thread 0x7febee29b640 (LWP 4618) "python3"):
2024-02-21T18:40:35.9329336Z #0  0x00007fec1a82984e in epoll_wait () from /lib64/libc.so.6
2024-02-21T18:40:35.9330767Z #1  0x00007febee7b11c2 in XrdSys::IOEvents::PollE::Begin(XrdSysSemaphore*, int&, char const**) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9332807Z #2  0x00007febee7ad96d in XrdSys::IOEvents::BootStrap::Start(void*) () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9334607Z #3  0x00007febee7b64b8 in XrdSysThread_Xeq () from /cvmfs/sw-nightlies.hsf.org/key4hep/releases/2024-01-09/x86_64-almalinux9-gcc11.3.1-opt/xrootd/5.6.1-t6qwdz/lib64/libXrdUtils.so.3
2024-02-21T18:40:35.9335814Z #4  0x00007fec1a77a802 in start_thread () from /lib64/libc.so.6
2024-02-21T18:40:35.9336443Z #5  0x00007fec1a71a314 in clone () from /lib64/libc.so.6
2024-02-21T18:40:35.9336833Z 
2024-02-21T18:40:35.9337025Z Thread 1 (Thread 0x7fec1a5cc200 (LWP 4560) "python3"):
2024-02-21T18:40:35.9337631Z #0  0x00007fec1a7f330f in wait4 () from /lib64/libc.so.6
2024-02-21T18:40:35.9338269Z #1  0x00007fec1a73c953 in do_system () from /lib64/libc.so.6
2024-02-21T18:40:35.9339670Z #2  0x00007fec15aeea25 in TUnixSystem::Exec (shellcmd=<optimized out>, this=0x19ae1a0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/core/unix/src/TUnixSystem.cxx:2104
2024-02-21T18:40:35.9341474Z #3  TUnixSystem::StackTrace (this=0x19ae1a0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/core/unix/src/TUnixSystem.cxx:2395
2024-02-21T18:40:35.9343544Z #4  0x00007fec1659bed3 in (anonymous namespace)::do_trace (sig=1) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/bindings/pyroot/cppyy/cppyy-backend/clingwrapper/src/clingwrapper.cxx:182
2024-02-21T18:40:35.9346063Z #5  (anonymous namespace)::TExceptionHandlerImp::HandleException (this=<optimized out>, sig=1) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/bindings/pyroot/cppyy/cppyy-backend/clingwrapper/src/clingwrapper.cxx:201
2024-02-21T18:40:35.9348507Z #6  0x00007fec15aebc61 in TUnixSystem::DispatchSignals (this=0x19ae1a0, sig=kSigSegmentationViolation) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/core/unix/src/TUnixSystem.cxx:3610
2024-02-21T18:40:35.9349737Z #7  <signal handler called>
2024-02-21T18:40:35.9350184Z #8  TFree::GetBestFree (this=<optimized out>, lfree=lfree
2024-02-21T18:40:35.9350763Z entry=0x14b281d0, nbytes=nbytes
2024-02-21T18:40:35.9351652Z entry=95) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TFree.cxx:133
2024-02-21T18:40:35.9353318Z #9  0x00007fec1517c424 in TKey::Create (this=0xc6ca2b0, nbytes=36, externFile=0x0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TKey.cxx:475
2024-02-21T18:40:35.9354501Z #10 0x00007fec1517f42b in TKey::TKey (this=this
2024-02-21T18:40:35.9354946Z entry=0xc6ca2b0, obj=obj
2024-02-21T18:40:35.9355321Z entry=0x15e61070, name=name
2024-02-21T18:40:35.9355808Z entry=0x14d33df0 "eventsProcessed", bufsize=bufsize
2024-02-21T18:40:35.9356241Z entry=1024, motherDir=motherDir
2024-02-21T18:40:35.9357183Z entry=0x14022300) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TKey.cxx:286
2024-02-21T18:40:35.9359481Z #11 0x00007fec15151145 in TFile::CreateKey (this=<optimized out>, mother=0x14022300, obj=0x15e61070, name=0x14d33df0 "eventsProcessed", bufsize=1024) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TFile.cxx:1014
2024-02-21T18:40:35.9361964Z #12 0x00007fec15142416 in TDirectoryFile::WriteTObject (this=0x14022300, obj=0x15e61070, name=<optimized out>, option=<optimized out>, bufsize=0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TDirectoryFile.cxx:1962
2024-02-21T18:40:35.9364313Z #13 0x00007fec159e3a75 in TObject::Write (this=0x15e61070, name=0x0, option=<optimized out>, bufsize=0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/core/base/src/TObject.cxx:863
2024-02-21T18:40:35.9365494Z #14 0x00007febcbf330c2 in ?? ()
2024-02-21T18:40:35.9365970Z #15 0x00000000145066a0 in ?? ()
2024-02-21T18:40:35.9366404Z #16 0x00007ffed9c84970 in ?? ()
2024-02-21T18:40:35.9366740Z #17 0x0000000015e61070 in ?? ()
2024-02-21T18:40:35.9367307Z #18 0x00007ffed9c849fc in ?? ()
2024-02-21T18:40:35.9367752Z #19 0x0000000000000000 in ?? ()
2024-02-21T18:40:35.9368169Z ===========================================================
2024-02-21T18:40:35.9368447Z 
2024-02-21T18:40:35.9368451Z 
2024-02-21T18:40:35.9368766Z The lines below might hint at the cause of the crash. If you see question
2024-02-21T18:40:35.9369518Z marks as part of the stack trace, try to recompile with debugging information
2024-02-21T18:40:35.9370255Z enabled and export CLING_DEBUG=1 environment variable before running.
2024-02-21T18:40:35.9370941Z You may get help by asking at the ROOT forum https://root.cern/forum
2024-02-21T18:40:35.9371732Z Only if you are really convinced it is a bug in ROOT then please submit a
2024-02-21T18:40:35.9372492Z report at https://root.cern/bugs Please post the ENTIRE stack trace
2024-02-21T18:40:35.9373179Z from above as an attachment in addition to anything else
2024-02-21T18:40:35.9373669Z that might help us fixing this issue.
2024-02-21T18:40:35.9374114Z ===========================================================
2024-02-21T18:40:35.9374708Z #8  TFree::GetBestFree (this=<optimized out>, lfree=lfree
2024-02-21T18:40:35.9375199Z entry=0x14b281d0, nbytes=nbytes
2024-02-21T18:40:35.9376106Z entry=95) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TFree.cxx:133
2024-02-21T18:40:35.9377939Z #9  0x00007fec1517c424 in TKey::Create (this=0xc6ca2b0, nbytes=36, externFile=0x0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TKey.cxx:475
2024-02-21T18:40:35.9379085Z #10 0x00007fec1517f42b in TKey::TKey (this=this
2024-02-21T18:40:35.9379545Z entry=0xc6ca2b0, obj=obj
2024-02-21T18:40:35.9379972Z entry=0x15e61070, name=name
2024-02-21T18:40:35.9380466Z entry=0x14d33df0 "eventsProcessed", bufsize=bufsize
2024-02-21T18:40:35.9380953Z entry=1024, motherDir=motherDir
2024-02-21T18:40:35.9381911Z entry=0x14022300) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TKey.cxx:286
2024-02-21T18:40:35.9383869Z #11 0x00007fec15151145 in TFile::CreateKey (this=<optimized out>, mother=0x14022300, obj=0x15e61070, name=0x14d33df0 "eventsProcessed", bufsize=1024) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TFile.cxx:1014
2024-02-21T18:40:35.9386348Z #12 0x00007fec15142416 in TDirectoryFile::WriteTObject (this=0x14022300, obj=0x15e61070, name=<optimized out>, option=<optimized out>, bufsize=0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/io/io/src/TDirectoryFile.cxx:1962
2024-02-21T18:40:35.9388690Z #13 0x00007fec159e3a75 in TObject::Write (this=0x15e61070, name=0x0, option=<optimized out>, bufsize=0) at /tmp/root/spack-stage/spack-stage-root-6.28.10-2k5pau2p4ygavqiz6sppdbz3yrckl2eg/spack-src/core/base/src/TObject.cxx:863
2024-02-21T18:40:35.9389881Z #14 0x00007febcbf330c2 in ?? ()
2024-02-21T18:40:35.9390333Z #15 0x00000000145066a0 in ?? ()
2024-02-21T18:40:35.9390706Z #16 0x00007ffed9c84970 in ?? ()
2024-02-21T18:40:35.9391056Z #17 0x0000000015e61070 in ?? ()
2024-02-21T18:40:35.9391487Z #18 0x00007ffed9c849fc in ?? ()
2024-02-21T18:40:35.9391933Z #19 0x0000000000000000 in ?? ()
2024-02-21T18:40:35.9392348Z ===========================================================
2024-02-21T18:40:35.9392628Z 
2024-02-21T18:40:35.9392633Z 
2024-02-21T18:40:35.9392637Z 
2024-02-21T18:40:35.9392641Z 
2024-02-21T18:40:35.9392902Z 97% tests passed, 1 tests failed out of 38
2024-02-21T18:40:35.9393181Z 
2024-02-21T18:40:35.9393373Z Total Test time (real) = 120.62 sec
2024-02-21T18:40:35.9393619Z 
2024-02-21T18:40:35.9393751Z The following tests FAILED:
2024-02-21T18:40:35.9394451Z 	  4 - fccanalysisrun_examples/FCCee/higgs/mH-recoil/mumu/analysis_stage1.py (SEGFAULT)

Looks something related to file input:

2024-02-21T18:40:35.9036643Z Warning in <TFile::Init>: file outputs/FCCee/higgs/mH-recoil/mumu/stage1/output.root probably not closed, cannot read free segments
2024-02-21T18:40:35.9038695Z Warning in <TFile::Init>: file outputs/FCCee/higgs/mH-recoil/mumu/stage1/output.root has no keys

This is on Alma9 using the latest nightly. From running the CI other times it seems there is a low probability of this happening but it would be nice to have it fixed, maybe by retrying to get the file if that didn't work? I'm not sure what went wrong here. It's running ctest -j 2 or ctest -j 4 I don't remember how many cores the runners have.
@kjvbrt kjvbrt mentioned this issue Feb 22, 2024
Merged
@kjvbrt
Copy link
Contributor

kjvbrt commented Feb 22, 2024

This looks like the output file is not yet ready when additional information is being written to it. This #352 should help, but I'm not entirely sure.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jmcarcell @kjvbrt