HammerCloud | ATLAS rss

Administration
<< Back

PanDA incidents history

The following table summarizes the incidents happened in HammerCloud tests. You can filter the results using the form below and clicking in 'Refresh'.


Incidents for last 72 hours

TimestampSeverityCommentTest
Thu 22 Jan 2026 17:06:11warningThe following sites need more test jobs for the PFT template 1289: DE-TARDIS, EMMY, HONGKONG, LRZ-LMU, LRZ-LMU_TEST, PUHTI, UNIGE-BAOBAB 20327389 »
Thu 22 Jan 2026 17:06:11warningThe following sites need more test jobs for the PFT template 1293: DE-TARDIS, EMMY, HONGKONG, SiGNET-NSC_MCORE, UNIGE-BAOBAB 20327389 »
Thu 22 Jan 2026 17:06:11warningThe following sites need more test jobs for the AFT template 1272: ANALY_BNL_VP, UNIGE-BAOBAB, wuppertal_VP 20327382 »
Thu 22 Jan 2026 17:06:11warningThe following sites need more test jobs for the AFT template 1273: ANALY_BNL_VP, UNIGE-BAOBAB, wuppertal_VP 20327382 »
Thu 22 Jan 2026 17:06:11warningThe following sites need more test jobs for the PFT_MCORE template 1294: UKI-SOUTHGRID-SUSX_TEST 20327344 »
Thu 22 Jan 2026 17:05:01warningUNIGE-BAOBAB->UNIGE-BAOBAB: Auto-inclusion policy Last-Two-From-All not passed. Site needs jobs for all templates (1273, 1272, 1293, 1289) 20327382 »
Thu 22 Jan 2026 17:05:01warningUM6P->UM6P: AutoInclusion policy Last-Two-From-All not passed. See jobs ** http://bigpanda.cern.ch/job?pandaid=6980061580 ==> modificationHost: aipanda404.cern.ch pilot:::9000 LRMS error: (309) Job failed ddm:::200 expected output 7ac9a3cc-bb37-443c-a6b4-eb89bfb292f9_36570.1.job.log.tgz is missing in pilot JSON ** http://bigpanda.cern.ch/job?pandaid=6980062990 ==> modificationHost: aipanda404.cern.ch pilot:::9000 LRMS error: (309) Job failed ddm:::200 expected output c333b753-cd87-4379-bee6-b2121bddbef1_59640.1.job.log.tgz is missing in pilot JSON 20327344 »
Thu 22 Jan 2026 17:05:01warningINFN-COSENZA-RECAS->INFN-COSENZA-RECAS: AutoInclusion policy Last-Two-From-All not passed. See jobs ** http://bigpanda.cern.ch/job?pandaid=6979556487 ==> modificationHost: slot1_7@recas-wn-35.cs.infn.it pilot:::1151 File transfer timed out during stage-in: mc23_13p6TeV:TXT.43313123._000084.tar.gz.1 from INFN-COSENZA_DATADISK, Error on XrdCl:CopyProcess:Run(): [ERROR] Server responded with an error: [3012] Internal timeout (source)')]:failed to transfer files using copytools=['rucio'] ** http://bigpanda.cern.ch/job?pandaid=6980103949 ==> modificationHost: slot1_2@recas-wn-35.cs.infn.it pilot:::1151 File transfer timed out during stage-in: mc21_13p6TeV:EVNT.29070483._000415.pool.root.1 from INFN-COSENZA_DATADISK, Error on XrdCl:CopyProcess:Run(): [ERROR] Server responded with an error: [3012] Internal timeout (source)')]:failed to transfer files using copytools=['rucio'] ** http://bigpanda.cern.ch/job?pandaid=6980094631 ==> modificationHost: slot1_1@recas-wn-35.cs.infn.it pilot:::1151 File transfer timed out during stage-in: mc21_13p6TeV:EVNT.29070483._000207.pool.root.1 from INFN-COSENZA_DATADISK, Error on XrdCl:CopyProcess:Run(): [ERROR] Server responded with an error: [3012] Internal timeout (source)')]:failed to transfer files using copytools=['rucio'] 20327389 »
Thu 22 Jan 2026 17:05:01warningAM-01-AANL->AM-01-AANL: AutoInclusion policy Last-Two-From-All not passed. See jobs ** http://bigpanda.cern.ch/job?pandaid=6980100299 ==> modificationHost: aipanda404.cern.ch pilot:::9000 LRMS error: (309) Job failed ddm:::200 expected output 5b2f64e3-7cbc-4011-85e8-6980277f4a7a_47147.1.job.log.tgz is missing in pilot JSON ** http://bigpanda.cern.ch/job?pandaid=6980092253 ==> modificationHost: aipanda403.cern.ch pilot:::9000 LRMS error: (309) Job failed ddm:::200 expected output 2c8d7e8c-bd3a-4fd5-a285-b777544794a0_13001.1.job.log.tgz is missing in pilot JSON 20327344 »
Thu 22 Jan 2026 17:05:01blacklistingChecking these sites currently test because of HC: ['AM-01-AANL', 'INFN-COSENZA-RECAS', 'UM6P', 'UNIGE-BAOBAB']  
Thu 22 Jan 2026 16:57:56warningSite CA-WATERLOO-T2 has missing input data of a dspattern. Will not submit any job to this site! Missing input dataset patterns: [[{'dsn': 'hc_test:mc20_13TeV.830072.H7EG_jetjet_Lund_JZ1.deriv.DAOD_PHYS.e8419_s3681_r13167_r13146_p5855_tid34870879_00', 'nfiles': '1'}]] 20327396 »
Thu 22 Jan 2026 16:57:56warningSite wuppertal_VP has missing input data of a dspattern. Will not submit any job to this site! Missing input dataset patterns: [[{'dsn': 'hc_test:mc20_13TeV.830072.H7EG_jetjet_Lund_JZ1.deriv.DAOD_PHYS.e8419_s3681_r13167_r13146_p5855_tid34870879_00', 'nfiles': '1'}]] 20327396 »
Thu 22 Jan 2026 16:57:56warningSite ANALY_BNL_VP has missing input data of a dspattern. Will not submit any job to this site! Missing input dataset patterns: [[{'dsn': 'hc_test:mc20_13TeV.830072.H7EG_jetjet_Lund_JZ1.deriv.DAOD_PHYS.e8419_s3681_r13167_r13146_p5855_tid34870879_00', 'nfiles': '1'}]] 20327396 »
Thu 22 Jan 2026 16:56:03testinfoTest 20327391 was assigned to hammercloud-ai-72.cern.ch. 20327391 »
Thu 22 Jan 2026 16:56:03testinfoTest 20327396 was assigned to hammercloud-ai-41.cern.ch. 20327396 »
Thu 22 Jan 2026 16:55:02errorTest 20327391 had no host at the moment of running. 20327391 »
Thu 22 Jan 2026 16:55:01errorTest 20327391 had no host at the moment of running. 20327391 »
Thu 22 Jan 2026 16:55:01errorTest 20327391 had no host at the moment of running. 20327391 »
Thu 22 Jan 2026 16:55:01errorTest 20327391 had no host at the moment of running. 20327391 »
Thu 22 Jan 2026 16:53:02errorTest 20327391 had no host at the moment of running. 20327391 »
Thu 22 Jan 2026 16:53:01errorTest 20327391 had no host at the moment of running. 20327391 »
Thu 22 Jan 2026 16:53:01errorTest 20327391 had no host at the moment of running. 20327391 »
Thu 22 Jan 2026 16:53:01errorTest 20327391 had no host at the moment of running. 20327391 »
Thu 22 Jan 2026 16:51:02warningThe following sites need more test jobs for the AFT template 1272: ANALY_BNL_VP, UNIGE-BAOBAB, wuppertal_VP 20327382 »
Thu 22 Jan 2026 16:51:02warningThe following sites need more test jobs for the AFT template 1273: ANALY_BNL_VP, UNIGE-BAOBAB, wuppertal_VP 20327382 »
«« first Page 1 of 161 next » last »»