KM3NeT Computing and Data Management Kay Graf, ECAP , University - - PowerPoint PPT Presentation

▶
km3net computing and data management
SMART_READER_LITE
LIVE PREVIEW

KM3NeT Computing and Data Management Kay Graf, ECAP , University - - PowerPoint PPT Presentation

Feb 05, 2023 492 likes •669 views

KM3NeT Computing and Data Management Kay Graf, ECAP , University of Erlangen ASTERICS European Data Provider Forum and Training Event 2018 Heidelberg, 27 / 28 June 2018 H2020-Astronomy ESFRI and Research Infrastructure Cluster (Grant

slide-1
SLIDE 1

KM3NeT Computing and Data Management

Kay Graf, ECAP , University of Erlangen ASTERICS European Data Provider Forum and Training Event 2018 Heidelberg, 27 / 28 June 2018

H2020-Astronomy ESFRI and Research Infrastructure Cluster (Grant Agreement number: 653477).

slide-2
SLIDE 2

Neutrino-Astronomy and KM3NeT

2

slide-3
SLIDE 3

3

The Neutrino Telescope World Map 2018

ANTARES Deep water 0.01 km3 2008 – 2019 Baikal/GVD Deep water ~1 km3 Construction KM3NeT Deep water 1 + 0.006 km3 Construction IceCube Deep ice 1 km3 2011 – IceCube-Gen2 Deep ice ~10 km3 Projected, 1st phase imminent

ASTERICS EDP Forum, Heidelberg - June 2018 - K. Graf, ECAP

From: U. Katz, “Future neutrino telescopes in water and ice”, Neutrino 2018, Heidelberg

slide-4
SLIDE 4

The KM3NeT Collaboration

  • about 230 authors; more than 45 institutes or universities;

15 different countries

  • to build, install and operate the first phase of the KM3NeT Research

Infrastructure in the Mediterranean Sea which houses a network of neutrino detectors and ports for Earth and Sea science research

4

slide-5
SLIDE 5

The KM3NeT-ORCA/ARCA Design

  • DU: vertical slender string equipped with 18 DOMS, 9/36 m vertical spacing
  • power and data distributed by a single backbone cable from shore;

seafloor network of cables and junction boxes connected

  • all data sent to shore and processed there in a dedicated computing farm

artist’s view

sensitive element: Digital Optical Module (DOM) vertical structure: Detection Unit (DU)

3D array of optical sensors

5

!

" artist’s view

  • ASTERICS EDP Forum, Heidelberg - June 2018 - K. Graf, ECAP
slide-6
SLIDE 6

KM3NeT 2.0 = ARCA and ORCA

ASTERICS EDP Forum, Heidelberg - June 2018 - K. Graf, ECAP 6

ARCA =

Vertical DOM distance = 36 m

ORCA =

Vertical DOM distance = 9 m Astroparticle Research with Cosmics in the Abyss Oscillation Research with Cosmics in the Abyss

+

Phase 1 (fully funded)

KM3NeT 2.0 Letter of Intent: arXiv:1601.07459 and J.Phys. G43 (2016) 084001

Phase 2 partially funded

From: U. Katz, “Future neutrino telescopes in water and ice”, Neutrino 2018, Heidelberg

slide-7
SLIDE 7

KM3NeT 2.0 = ARCA and ORCA

ASTERICS EDP Forum, Heidelberg - June 2018 - K. Graf, ECAP 7

ARCA =

Vertical DOM distance = 36 m

ORCA =

Vertical DOM distance = 9 m Astroparticle Research with Cosmics in the Abyss Oscillation Research with Cosmics in the Abyss

+

Phase 1 (fully funded)

KM3NeT 2.0 Letter of Intent: arXiv:1601.07459 and J.Phys. G43 (2016) 084001

Phase 2 partially funded

time

Phase 1 Deployment 2018-19 KM3NeT 2.0 Deployment 2019-21

From: U. Katz, “Future neutrino telescopes in water and ice”, Neutrino 2018, Heidelberg

slide-8
SLIDE 8

ASTERICS EDP Forum, Heidelberg - June 2018 - K. Graf, ECAP 8

Neutrino astronomy: where are we? The exploration

  • f the high-energy

Universe requires multi-messenger studies including neutrinos!

From: U. Katz, “Future neutrino telescopes in water and ice”, Neutrino 2018, Heidelberg

slide-9
SLIDE 9

KM3NeT Data Provisioning:

  • offline:

detector events, after full data processing (quality control) with embargo time

  • (near) online: alerts, astrophysical events

after order of a minute with partial data processing (e.g. reduced calibration precision) and specific data streams (e.g. acoustic data)

9

slide-10
SLIDE 10

What to Expect from Neutrino Experiments?

10

from: IceCube Coll. “Searches for Extended and Point-like Neutrino Sources with Four Years of IceCube Data” arXiv:1406.6757 [astro-ph.HE]

Pre-trial significance sky map from ~215k events simulation dominated by:

  • atm. #’s

atm $’s

similar numbers for KM3NeT

  • No. of

strings Live-time [days]

  • No. of up-

going events

  • No. of down-

going events 40 376 14,121 22,779 59 348 43,339 64,230 79 316 50,857 59,009 86 333 69,227 69,096

slide-11
SLIDE 11

KM3NeT Data Management

CC-IN2P3 … CC-IN2P3 CNAF ReCaS CC-IN2P3 CNAF ReCaS … KM3NeT FR

  • nshore

computing KM3NeT IT

  • nshore

computing Local computing resources Tier-0 Tier-1 Tier-2 storage processing analysis KM3NeT users GRID access batch access raw data data base acquisition

ASTERICS EDP Forum, Heidelberg - June 2018 - K. Graf, ECAP 11

  • nline
  • ffline

Internal: Open access service (special, VO, later: EOSC) science community External:

slide-12
SLIDE 12

KM3NeT Data Management Plan

  • KM3NeT set up a data management plan including:
  • Data summary
  • FAIR data usage
  • Findability
  • Open accessibility
  • Interoperability
  • Re-usability
  • VO is one key ingredient for FAIR data usage both for:
  • Online data (alerts, events)
  • Offline data (detector events)

ASTERICS EDP Forum, Heidelberg - June 2018 - K. Graf, ECAP 12

slide-13
SLIDE 13

ANTARES Data in GAVO Data Centre

  • “2007-2012 ANTARES search for cosmic neutrino point sources”
  • Update from 2010 to 2012 in Dec. 2017
  • 5921 events obtained during the effective lifetime of 1338 days.
  • Coordinates, simple energy estimator (number of photons detected)

ASTERICS EDP Forum, Heidelberg - June 2018 - K. Graf, ECAP 13

from: http://dc.zah.uni-heidelberg.de/antares/q/cone/info

test case for KM3NeT

slide-14
SLIDE 14

LSST SVOM TAROT

KM3NeT multi-messenger program

14

  • Follow-up of neutrino alerts
  • Joint sub-threshold analysis
  • Follow-up of EM/GW alerts
  • Offline time/space correlation

search with catalogues (GRB, AGN, XRB, SN, FRB…)

see Massimiliano’s talk tomorrow

KM3NeT ELT LIGO/VIRGO HAWC SKA CTA

ASTERICS EDP Forum, Heidelberg - June 2018 - K. Graf, ECAP

slide-15
SLIDE 15

ANTARES alert brokers: * GCN socket: TAROT, ZADKO, MASTER, INTEGRAL * VO Event: MWA, HESS, SVOM, AMON * Mail: Swift For ANTARES, all neutrino information are private. Need MoU with external partners. Alert Message: * ID * Time, * RA, DEC, error 50% * Energy proxy * Reconstruction quality * probability neutrino * Multiplicity, type of trigger Only one real-time message For KM3NeT: define a standard VO event: * ID * Time, * RA, DEC, error 50% * Energy proxy * Reconstruction quality * probability neutrino * type of neutrino * Multiplicity * Type of trigger + develop one alert brokers with different types of alerts

From: ANTARES Alerts and Broker

15

to: a KM3NeT “Open Public Alert” programme

slide-16
SLIDE 16

Links with IVOA, ASTERICS

16

  • IVOA tools
  • to format alert messages (VO Event)
  • to set brokers (Comet)
  • to plan observations (STARALT,

OVAP, OLAP…)

  • for source identification (Simbad,

Aladin, Aladin-Little, VizieR, Xmatch…)

  • Asterics: ROAst (to be verified)
slide-17
SLIDE 17

Open Data Policy

  • central goal: prompt dissemination of scientific results, new methods

and implementations; provide cross-experiment simulation data

  • Data policy:
  • public access to summary data (event information plus quality

information, simulation) after fixed latency (typically 2 years); event and alert data

  • web-based downloads of data and software (VO et other services)
  • special arrangements on more (detailed) data, earlier releases, etc.
  • observer in KM3NeT collaboration (free of charge)
  • access to all data, meetings, etc. (but no voting rights); co-authorship for

contributions to publicationS

  • H2020 funded:

preparation in ASTERICS, complete concept in KM3NeT-INFRADEV

  • Additional activities: e.g. CORSIKA production (air shower simulation)

for cross-experiment use defined, processed and made public within ASTERICS (CORElib)

ASTERICS EDP Forum, Heidelberg - June 2018 - K. Graf, ECAP 17