Data Quality in Gravitational Wave Burst and Inspiral Searches in the - - PowerPoint PPT Presentation

data quality in gravitational wave burst and inspiral
SMART_READER_LITE
LIVE PREVIEW

Data Quality in Gravitational Wave Burst and Inspiral Searches in the - - PowerPoint PPT Presentation

Data Quality in Gravitational Wave Burst and Inspiral Searches in the 2 n d Virgo Science Run Florent Robinet For the Virgo and the LSC Collaborations The Virgo Data Quality Group Activities Online analysis pipelines Kleine Welle triggers


slide-1
SLIDE 1

Data Quality in Gravitational Wave Burst and Inspiral Searches in the 2n

d Virgo Science Run

Florent Robinet For the Virgo and the LSC Collaborations

slide-2
SLIDE 2

The Virgo Data Quality Group Activities

GWDAW-14 Florent Robinet 1

Noise/Glitch Understanding

Monitoring tools Online analysis pipelines MBTA (CBC), Omega (Bursts) Commissioning inputs Scientists on shift inputs

DQ flag definition ONLINE DQ segments production DQ flag checks DQ flag performance DQ flag safety OFFLINE DQ segments production

Kleine Welle triggers in auxiliary channels

Coupling between auxiliary channels and the GW channel Channel selection OFFLINE Veto segments production

Online analysis pipelines Offline analysis pipelines Feedback to commissioning Online monitoring tools

Storage / Access Storage / Access

slide-3
SLIDE 3

Tools for Investigations

GWDAW-14 Florent Robinet 2-1

  • Online Analysis Pipelines

Omega for bursts, MBTA for CBC Trigger rate variations Follow-up of the loudest events Loudest events Population

  • f glitches

Bad Weather

slide-4
SLIDE 4

Tools for Investigations

GWDAW-14 Florent Robinet 2-2

  • Online Analysis Pipelines

Omega for bursts, MBTA for CBC Trigger rate variations Follow-up of the loudest events

  • Monitoring Tools

Band-RMS Spectrograms Omega scans Environmental monitoring

GW Signal Injection channel Magnetic sensor

> 100 auxiliary channels COUPLING

slide-5
SLIDE 5

Tools for Investigations

GWDAW-14 Florent Robinet 2-3

  • Online Analysis Pipelines

Omega for bursts, MBTA for CBC Trigger rate variations Follow-up of the loudest events

  • Monitoring Tools

Band-RMS Spectrograms Omega scans Environmental monitoring

  • Commissioning People

Unique knowledge of the interferometer Work on the detector on a day-by-day basis Strong interaction between the DQ group and the commissioning team

slide-6
SLIDE 6

Tools for Investigations

GWDAW-14 Florent Robinet 2-4

  • Online Analysis Pipelines

Omega for bursts, MBTA for CBC Trigger rate variations Follow-up of the loudest events

  • Monitoring Tools

Band-RMS Spectrograms Omega scans Environmental monitoring

  • Commissioning People

Unique knowledge of the interferometer Work on the detector on a day-by-day basis Strong interaction between the DQ group and the commissioning team

  • Scientists on Shift

Shift report in the logbook Weekly glitch investigation

slide-7
SLIDE 7

DQ Categories

GWDAW-14 Florent Robinet 3-1

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data.

  • Ex. : Missing h(t)
slide-8
SLIDE 8

DQ Categories

GWDAW-14 Florent Robinet 3-2

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data.

  • Ex. : Flags defined by hand in case of a serious malfunction of the detector

Usually, these kind of flags are introduced offline later, based on observations of commissioners / shifters. Thermal Compensation System failure

slide-9
SLIDE 9

DQ Categories

GWDAW-14 Florent Robinet 3-3

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data. CAT 2 : Noisy periods where the coupling noise source / GW channel is well established. Triggers are removed before post-processing (coincidence, selection cuts...)

  • Ex. : Magnetic glitches. A 50Hz glitch is seen by all the magnetometer at the same time.

GW channel

slide-10
SLIDE 10

DQ Categories

GWDAW-14 Florent Robinet 3-4

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data. CAT 2 : Noisy periods where the coupling noise source / GW channel is well established. Triggers are removed before post-processing (coincidence, selection cuts...)

  • Ex. : Acoustic glitches.

Airplane event detected by a microphone

GW channel

slide-11
SLIDE 11

DQ Categories

GWDAW-14 Florent Robinet 3-4

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data. CAT 2 : Noisy periods where the coupling noise source / GW channel is well established. Triggers are removed before post-processing (coincidence, selection cuts...)

  • Ex. : Acoustic glitches.

Airplane event detected by a microphone

GW channel Helicopter flying over the site NS/NS horizon

slide-12
SLIDE 12

DQ Categories

GWDAW-14 Florent Robinet 3-5

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data. CAT 2 : Noisy periods where the coupling noise source / GW channel is well established. Triggers are removed before post-processing (coincidence, selection cuts...)

  • Ex. : Severe micro-seismic activity see I. Fiori's talk

Flagging of Omega triggers

GW channel

slide-13
SLIDE 13

DQ Categories

GWDAW-14 Florent Robinet 3-6

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data. CAT 2 : Noisy periods where the coupling noise source / GW channel is well established. Triggers are removed before post-processing (coincidence, selection cuts...) CAT 3 : Noisy periods where the coupling is not well understood. The validity of a GW candidate flagged by a CAT3 should be controlled carefully.

  • Ex. : seismic glitches

2 seismic glitches of the same amplitude will not have the same impact on the GW channel. CAT3 vetoes plays a big role in the follow-up studies. GW channel SNR ~ 25 Seismometer

slide-14
SLIDE 14

DQ Categories

GWDAW-14 Florent Robinet 3-6

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data. CAT 2 : Noisy periods where the coupling noise source / GW channel is well established. Triggers are removed before post-processing (coincidence, selection cuts...) CAT 3 : Noisy periods where the coupling is not well understood. The validity of a GW candidate flagged by a CAT3 should be controlled carefully.

  • Ex. : seismic glitches

2 seismic glitches of the same amplitude will not have the same impact on the GW channel. CAT3 vetoes plays a big role in the follow-up studies. GW channel Seismometer

slide-15
SLIDE 15

DQ Categories

GWDAW-14 Florent Robinet 3-7

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data. CAT 2 : Noisy periods where the coupling noise source / GW channel is well established. Triggers are removed before post-processing (coincidence, selection cuts...) CAT 3 : Noisy periods where the coupling is not well understood. The validity of a GW candidate flagged by a CAT3 should be controlled carefully.

  • Ex. : Same as CAT2 but with stricter threshold

CAT2 micro-seismic flag CAT3 micro-seismic flag with a lower threshold

slide-16
SLIDE 16

DQ Categories

GWDAW-14 Florent Robinet 3-8

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data. CAT 2 : Noisy periods where the coupling noise source / GW channel is well established. Triggers are removed before post-processing (coincidence, selection cuts...) CAT 3 : Noisy periods where the coupling is not well understood. The validity of a GW candidate flagged by a CAT3 should be controlled carefully. CAT 4 : Hardware injections used for sensitivity studies To be removed from the GW candidate list

slide-17
SLIDE 17

DQ Categories

GWDAW-14 Florent Robinet 3-9

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data. CAT 2 : Noisy periods where the coupling noise source / GW channel is well established. Triggers are removed before post-processing (coincidence, selection cuts...) CAT 3 : Noisy periods where the coupling is not well understood. The validity of a GW candidate flagged by a CAT3 should be controlled carefully. CAT 4 : Hardware injections used for sensitivity studies To be removed from the GW candidate list CAT5 : Advisory flags to track problems on the detector but no direct impact on the GW channel

  • Ex. : 300sec after the lock starts the detector is known to be unstable.

TOTAL ~ 70 DQ flags

slide-18
SLIDE 18

DQ Categories

GWDAW-14 Florent Robinet 3-10

DQ flags have been divided into 5 categories for a better use by analyses : CAT 1 : Obvious problems on the detector. CAT1 periods have to be removed to redefine the science data. CAT 2 : Noisy periods where the coupling noise source / GW channel is well established. Triggers are removed before post-processing (coincidence, selection cuts...) CAT 3 : Noisy periods where the coupling is not well understood. The validity of a GW candidate flagged by a CAT3 should be controlled carefully. CAT 4 : Hardware injections used for sensitivity studies To be removed from the GW candidate list CAT5 : Advisory flags to track problems on the detector but no direct impact on the GW channel

  • Ex. : 300sec after the lock starts the detector is known to be unstable.

TOTAL ~ 70 DQ flags The safety of all DQ flags has been checked A flag is declared unsafe if the number of flagged hardware injections is larger than dead-time × total number of hardware injections

slide-19
SLIDE 19

DQ Impact for Bursts

GWDAW-14 Florent Robinet 4-1

8 first weeks of VSR2 Cumulative dead-time ~ 1 % ~ + 3 % ~ + 6 % Efficiency for SNR > 8 : ~ 25 % ~ + 15 % ~ + 15 %

slide-20
SLIDE 20

DQ Impact for Bursts (Omega)

GWDAW-14 Florent Robinet 4-2

8 first weeks of VSR2 19 last weeks of VSR2 Cumulative dead-time ~ 5 % ~ + 7 % ~ + 16 % Mostly due to bad weather conditions

PRELIMINARY

Cumulative dead-time ~ 1 % ~ + 3 % ~ + 6 %

slide-21
SLIDE 21

DQ Impact for Inspirals (MBTA)

GWDAW-14 Florent Robinet 5

Cumulative dead-time ~ 1 % ~ + 3 % ~ + 6 % Efficiency for SNR > 7 : ~ 14 % ~ + 11 % ~ + 12 % 8 first weeks of VSR2

slide-22
SLIDE 22

Veto Based on Auxiliary Channels

GWDAW-14 Florent Robinet 6-1

Kleine Welle is a fast filtering algorithm used to produce triggers on multiple channels (>200 at Virgo) :

  • Environmental channels : seismic, magnetic, acoustic...
  • Optical channels : photodiode signals, laser monitoring
  • Control channels

The most useful channels are selected by looking at the correlations with the GW triggers. 2 strategies are used to define the vetoes : Burst strategy : 1) Channels are ranked according to their efficiency to remove GW triggers. 2)

  • Only channels with a large statistical significance are used (LIGO).
  • Only channels with a large efficiency/use-percentage are used (Virgo).

CBC Strategy : Only channels with a use-percentage > 50% are used (both for Virgo and LIGO) See T. Isogai's poster All the strategies give consistent results

slide-23
SLIDE 23

Veto Based on Auxiliary Channels

GWDAW-14 Florent Robinet 6-2

Cumulative dead-time ~ 1 % ~ + 0.06 % Efficiency for SNR > 8 : ~ 25 % ~ + 8 %

One of the main interest

  • f the KW vetoes is the

very low dead-time

8 first weeks of VSR2

PRELIMINARY

slide-24
SLIDE 24

A Virgo Specificity : PQ Veto

GWDAW-14 Florent Robinet 7

For VSR1, a specific veto was originally introduced for dust induced events. A genuine GW signal should create a signal in the in-phase channel (ACp) and not in the quadrature channel (ACq). The PQ veto is based on coincident KW triggers in ACp and ACq (EA

C q > EA C p ).

This veto can be defined only in Virgo since the demodulation phase is monitored and kept at a well- tuned value. Very low dead-time ( < 0.5 % ). Safety is checked on hardware injections (green points).

ACp KW SNR A C q K W S N R

slide-25
SLIDE 25

DQ Storage

GWDAW-14 Florent Robinet 8

MySQL database to store DQ and veto segments. Web interface to retrieve and combine segment lists. Very practical tool for follow-up studies. The Virgo database is frequently synchronized with the LIGO database.

slide-26
SLIDE 26

Online Data Quality

GWDAW-14 Florent Robinet 9

Online data DQ monitors Segments generation Database storage Transfer to network analyses DQ applied to triggers Alerts To the control room DQ monitors have been developed to produce DQ flags with a few seconds latency. (~70 flags) Monitor outputs are used in the control room by the shift crew. Segments are generated and sent to the analysis computers within the minute. Candidate alerts (see Erik Katsavounidis's talk)

slide-27
SLIDE 27

Conclusions

GWDAW-14 Florent Robinet 10

  • The data quality work has become more and more crucial to aim at a GW detection.
  • The Virgo Data Quality Group is an essential piece between the detector and the analyses groups.
  • Large efforts have been made to understand the noise of the new VSR2 detector.
  • About 70 DQ flags have been defined and are produced online.
  • Correlations with auxiliary channels have been studied and used to produce powerful vetoes

(KW)

  • Many checks have been performed to insure the veto reliability :
  • Segment checks
  • Safety against signal injections
  • Performance over analyses pipelines
  • Categorization of the flags
  • Application of the Virgo vetoes over the analyses triggers show that a large fraction of events can

be flagged with a limited dead-time.

  • Some glitches remain unexplained and are under investigation.
  • More improvements are expected in the next few weeks.