AnaPAON4 : Analysis software for PAON4 JSkyMap : Map making and - - PowerPoint PPT Presentation

BAORadio / PAON4 c++ software suite

• R. Ansari

Xingchen Tianyuan Hotel, Pingtang, Guizhou, China September 2018

21 cm Cosmology workshop & Tianlai collaboration meeting

✤ AnaPAON4 : Analysis software for PAON4 ✤ JSkyMap : Map making and simulation software suit

for transit instruments ( Jiao Zhang PhD)

✤ TAcq : Acquisition software and software correlator

C++ software, using the SOPHYA class library

SOPHYA

a C++ class library for intensive data analysis and scientific computing

http://www.sophya.org https://gitlab.in2p3.fr/SOPHYA

AnaPAON4

✤ Classes for reading/managing the visibility files ✤ Satellites subdirectory: Satellites position / track computation (C. Magneville) ✤ AnaFringes subdirectory: Fringe fitting (with Minuit) (J.E.Campagne) ✤ Phase calibration , array geometry - also part of Qizhi Huang’s PhD work ✤ Script subdirectory: running different tasks , few python scripts ✤ A number of utility Classes in p4autils.h .cc :

✤ P4FreqBand , P4VisiNumEncoder , P4AnaParams , P4Coords , P4RAMapUtil

✤ Visibility reading classes (visip4reader.h .cc) :

✤ VisiP4ReaderBase , VisiP4ReaderNoDB , VisiP4ReaderDB

✤ Classes to compute gains and apply them : g(nu) ( p4gnugain.h .cc ) and G(t) ( p4gvcor.h

.cc )

✤ P4gnuGain , P4gvCor

AnaPAON4 (1)

git@gitlab.in2p3.fr:baoradio/AnaPAON4.git

✤ Input visibility reader classes (visip4reader.h .cc) , with services to select data one time

frame …

✤ VisiP4ReaderBase , VisiP4ReaderNoDB , VisiP4ReaderDB

✤ Phase correction class Φ(ν) ( p4phcor.h .cc )

✤ P4PhaseCor

✤ Higher level visibility reader class, with time windowing, with the capability to apply

gain/phase correction (visp4winreader.h .cc)

✤ VisiP4WindowReader

✤ Few programs to perform averaging/filtering to produce time-frequency (ou RA-freq)

• r other summary information, or gain computation …

✤ visiavg.cc visi2ra.cc visi2dtacx.cc visi2nt.cc

AnaPAON4 (2)

git@gitlab.in2p3.fr:baoradio/AnaPAON4.git

JSkyMap

Map making (visibility to map) and simulation (map to visibility) software tools - J. Zhang PhD Needs some documentation, maybe Jiao will write some …

✤ Simulation / computation of visibilities from spherical maps and map reconstruction

from visibilities

✤ J. Zhang PhD work (and papers) ✤ Example of utility codes: vis2map.cc , p4src2vis.cc , map2vis.cc ✤ (α,δ) map reconstruction through linear combination (beam-forming/phase-array) of

visibilities for PAON4 p4src2vis.cc (NOT applicable for polar cap) - Can be useful for mid latitude observations with Tianlai dish array

TArray<double> make_map_from_visibilities(vector< TArray< complex<double> > > & vec_visarr, bool useauto=false);

✤ Computing PAON4/Tianlai visibilities from a spherical map from a spherical

(HEALPix) or other pixelisations available in SOPHYA or from a liste of sources. Can easily make a version for Tianlai dish array.

JSkyMap

git@gitlab.in2p3.fr:SCosmoTools/JSkyMap.git

• Do not yet handle polarisation, but extension is rather easy
• Except for the computation of polarised beam responses…
• The code is rather simple, built around few classes, but relies on the

SOPHYA class library (http://www.sophya.org)

• Main classes used in JSkyMap :
• BeamTP , BeamLM and BeamVis
• SphCoordTrans , PseudoInverse<T>
• JSphSkyMap
• JSkyMap and BeamUV for planar geometry
• Some utility functions

JSkyMap : Map making software (II)

(J. Zhang PhD)

GIT repo: https://gitlab.in2p3.fr/SCosmoTools/JSkyMap

TAcq

A flexible and efficient c++ software for interferometer data acquisition, correlator (can be extended to beam former) - mostly for development/debugging purposes

https://gitlab.in2p3.fr/baoradio/tacq

Several level of parallelism :

• Coarse: processes running over compute nodes in a cluster
• Fine: tasks running (threads) on different cores within a single process
• VeryFine: multi-threaded tasks for CPU heavy tasks

✤ Multi-thread programs / object oriented (C++) architecture ✤ FITS files (+ directory structure) for data storage (raw data/Fourier

coefficient/Visibilities/spectra)

✤ BRPaquet hardware / software data exchange unit ✤ RAcqMemZoneMgr (memory manager) insure thread

synchronisation/coordination

✤ Thread objects (ZThread) perform differents tasks ✤ Uses the SOPHYA C++ class library ✤ HDF5 files can also be used , as the latest SOPHYA release has / will

have HDF5 support

BAORadio Acquisition/Processing software

https://gitlab.in2p3.fr/baoradio/tacq

Some of the TAcq classes

✤ Class BRPaquet & BRPaqChecker ✤ Class RAcqMemZoneMgr (Multi fiber / link managed memory zone) ✤ Thread (task) classes (ZThread) ( see next slide) ✤ Class MiniFITSFile

HDR TRL BRPaquet … Data … The programs can be deployed over a computer cluster, and coherent execution over time is insured partly thank to the BRPaquet TimeTagged data paquets

Thread (Task) classes

• PCIEMultiReader (PCI-Express DMA to memory)
• PCIEToEthernet (PCI-Express DMA to ethernet )
• MultiDataSaver (Writes packet data to disk (FITS format))
• EthernetReader (Read packet from ethernet to memory)
• BRMultiFitsReader (Multi fiber fits reader, align in time)
• BRVisibilityCalculator (Computes visibilities, multi-

threaded internally)

• BRFFTCalculator (perform FFT on raw data - multi-

threaded internally)

• MonitorProc(s) (Monitoring during processing)

P11 P12 P13 P14 … P21 P22 P23 … P31 P32 …

RAcqMemZoneMgr T1 -ReadEternet

↔ ↔

BRVisibilityCalculator

↔

ZThread

Fils d’exécution : EthernetReader, VisiCalc, Monitoring …

↔

T3 - Monitoring

↔

DMA-Task

↔

PCIExpress Ethernet

Task: PCIExpress ➠ Ethernet Acquisition/visibility computation(mfacq)

PAON4 acquisition configuration

Waveform data stream from receivers First layer:perform FFT, split in frequency bands and send to the second level

Network

Second layer: computes correlations - saves data to disk

The same program runs, all the configuration, including the cluster configuration, in parameters (datacard) Operation over different nodes in streaming mode (data is pushed forward)