topology detection
play

topology detection Screenshot (und Demo?) hwloc /proc/cpuinfo - PowerPoint PPT Presentation

May 03, 2023 •33 likes •323 views

topology detection Screenshot (und Demo?) hwloc /proc/cpuinfo processor : 0 vendor_id : GenuineIntel model name : Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz cache size : 15360 KB physical id : 0 siblings :

  1. topology detection

  2. ● Screenshot (und Demo?) hwloc

  3. /proc/cpuinfo processor : 0 vendor_id : GenuineIntel model name : Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz cache size : 15360 KB physical id : 0 siblings : 12 core id : 0 cpu cores : 6 flags : fpu vme de pse … processor : 1 vendor_id : GenuineIntel model name : Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz cache size : 15360 KB physical id : 0 siblings : 12 core id : 1 cpu cores : 6 flags : fpu vme de pse …

  4. /proc/cpuinfo processor : 0 vendor_id : GenuineIntel model name : Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz cache size : 15360 KB physical id : 0 siblings : 12 core id : 0 cpu cores : 6 flags : fpu vme de pse … processor : 1 vendor_id : GenuineIntel model name : Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz cache size : 15360 KB physical id : 0 siblings : 12 core id : 1 cpu cores : 6 flags : fpu vme de pse …

  5. numactl --hardware node 0 cpus: 0 1 2 3 4 5 12 13 14 15 16 17 node 0 size: 32140 MB node 0 free: 28841 MB node 1 cpus: 6 7 8 9 10 11 18 19 20 21 22 23 node 1 size: 32251 MB node 1 free: 30743 MB node distances: node 0 1 0: 10 20 1: 20 10

  6. numactl --hardware node 0 cpus: 0 1 2 3 4 5 12 13 14 15 16 17 node 0 size: 32140 MB node 0 free: 28841 MB node 1 cpus: 6 7 8 9 10 11 18 19 20 21 22 23 node 1 size: 32251 MB node 1 free: 30743 MB node distances: node 0 1 0: 10 20 1: 20 10

  7. numactl --hardware [...] node distances: node 0 1 2 3 4 5 6 7 0: 10 12 17 17 19 19 19 19 1: 12 10 17 17 19 19 19 19 2: 17 17 10 12 19 19 19 19 3: 17 17 12 10 19 19 19 19 4: 19 19 19 19 10 12 17 17 5: 19 19 19 19 12 10 17 17 6: 19 19 19 19 17 17 10 12 7: 19 19 19 19 17 17 12 10

  8. ● /sys/devices/system/node/node* ● /sys/devices/system/node/node*/distance ● /sys/devices/system/node/node*/cpu*

  9. Information sources ● ACPI – System Resource Affinity Table (SRAT) ● NUMA nodes (proximity domains), RAM, Interrupt controllers, – System Locality Distance Information Table (SLIT) ● only relative information about "distances"

  10. estimate hardware topology [...] node distances: node 0 1 2 3 4 5 6 7 0: 10 12 17 17 19 19 19 19 1: 12 10 17 17 19 19 19 19 2: 17 17 10 12 19 19 19 19 3: 17 17 12 10 19 19 19 19 4: 19 19 19 19 10 12 17 17 5: 19 19 19 19 12 10 17 17 6: 19 19 19 19 17 17 10 12 7: 19 19 19 19 17 17 12 10

  11. estimate hardware topology [...] node distances: node 0 1 2 3 4 5 6 7 0: 10 12 17 17 19 19 19 19 1: 12 10 17 17 19 19 19 19 2: 17 17 10 12 19 19 19 19 3: 17 17 12 10 19 19 19 19 4: 19 19 19 19 10 12 17 17 5: 19 19 19 19 12 10 17 17 6: 19 19 19 19 17 17 10 12 7: 19 19 19 19 17 17 12 10 0 1 2 3 4 5 6 7

  12. estimate hardware topology [...] node distances: node 0 1 2 3 4 5 6 7 0: 10 12 17 17 19 19 19 19 1: 12 10 17 17 19 19 19 19 2: 17 17 10 12 19 19 19 19 3: 17 17 12 10 19 19 19 19 4: 19 19 19 19 10 12 17 17 5: 19 19 19 19 12 10 17 17 6: 19 19 19 19 17 17 10 12 7: 19 19 19 19 17 17 12 10 0 2 4 6 1 3 5 7

  13. estimate hardware topology [...] node distances: node 0 1 2 3 4 5 6 7 0: 10 12 17 17 19 19 19 19 1: 12 10 17 17 19 19 19 19 2: 17 17 10 12 19 19 19 19 3: 17 17 12 10 19 19 19 19 4: 19 19 19 19 10 12 17 17 5: 19 19 19 19 12 10 17 17 6: 19 19 19 19 17 17 10 12 7: 19 19 19 19 17 17 12 10 0 2 4 6 1 3 5 7

  14. estimate hardware topology [...] node distances: node 0 1 2 3 4 5 6 7 0: 10 12 17 17 19 19 19 19 1: 12 10 17 17 19 19 19 19 2: 17 17 10 12 19 19 19 19 3: 17 17 12 10 19 19 19 19 4: 19 19 19 19 10 12 17 17 5: 19 19 19 19 12 10 17 17 6: 19 19 19 19 17 17 10 12 7: 19 19 19 19 17 17 12 10 ? 0 2 1 3 4 6 5 7

  15. actual hardware topology? ● Wasn't there only max 4 QPI links per CPU? ● $cat /sys/devices/virtual/dmi/id/product_name ProLiant DL980 G7

  16. actual hardware topology? ● Wasn't there only max 4 QPI links per CPU? ● $cat /sys/devices/virtual/dmi/id/product_name ProLiant DL980 G7

  17. actual hardware topology [...] node distances: node 0 1 2 3 4 5 6 7 0: 10 12 17 17 19 19 19 19 1: 12 10 17 17 19 19 19 19 2: 17 17 10 12 19 19 19 19 3: 17 17 12 10 19 19 19 19 4: 19 19 19 19 10 12 17 17 5: 19 19 19 19 12 10 17 17 6: 19 19 19 19 17 17 10 12 7: 19 19 19 19 17 17 12 10

  18. Absolute measurements ● mlc -e

  19. Absolute measurements Raw Bandwidth values (MB/s) Socket 0 1 2 3 4 5 6 7 0 25368,9 10882,8 11203,2 11201,7 11179,1 11175,9 11175,6 11177,8 1 10858,8 25524,8 11184,3 11186,9 11168,0 11183,7 11175,1 11165,0 2 11165,7 11211,5 25605,7 10877,3 11182,6 11173,5 11175,9 11182,9 3 11181,9 11207,4 10876,2 25558,8 11176,5 11167,7 11169,2 11174,5 4 11119,3 11166,1 11165,6 11169,0 25540,0 10862,3 11186,2 11190,0 5 11140,0 11179,1 11182,0 11172,1 10867,8 25553,2 11187,6 11192,8 6 11153,3 11191,1 11193,1 11189,3 11212,0 11208,4 25633,1 10900,8 7 11165,8 11196,0 11195,1 11187,2 11210,4 11210,6 10920,2 25634,7

  20. Absolute measurements Raw Bandwidth values (MB/s) → non-direct connections very similar speeds Socket 0 1 2 3 4 5 6 7 0 25368,9 10882,8 11203,2 11201,7 11179,1 11175,9 11175,6 11177,8 1 10858,8 25524,8 11184,3 11186,9 11168,0 11183,7 11175,1 11165,0 2 11165,7 11211,5 25605,7 10877,3 11182,6 11173,5 11175,9 11182,9 3 11181,9 11207,4 10876,2 25558,8 11176,5 11167,7 11169,2 11174,5 4 11119,3 11166,1 11165,6 11169,0 25540,0 10862,3 11186,2 11190,0 5 11140,0 11179,1 11182,0 11172,1 10867,8 25553,2 11187,6 11192,8 6 11153,3 11191,1 11193,1 11189,3 11212,0 11208,4 25633,1 10900,8 7 11165,8 11196,0 11195,1 11187,2 11210,4 11210,6 10920,2 25634,7

  21. Absolute measurements Idle latency Soc 0 1 2 3 4 5 6 7 0 37.30 49.90 74.70 73.50 84.40 82.60 80.30 82.00 1 49.40 36.30 73.80 76.90 85.00 82.30 84.40 86.10 2 75.00 75.60 35.00 46.40 75.30 75.40 78.10 81.80 3 69.60 67.60 47.30 35.10 83.50 81.70 78.20 81.50 4 77.10 78.60 77.50 78.90 34.80 48.90 70.00 75.30 5 79.80 76.50 79.80 80.90 46.20 35.10 69.20 69.80 6 75.70 74.10 80.00 77.10 67.60 67.80 35.10 46.50 7 83.70 84.00 84.00 82.70 69.90 70.30 47.40 34.90 Normalisiert: SLIT (expected) vs measured 10 10 12 11,1 17 22,7 19 25,5

  22. Absolute measurements Idle latency Soc 0 1 2 3 4 5 6 7 0 37.30 49.90 74.70 73.50 84.40 82.60 80.30 82.00 1 49.40 36.30 73.80 76.90 85.00 82.30 84.40 86.10 2 75.00 75.60 35.00 46.40 75.30 75.40 78.10 81.80 3 69.60 67.60 47.30 35.10 83.50 81.70 78.20 81.50 4 77.10 78.60 77.50 78.90 34.80 48.90 70.00 75.30 5 79.80 76.50 79.80 80.90 46.20 35.10 69.20 69.80 6 75.70 74.10 80.00 77.10 67.60 67.80 35.10 46.50 7 83.70 84.00 84.00 82.70 69.90 70.30 47.40 34.90 SLIT (expected) vs measured (fastest normalized to 10) 10 10 12 11,1 Close...ish ? 17 22,7 19 25,5

  23. NUMA and IO ● not only memory is non-uniform ● IO controllers are connected to only some nodes

  24. NUMA and IO ● PCIe 4.0: 2 GB/s per lane vs QPI: 12,8 GB/s per link ● 40 GbE cards, access to GPU memory utilize these speeds ● example applications: network processing, clusters

  27. Identifying IO nodes ● lspci -tv, then look up in /sys/bus/... ● Why is our machine structured like it is?

  28. future work ● do extended measurements on 8-node machine ● utilize QPI link information for discovery

  29. http://www.acpi.info/DOWNLOADS/ACPIspec40a.pdf ● http://h50146.www5.hp.com/products/software/oe/linux/mainstream/sup ● port/whitepaper/pdfs/c03261871.pdf http://on-demand.gputechconf.com/gtc/2014/presentations/S4589- ● openmpi-rdma-support-cuda.pdf man numa, numactl, lstopo ● http://www.ntop.org/pf_ring/not-all-servers-are-alike-with-pf_ring-zcdna- ● part-3/

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

1 Star topology Bus topology popular through mid 90s Now star topology prevails

1 Star topology Bus topology popular through mid 90s Now star topology prevails

The Data Link Layer Last time Our goals: link layer services understand principles error detection, correction behind data link layer services: multiple access protocols and LANs error detection, correction link layer

876 views • 17 slides
Web Spam Know Your Neighbors: Web Spam Detection using the Web Topology Presenter: Sadia Masood

Web Spam Know Your Neighbors: Web Spam Detection using the Web Topology Presenter: Sadia Masood

Seminar: Future Of Web Search University of Saarland Web Spam Know Your Neighbors: Web Spam Detection using the Web Topology Presenter: Sadia Masood Tutor : Klaus Berberich Date : 17-Jan-2008 The Agenda Focus of the First Paper

1.22k views • 53 slides
WHAT DO WE KNOW ABOUT THE TOPOLOGY? WHAT DO WE KNOW ABOUT THE TOPOLOGY? Number of nodes and

WHAT DO WE KNOW ABOUT THE TOPOLOGY? WHAT DO WE KNOW ABOUT THE TOPOLOGY? Number of nodes and

TxProbe: Discovering Bitcoins Network Topology Using Orphan Transactions Sergi Delgado-Segura , Surya Bakshi, Cristina Prez-Sol, James Litton, Andrew Pachulski, Andrew Miller and Bobby Bhattacharjee sr_gi WHAT DO WE KNOW ABOUT THE TOPOLOGY?

1.84k views • 162 slides
Combinatorics and topology of toric arrangements II. Topology of arrangements in the complex torus

Combinatorics and topology of toric arrangements II. Topology of arrangements in the complex torus

Combinatorics and topology of toric arrangements II. Topology of arrangements in the complex torus (An invitation to combinatorial algebraic topology) Emanuele Delucchi (SNSF / Universit e de Fribourg) Toblach/Dobbiaco February 23, 2017

543 views • 42 slides
Order Topology Definition Let ( X , < ) be an ordered set. Then the order topology on X is the

Order Topology Definition Let ( X , < ) be an ordered set. Then the order topology on X is the

Order Topology Definition Let ( X , < ) be an ordered set. Then the order topology on X is the topology generated by the basis consisting of unions of sets of the form 1 Open intervals of the form ( a , b ) with a < b in X . 2 If X has a

62 views • 3 slides
Topological data analysis and topology-based visualization Leila De Floriani Topology-based

Topological data analysis and topology-based visualization Leila De Floriani Topology-based

Topological data analysis and topology-based visualization Leila De Floriani Topology-based methods v Why topology? topology deals with qualitative geometric information , thus v providing a structural description of data topological

298 views • 10 slides
& OTHER QUESTIONS: EQUAL A COFFEE MUG? WHAT IS TOPOLOGY? SARAH BLACKWELL WHAT IS TOPOLOGY?

& OTHER QUESTIONS: EQUAL A COFFEE MUG? WHAT IS TOPOLOGY? SARAH BLACKWELL WHAT IS TOPOLOGY?

WHY DOES A DONUT & OTHER QUESTIONS: EQUAL A COFFEE MUG? WHAT IS TOPOLOGY? SARAH BLACKWELL WHAT IS TOPOLOGY? WHAT DOES IT MEAN FOR TWO THINGS TO BE THE SAME? 1 = 7 (mod 6) color versus colour congruent or similar triangles

542 views • 30 slides
ALM API for Topology Management ALM API for Topology Management and Network Layer Transparent

ALM API for Topology Management ALM API for Topology Management and Network Layer Transparent

ALM API for Topology Management ALM API for Topology Management and Network Layer Transparent Multimedia Transport <draft lim irtf sam alm api 00.txt > p 71 ST IETF SAM RG MEETING, PHILADELPHIA. Lim Boon Ping

230 views • 19 slides
WHAT DO WE KNOW ABOUT THE TOPOLOGY? WHAT DO WE KNOW ABOUT THE TOPOLOGY? Number of nodes and

WHAT DO WE KNOW ABOUT THE TOPOLOGY? WHAT DO WE KNOW ABOUT THE TOPOLOGY? Number of nodes and

# SFBW19 TxProbe: Discovering Bitcoins Network Topology Using Orphan Transactions Sergi Delgado-Segura , Surya Bakshi, Cristina Prez-Sol, James Litton, Andrew Pachulski, Andrew Miller and Bobby Bhattacharjee sr_gi WHAT DO WE KNOW ABOUT THE

1.96k views • 168 slides
1 Ring Topology Ring Topology In a ring network, every device has exactly two neighbours

1 Ring Topology Ring Topology In a ring network, every device has exactly two neighbours

What is a Topology? Network topologies describe the ways in which the elements of a network are mapped. They describe the physical and logical arrangement of the network nodes. The physical topology of a network refers to the

279 views • 4 slides
Hard Problems in 3-Manifold Topology School on Low-Dimensional Geometry and Topology: Discrete

Hard Problems in 3-Manifold Topology School on Low-Dimensional Geometry and Topology: Discrete

Hard Problems in 3-Manifold Topology School on Low-Dimensional Geometry and Topology: Discrete and Algorithmic Aspects Arnaud de Mesmay 1 Yoav Rieck 2 Eric Sedgwick 3 Martin Tancer 4 1 CNRS, GIPSA-Lab 2 University of Arkansas 3 DePaul

1.37k views • 83 slides
Detection of neutral particles detection of neutrons detection of neutrinons detection of low

Detection of neutral particles detection of neutrons detection of neutrinons detection of low

Detection of neutral particles detection of neutrons detection of neutrinons detection of low energy photons (detection of high energy photons calorimeters) Peter Krizan, Neutron and neutrino detection Detection of neutral particles

1.21k views • 67 slides
On Evolution of On Evolution of C2 Netw ork Topology C2 Netw ork Topology IC ICCR CRTS 2010

On Evolution of On Evolution of C2 Netw ork Topology C2 Netw ork Topology IC ICCR CRTS 2010

On Evolution of On Evolution of C2 Netw ork Topology C2 Netw ork Topology IC ICCR CRTS 2010 TS 2010 Paper 082 National Key Laboratory of Science and Technology on C4ISR Dr. Songhua Huang NRIEE, CETC, China Introduction C2 netw orks

458 views • 16 slides
The Smooth Rectangular Peg Problem Kyle Hayden September 23, 2020 Topology Topology concerns

The Smooth Rectangular Peg Problem Kyle Hayden September 23, 2020 Topology Topology concerns

The Smooth Rectangular Peg Problem Kyle Hayden September 23, 2020 Topology Topology concerns the properties of objects/spaces that are preserved un- der continuous deformations, such as stretching, twisting, crumpling and bending, but not

242 views • 20 slides
Topology API Use Cases

Topology API Use Cases

Topology API Use Cases dra$-amante-i2rs-topology-use-cases-01 Shane Amante Jan Medved, jmedved@cisco.com Stefano Previdi, sprevidi@cisco.com Victor

424 views • 14 slides
Pizzas, Bagels, Pretzels, and Euler's Magical ---- an informal introduction to topology What

Pizzas, Bagels, Pretzels, and Euler's Magical ---- an informal introduction to topology What

Pizzas, Bagels, Pretzels, and Euler's Magical ---- an informal introduction to topology What is topology? Given a set X , a topology on X is a collection T of subsets of X , satisfying the following axioms: 1. The empty set and X are in T . 2.

946 views • 38 slides
Cap6 Snoop-based Multiprocessor Design Design Goals Adaptado dos slides da editora por Mario

Cap6 Snoop-based Multiprocessor Design Design Goals Adaptado dos slides da editora por Mario

Cap6 Snoop-based Multiprocessor Design Design Goals Adaptado dos slides da editora por Mario Crtes IC/Unicamp 2009s2 Performance and cost depend on design and implementation too Goals Correctness High Performance Minimal

733 views • 58 slides
Welcome to CSE 506 Introduc/on & Review Don Porter 1 2 CSE 506: Opera.ng Systems CSE 506:

Welcome to CSE 506 Introduc/on & Review Don Porter 1 2 CSE 506: Opera.ng Systems CSE 506:

3/14/16 CSE 506: Opera.ng Systems CSE 506: Opera.ng Systems Why Grad OS? Primary Goal: Demys/fy how computers work Welcome to CSE 506 Introduc/on & Review Don Porter 1 2 CSE 506: Opera.ng Systems CSE 506: Opera.ng Systems An

355 views • 6 slides
Spiral 2-8 Cell Layout 2-8.2 Learning Outcomes I understand how a digital circuit is

Spiral 2-8 Cell Layout 2-8.2 Learning Outcomes I understand how a digital circuit is

2-8.1 Spiral 2-8 Cell Layout 2-8.2 Learning Outcomes I understand how a digital circuit is composed of layers of materials forming transistors and wires I understand how each layer is expressed as geometric patterns called masks I

532 views • 39 slides
Network Flow-based Bipartitioning Perform flow-based bipartitioning under: Area constraint

Network Flow-based Bipartitioning Perform flow-based bipartitioning under: Area constraint

Network Flow-based Bipartitioning Perform flow-based bipartitioning under: Area constraint [4,5] Source = a , sink = i Break ties alphabetically Practical Problems in VLSI Physical Design FBB Algorithm (1/6) First Max-Flow and Its

87 views • 6 slides
CAN/CANopen Tools, Interfaces and I/O Modules Pierre Baehler CERN/IT-Division December 9, 1998

CAN/CANopen Tools, Interfaces and I/O Modules Pierre Baehler CERN/IT-Division December 9, 1998

CAN/CANopen Tools, Interfaces and I/O Modules Pierre Baehler CERN/IT-Division December 9, 1998 CAN/CANopen Tools CAN/CANopen analyzer CANalyzer CANopen from Vector (Softing), (stzp) CANopen Electronic Data Sheet editor

239 views • 7 slides
Long term test of LED Long term test of LED pulsing pulsing Long time LED system stability

Long term test of LED Long term test of LED pulsing pulsing Long time LED system stability

Long term test of LED Long term test of LED pulsing pulsing Long time LED system stability measurement Aging of part of optical system Future plans Jaroslav Zalesak, Jan Smolik Institute of Physics ASCR, Prague Sep 13, 2007 CALICE

298 views • 11 slides
A Virtualized Separation Kernel for Mixed Criticality Systems Ye Li, Richard West and Eric

A Virtualized Separation Kernel for Mixed Criticality Systems Ye Li, Richard West and Eric

Introduction Architecture Performance Conclusions Ongoing and Future Work A Virtualized Separation Kernel for Mixed Criticality Systems Ye Li, Richard West and Eric Missimer Boston University March 2nd, 2014 Introduction Architecture

449 views • 21 slides
The Development Of DAQ System For J-PARC K O TO Experiment Yasuyuki Sugiyama D1@Yamanaka Taku

The Development Of DAQ System For J-PARC K O TO Experiment Yasuyuki Sugiyama D1@Yamanaka Taku

The Development Of DAQ System For J-PARC K O TO Experiment Yasuyuki Sugiyama D1@Yamanaka Taku Lab. Year End report meeting 2010/12/19(Mon) 1 2011 12 19 1 Contents KOTO Experiment Trigger/Data Acquisition(DAQ)

735 views • 32 slides

More recommend