Development of a hardware-abstraction layer for the Baltikum test - - PowerPoint PPT Presentation
Chair of Network Architectures and Services Department of Informatics Technical University of Munich Development of a hardware-abstraction layer for the Baltikum test framework IDP final talk Tobias Betz December 12, 2016 Chair of Network
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
IDP final talk Tobias Betz
December 12, 2016 Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Baltikum framework Design goals Experiment workflow REST API Baltinet library Case study Conclusion Bibliography
– Baltikum framework 2
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
aging the Baltikum testbed.
– Baltikum framework 3
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Main goal: reproducible automated network experiments with hardware- independent framework
– Baltikum framework 4
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Every node provides three functions: start(), command(), and stop()
Listing 1: Old implementation
1 function node.start() { 2
iPXE configuration
3
IPMI command
4
...
5 } 6
Listing 2: New implementation
1 function node.start() { 2
switch(node.boot_module)
3
case IPMI:
4
IPMI.send_command(...)
5 6
case Wake -on-LAN:
7
WoL.send_magic_packet(...)
8 9
case always -on:
10
nop
11 } 12
Same for command() and stop()
– Baltikum framework 5
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
MGMT Node1 Node2 Deploy/start rolescript
Figure 1: Old workflow
– Baltikum framework 6
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
MGMT Node1 Node2 Deploy config Foreground command Background command Node3 Queued command Queued command Queued command
Figure 2: New workflow with command types
– Baltikum framework 7
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
– Baltikum framework 8
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Modular low-level interface Interactive control Modular low-level interface
– Baltikum framework 8
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
http://.../allocation http://.../cmd http://.../allocation
– Baltikum framework 9
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Allocation status of the nodes
1 { 2
"id": "pc3.r",
3
"user": "betz",
4
"status": "allocated",
5
"test_id": "MyExperiment",
6
"force_reboot": true
7 }
– Baltikum framework 10
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Users can send commands for the nodes to execute
1 { 2
"node": "pc3.r",
3
"user": "betz",
4
"payload": "whoami; echo foo = $foo",
5
"background": false ,
6
"queued": false
7 }
Example response
1 { 2
"message": "root\nfoo = bar\n",
3 }
– Baltikum framework 11
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Static information about testbed hardware
1 { 2
"id": "pc3.r",
3
"type": "host",
4
"description": "Intel(R) Xeon(R) CPU E3 -1265L V2 @ 2.50GHz , 4 cores",
5
"interfaces": [
6
{
7
"description": "Intel 82580 Gigabit Network Connection",
8
"id": "eth0",
9
"phys -address": "90:e2:ba:2a:91:fc",
10
"speed": "1Gb"
11
},
12
...
13
],
14
"management": {
15
"address": "pc3.r",
16
"configuration": "ssh -jumper -ilab",
17
"initialize": "wake -on-lan -ilab",
18
"phys -address": "bc:5f:f4:4a:49:59"
19
},
20
"config": {}
21 }
– Baltikum framework 12
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
– Baltikum framework 13
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Baltinet MGMT Host1 User Baltinet.start() PATCH /allocation IPMI Host1.cmd() POST /cmd SSH
– Baltikum framework 14
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
sis)
– Baltikum framework 15
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Isle S ilab-control Server central switch Isle A Isle B Isle C Isle D Isle R Isle F Isle E network equipment for users KVM switch pc2 pc3 isle switch pc1 KVM switch pc5 pc6 pc4
Figure 3: The iLab testbed [1]
– Baltikum framework 16
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
kaunas Eve REST API MongoDB pcX.Y ilab-control SSH proxy Power management script iPXE DNS DHCP S S H W
SSH SSH HTTP Experimenter's computer Baltinet script HTTP Baltinet library
Figure 4: Baltikum framework controlling the iLab testbed
– Baltikum framework 17
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Listing 3: Example Baltinet script
1 import baltinet 2 3 topo = baltinet.Topo(...) 4 bn = baltinet.Baltinet(topo=topo , exp_id='MyExperiment ') 5 bn.start()
# 1./2. Allocate/Configure resources (/ allocation)
6 7 bn['pc3.r'].cmd('./ install.sh')
# 3. Testing process (/cmd)
8 9 for host in bn.hosts: 10
host.cmd('./run.sh > /tmp/output ') # 3. Testing process (/cmd)
11 12 for host in bn.hosts: 13
# upload results
14
host.cmd('testbed -upload /tmp/output ') # 3. Testing process (/cmd)
15 16 bn.stop()
# 4. Free resources (/ allocation)
– Baltikum framework 18
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Experiment successfully ran on 11 iLab hosts (2 isles)
Listing 4: SMC Experiment results
1 num ,time ,nodeid ,result ,testid 2 11,764,1,132, parameters_11_8_1600_20 3 11,764,2,132, parameters_11_8_1600_20 4 11,765,3,132, parameters_11_8_1600_20 5 11,765,4,132, parameters_11_8_1600_20 6 11,766,5,132, parameters_11_8_1600_20 7 11,756,6,132, parameters_11_8_1600_20 8 11,765,7,132, parameters_11_8_1600_20 9 11,764,8,132, parameters_11_8_1600_20 10 11,764,9,132, parameters_11_8_1600_20 11 11,763,10,132, parameters_11_8_1600_20 12 11,764,11,132, parameters_11_8_1600_20
– Baltikum framework 19
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
⇒ Optional reboot of hosts, check allocation status, ...
point ⇒ No more static role scripts
⇒ Easier to refactor and expand
– Baltikum framework 20
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
– Baltikum framework 21
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
[1] M. Teich, L. Schwaighofer, and B. Hof. ilabos Overview. https://ilab.net.in.tum.de/ilabos/pages/overview.html.
– Baltikum framework 22
Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Dynamic status of the nodes
1 { 2
"id": "pc3.r",
3
"user": "betz",
4
"os": "rebooting",
5
"power": "on",
6
"testbed": "not_deployed"
7 }
– Baltikum framework 23