An OpenAFS Site Report Code Name Sunrise Ralf Brunckhorst Michael - PowerPoint PPT Presentation

An OpenAFS Site Report Code Name Sunrise Ralf Brunckhorst Michael Meffie (SNA) June 19, 2019 An OpenAFS Site Report 1 of 21

History of AFS at Sunrise 1999 AFS was introduced at one site in Sweden. 2000s More sites were added. 2006 AFS read-only sites limit reached. Four subcells were created. 2015 CellCC deployed to support multi-cell sync. 2019 DPF deployed for volume releases over WAN. An OpenAFS Site Report 2 of 21

Business View of the AFS Service • Series of Linux/Unix based services which are vital to development and test at several sites on three continents. • These services include Linux and Unix managed workplaces, Terminal Servers, Global Application delivery and other services which are dependent on AFS. • The AFS file system provides a transparent mechanism to supply the application tree, environment files, Application Release Center (ARC) project environments and toolboxes to Linux/Unix services such as managed workplaces around the world. Many people are not aware of the AFS service since it is transparent. An OpenAFS Site Report 3 of 21

Managed Workplaces Two major areas of AFS seen from Managed Workplace clients at Sunrise. • Applications • Environment An OpenAFS Site Report 4 of 21

Application Release Center (ARC) The Application Release Center (ARC) is a project to get a common, highly flexible and configurable UNIX environment. An OpenAFS Site Report 5 of 21

Applications namespace Application distribution for Solaris, RedHat, SuSE, Ubuntu. Application symlink to AFS: /app -> /afs/${cell}/app/ An OpenAFS Site Report 6 of 21

Environment namespace The Environment namespace contains several important types of files used by Sunrise: • Site files • Licences • Application Release Center (ARC) files Environment symlink to AFS: /env -> /afs/${CELL}/env/ An OpenAFS Site Report 7 of 21

CellCC Scaling issues: • Still one Cell with only 3 AFSDB-servers worldwide • Change of mount points required in TAG-volumes (via dumpscan) • Double storage capacity needed on TAG RW-servers SNA was engaged in 2015 to create a product to support multi-sync for different Cells. CellCC is now used to sync a single source-cell to four other cells on three continents. An OpenAFS Site Report 8 of 21

DPF At Sunrise we have seen performance problems with AFS releases (UDP-based) when it comes to WAN traffic. Therefore we have implement a new mechanism developed by SNA: DPF for releases (TCP-based) This is now active since several months as default for releases. Improvement factor: 5 - 15 times faster depending on network topology An OpenAFS Site Report 9 of 21

Statistics • 5 active AFS cells • 1 source cell • 4 target cells • 33 AFS servers An OpenAFS Site Report 10 of 21

Servers OpenAFS fileservers. Model Number ProLiant DL360 Gen9 12 ProLiant DL360p Gen8 6 Database servers are deployed on virtual machines. Model Number XEN 1 VMware Virtual Platform 14 An OpenAFS Site Report 11 of 21

AFS-server OS usage overview Vendor Version ARCH Number RedHat 6 x86_64 2 RedHat 7 31 x86_64 An OpenAFS Site Report 12 of 21

AFS Clients Cell Number sero.gic 13070 seli.gic 9997 cn.ao 384 mo.ca.am 178 23629 An OpenAFS Site Report 13 of 21

Clients by OS Number of scanned systems grouped by OS: Name Number RedHat 15596 SLE 7811 Ubuntu 654 Solaris 319 openSuse 7 Debian 1 An OpenAFS Site Report 14 of 21

Client arch OSS Ver Arch Number RedHat 6 x86_64 7952 RedHat 7 7559 x86_64 SLE 11 x86_64 4725 SLE 12 2961 x86_64 Ubuntu 16 553 x86_64 Solaris 10 sparcv9 266 Ubuntu 18 78 x86_64 SLE 11 i686 67 RedHat 5 62 x86_64 Solaris 11 sparcv9 42 SLE 10 29 x86_64 SLE 10 i686 29 An OpenAFS Site Report 15 of 21

Client arch OSS Ver Arch Number Ubuntu 14 x86_64 22 RedHat 5 17 i686 openSuse 11 i686 7 RedHat 6 4 i686 Solaris 10 4 amd64 Solaris 11 amd64 3 Solaris 9 2 sparcv9 Solaris 8 sparcv9 2 RedHat 4 1 i686 Ubuntu 12 x86_64 1 RedHat 4 1 x86_64 Debian 0 x86_64 1 An OpenAFS Site Report 16 of 21

AFS 1.6 Clients AFS Vers Number OpenAFS 1.6.21 12252 OpenAFS 1.6.22 4450 OpenAFS 1.6.20 3118 OpenAFS 1.6.23 1975 OpenAFS 1.6.9 957 OpenAFS 1.6.10 322 OpenAFS 1.6.5 210 OpenAFS 1.6.x 872 OpenAFS 1.4.x 112 An OpenAFS Site Report 17 of 21

AFS 1.8 Clients Migration to 1.8.x underway. AFS Vers Number OpenAFS 1.8.2 46 OpenAFS 1.8.0pre5 34 OpenAFS 1.8.3 4 OpenAFS 1.8.3pre1 1 An OpenAFS Site Report 18 of 21

Disk cache vs Mem cache Cache Number of clients disk 24262 memory 89 An OpenAFS Site Report 19 of 21

Volume releases 5500 1800 # of Releases CellCC 1600 5000 1400 4500 1200 4000 1000 3500 GB 800 3000 600 2500 400 2000 200 1500 0 10/01/16 01/01/17 04/01/17 07/01/17 10/01/17 01/01/18 04/01/18 07/01/18 10/01/18 01/01/19 04/01/19 Figure 1: monthly-releases An OpenAFS Site Report 20 of 21

Thank you Questions? An OpenAFS Site Report 21 of 21