An OpenAFS Site Report Code Name Sunrise Ralf Brunckhorst Michael - - PowerPoint PPT Presentation

an openafs site report
SMART_READER_LITE
LIVE PREVIEW

An OpenAFS Site Report Code Name Sunrise Ralf Brunckhorst Michael - - PowerPoint PPT Presentation

An OpenAFS Site Report Code Name Sunrise Ralf Brunckhorst Michael Meffie (SNA) June 19, 2019 An OpenAFS Site Report 1 of 21 History of AFS at Sunrise 1999 AFS was introduced at one site in Sweden. 2000s More sites were added. 2006 AFS


slide-1
SLIDE 1

An OpenAFS Site Report

Code Name Sunrise Ralf Brunckhorst Michael Meffie (SNA) June 19, 2019

An OpenAFS Site Report 1 of 21

slide-2
SLIDE 2

History of AFS at Sunrise

1999 AFS was introduced at one site in Sweden. 2000s More sites were added. 2006 AFS read-only sites limit reached. Four subcells were created. 2015 CellCC deployed to support multi-cell sync. 2019 DPF deployed for volume releases over WAN.

An OpenAFS Site Report 2 of 21

slide-3
SLIDE 3

Business View of the AFS Service

  • Series of Linux/Unix based services which are vital to

development and test at several sites on three continents.

  • These services include Linux and Unix managed workplaces,

Terminal Servers, Global Application delivery and other services which are dependent on AFS.

  • The AFS file system provides a transparent mechanism to

supply the application tree, environment files, Application Release Center (ARC) project environments and toolboxes to Linux/Unix services such as managed workplaces around the world. Many people are not aware of the AFS service since it is transparent.

An OpenAFS Site Report 3 of 21

slide-4
SLIDE 4

Managed Workplaces

Two major areas of AFS seen from Managed Workplace clients at Sunrise.

  • Applications
  • Environment

An OpenAFS Site Report 4 of 21

slide-5
SLIDE 5

Application Release Center (ARC)

The Application Release Center (ARC) is a project to get a common, highly flexible and configurable UNIX environment.

An OpenAFS Site Report 5 of 21

slide-6
SLIDE 6

Applications namespace

Application distribution for Solaris, RedHat, SuSE, Ubuntu. Application symlink to AFS: /app -> /afs/${cell}/app/

An OpenAFS Site Report 6 of 21

slide-7
SLIDE 7

Environment namespace

The Environment namespace contains several important types of files used by Sunrise:

  • Site files
  • Licences
  • Application Release Center (ARC) files

Environment symlink to AFS: /env -> /afs/${CELL}/env/

An OpenAFS Site Report 7 of 21

slide-8
SLIDE 8

CellCC

Scaling issues:

  • Still one Cell with only 3 AFSDB-servers worldwide
  • Change of mount points required in TAG-volumes (via

dumpscan)

  • Double storage capacity needed on TAG RW-servers

SNA was engaged in 2015 to create a product to support multi-sync for different Cells. CellCC is now used to sync a single source-cell to four other cells

  • n three continents.

An OpenAFS Site Report 8 of 21

slide-9
SLIDE 9

DPF

At Sunrise we have seen performance problems with AFS releases (UDP-based) when it comes to WAN traffic. Therefore we have implement a new mechanism developed by SNA: DPF for releases (TCP-based) This is now active since several months as default for releases. Improvement factor: 5 - 15 times faster depending on network topology

An OpenAFS Site Report 9 of 21

slide-10
SLIDE 10

Statistics

  • 5 active AFS cells
  • 1 source cell
  • 4 target cells
  • 33 AFS servers

An OpenAFS Site Report 10 of 21

slide-11
SLIDE 11

Servers

OpenAFS fileservers. Model Number ProLiant DL360 Gen9 12 ProLiant DL360p Gen8 6 Database servers are deployed on virtual machines. Model Number XEN 1 VMware Virtual Platform 14

An OpenAFS Site Report 11 of 21

slide-12
SLIDE 12

AFS-server OS usage overview

Vendor Version ARCH Number RedHat 6 x86_64 2 RedHat 7 x86_64 31

An OpenAFS Site Report 12 of 21

slide-13
SLIDE 13

AFS Clients

Cell Number sero.gic 13070 seli.gic 9997 cn.ao 384 mo.ca.am 178 23629

An OpenAFS Site Report 13 of 21

slide-14
SLIDE 14

Clients by OS

Number of scanned systems grouped by OS: Name Number RedHat 15596 SLE 7811 Ubuntu 654 Solaris 319

  • penSuse

7 Debian 1

An OpenAFS Site Report 14 of 21

slide-15
SLIDE 15

Client arch

OSS Ver Arch Number RedHat 6 x86_64 7952 RedHat 7 x86_64 7559 SLE 11 x86_64 4725 SLE 12 x86_64 2961 Ubuntu 16 x86_64 553 Solaris 10 sparcv9 266 Ubuntu 18 x86_64 78 SLE 11 i686 67 RedHat 5 x86_64 62 Solaris 11 sparcv9 42 SLE 10 x86_64 29 SLE 10 i686 29

An OpenAFS Site Report 15 of 21

slide-16
SLIDE 16

Client arch

OSS Ver Arch Number Ubuntu 14 x86_64 22 RedHat 5 i686 17

  • penSuse

11 i686 7 RedHat 6 i686 4 Solaris 10 amd64 4 Solaris 11 amd64 3 Solaris 9 sparcv9 2 Solaris 8 sparcv9 2 RedHat 4 i686 1 Ubuntu 12 x86_64 1 RedHat 4 x86_64 1 Debian x86_64 1

An OpenAFS Site Report 16 of 21

slide-17
SLIDE 17

AFS 1.6 Clients

AFS Vers Number OpenAFS 1.6.21 12252 OpenAFS 1.6.22 4450 OpenAFS 1.6.20 3118 OpenAFS 1.6.23 1975 OpenAFS 1.6.9 957 OpenAFS 1.6.10 322 OpenAFS 1.6.5 210 OpenAFS 1.6.x 872 OpenAFS 1.4.x 112

An OpenAFS Site Report 17 of 21

slide-18
SLIDE 18

AFS 1.8 Clients

Migration to 1.8.x underway. AFS Vers Number OpenAFS 1.8.2 46 OpenAFS 1.8.0pre5 34 OpenAFS 1.8.3 4 OpenAFS 1.8.3pre1 1

An OpenAFS Site Report 18 of 21

slide-19
SLIDE 19

Disk cache vs Mem cache

Cache Number of clients disk 24262 memory 89

An OpenAFS Site Report 19 of 21

slide-20
SLIDE 20

Volume releases

1500 2000 2500 3000 3500 4000 4500 5000 5500 10/01/16 01/01/17 04/01/17 07/01/17 10/01/17 01/01/18 04/01/18 07/01/18 10/01/18 01/01/19 04/01/19 200 400 600 800 1000 1200 1400 1600 1800 GB # of Releases CellCC

Figure 1: monthly-releases

An OpenAFS Site Report 20 of 21

slide-21
SLIDE 21

Thank you

Questions?

An OpenAFS Site Report 21 of 21