sys.backup b k Centralized Open Source backup solution for CARNet - - PowerPoint PPT Presentation

b k sys.backup

Centralized Open Source backup solution for CARNet members solution for CARNet members

Branko Radojević, M.Sc.

Deputy Director

June 2011.

(v 1.00)

Just a few introductory words Just a few introductory words …

40 years around 10100 years around University computing center Croatian NREN University level services National-level services + some national services Universities + Schools GRID NO GRID FileSender NO FileSender

Inspired Inspired

• Some of the basic concepts and ideas were picked

Some of the basic concepts and ideas were picked up from our recent major involvement in TF- STORAGE

h k Thanks!

CARNet – Who we are & what we do? CARNet – Who we are & what we do?

• Public Institution funded from National Budget
• NREN – National Research and Education Network
• 95 full time + 50 part-time employees
• Over 19 years ISP for Educational Institutions in Croatia

(schools, universities, research institutes, ministry, agencies, public hospitals etc ) 3000 locations in Croatia public hospitals, etc.) – 3000 locations in Croatia

• Over 100 different services for educational community in Croatia

(Authorization services, LMS, CMS for schools, Videoconferencing, VoIP, virtual f f servers for faculties, e-learning academy, Cisco Networking Academy, etc.)

• Registry for .hr ccTLD – only service with broader audience

It all started in 1992 It all started in 1992…

1992

First link to Internet No WEB No WEB Few e-mails Small amount of not so important data Lack of knowledge about the Internet in

• ur Institutions

then in 1994/1995 … then in 1994/1995 …

1992 1994

First link to Internet No WEB CARNet decided to push Institutions to No WEB Few e-mails Small amount of not became virtually present CARNet starts to buy so important data Lack of knowledge about the Internet in and support UNIX servers located on Institutions premises

• ur Institutions

DECStation 5000/25 running ULTRIX

and finally around 1997 .. and finally around 1997 …

1992 1994 1997

First link to Internet No WEB CARNet decided to push Institutions to Amount and importance of data No WEB Few e-mails Small amount of not became virtually present CARNet starts to buy stored on server becomes respectable. CARNet starts to buy so important data Lack of knowledge about the Internet in and support UNIX servers located on Institutions premises and support UNIX servers with tape backup drives

• ur Institutions

CARNet starts to develop its own Linux distro based on Debian

CARNet server from around 1997 CARNet server from around 1997

CARNet servers today CARNet servers today

• Standard Intel x86 platform

Standard Intel x86 platform ( HP ML 370 and Fujitsu-Siemens TX300)

• Included LTO2 drive with the server
• Included LTO2 drive with the server
• Running CARNets version of Debian Linux
• r
• Institions run same on their own hardware

Institions run same on their own hardware

The Problem The Problem

• Servers came with Tape Drives but w/o tapes 

Servers came with Tape Drives but w/o tapes 

• Tape drives can make up to 50% of server’s purchase

price price

• In majority of cases were never or rarely used
• If used, often tapes were kept at same physical

location with servers

• Unwillingness to (manually) change tapes on daily

basis by the local administrators y

The Solution The Solution

• One to fix’em all 
• Centralized backup system for members over its

existing connection to CARNet network existing connection to CARNet network

• Easy to setup – single step for user to request and

establish the service establish the service

• Secure – data encrypted on client’s side and visible

l b th

• nly by the user

The Solution (cont’d) The Solution (cont d)

• Redundant – all data are stored on CARNet’s enterprise type

storage system in two steps and on two different devices (storage + tape library) – geographical redundancy Ch f i ti i f t t d

• Cheap – use of existing infrastructure, resources and open

source software

Hardware & Software Hardware & Software

• Hardware – multi tiered enterprise level backup

Hardware multi tiered enterprise level backup

• system. Tape library and Storage array kept on

same physical locations – can change same physical locations can change

• Software – sys.backup as a service is based on

B l t f O S t i d Bacula, a set of Open Source, enterprise ready, computer programs.

sys backup user perspective sys.backup ‐ user perspective

• To request the service: apt-get install bacula-cn

To request the service: apt get install bacula cn

• Within 24 hrs email is received with confirmation

that full backup is successfully completed i e service that full backup is successfully completed i.e. service was successfully established S t th h CARN t h l f b

• Support through CARNet sys.help for member

sysadmins

• Use existing sysadmin web portal for how-to’s on

selective recovery as well as recommended bare- metal recovery metal recovery

sys backup – our perspective sys.backup – our perspective

• Ticket is being opened by email from user after

Ticket is being opened by email from user after bacula-cn install

• Ticket contains all necessary info to add new
• Ticket contains all necessary info to add new

user/client to bacula director/server (currently manually updated) y p )

• Full backup for new client is scheduled in late night

hours hours

• Following day and if all goes well user is notified and

ticket is closed ticket is closed

Current limitations and issues Current limitations and issues

• only for full MI’s
• nly for full MIs
• bacula-cn runs only on cn-debian GNU/Linux distro
• not available for Windows (for now)
• “only” 100GB per user

y p

• can overwhelm the network for longer periods of

time if run over slower link – a challenge for NOC time if run over slower link a challenge for NOC department 

Thank You Thank You

Questions?