sys.backup b k Centralized Open Source backup solution for CARNet - PowerPoint PPT Presentation

sys.backup b k Centralized Open Source backup solution for CARNet members solution for CARNet members Branko Radojevi ć , M.Sc. Deputy Director June 2011. (v 1.00)

Just a few introductory words Just a few introductory words … 40 years around 10100 years around University computing center Croatian NREN University level services National-level services + some national services Universities + Schools GRID NO GRID FileSender NO FileSender

Inspired Inspired • Some of the basic concepts and ideas were picked Some of the basic concepts and ideas were picked up from our recent major involvement in TF- STORAGE Thanks! h k

CARNet – Who we are & what we do? CARNet – Who we are & what we do? • Public Institution funded from National Budget • NREN – National Research and Education Network • 95 full time + 50 part-time employees • Over 19 years ISP for Educational Institutions in Croatia (schools, universities, research institutes, ministry, agencies, public hospitals, etc.) – 3000 locations in Croatia public hospitals etc ) 3000 locations in Croatia • Over 100 different services for educational community in Croatia (Authorization services, LMS, CMS for schools, Videoconferencing, VoIP, virtual servers for faculties, e-learning academy, Cisco Networking Academy, etc.) f f • Registry for .hr ccTLD – only service with broader audience

It all started in 1992 It all started in 1992… 1992 First link to Internet No WEB No WEB Few e-mails Small amount of not so important data Lack of knowledge about the Internet in our Institutions

… then in 1994/1995 … then in 1994/1995 1992 1994 First link to Internet CARNet decided to push Institutions to No WEB No WEB became virtually present Few e-mails CARNet starts to buy Small amount of not and support UNIX so important data servers located on Lack of knowledge Institutions premises about the Internet in our Institutions DECStation 5000/25 running ULTRIX

.. and finally around 1997 … and finally around 1997 1992 1994 1997 First link to Internet CARNet decided to Amount and push Institutions to importance of data No WEB No WEB became virtually stored on server present becomes respectable. Few e-mails CARNet starts to buy CARNet starts to buy Small amount of not and support UNIX and support UNIX so important data servers located on servers with tape Lack of knowledge Institutions premises backup drives about the Internet in CARNet starts to our Institutions develop its own Linux distro based on Debian

CARNet server from around 1997 CARNet server from around 1997

CARNet servers today CARNet servers today • Standard Intel x86 platform Standard Intel x86 platform ( HP ML 370 and Fujitsu-Siemens TX300) • Included LTO2 drive with the server • Included LTO2 drive with the server • Running CARNets version of Debian Linux or • Institions run same on their own hardware Institions run same on their own hardware

The Problem The Problem • Servers came with Tape Drives but w/o tapes  Servers came with Tape Drives but w/o tapes  • Tape drives can make up to 50% of server’s purchase price price • In majority of cases were never or rarely used • If used, often tapes were kept at same physical location with servers • Unwillingness to (manually) change tapes on daily basis by the local administrators y

The Solution The Solution One to fix’em all  • Centralized backup system for members over its • existing connection to CARNet network existing connection to CARNet network Easy to setup – single step for user to request and • establish the service establish the service Secure – data encrypted on client’s side and visible • only by the user l b th

The Solution (cont’d) The Solution (cont d) Redundant – all data are stored on CARNet’s enterprise type • storage system in two steps and on two different devices (storage + tape library) – geographical redundancy Ch Cheap – use of existing infrastructure, resources and open f i ti i f t t d • source software

Hardware & Software Hardware & Software • Hardware – multi tiered enterprise level backup Hardware multi tiered enterprise level backup system. Tape library and Storage array kept on same physical locations – can change same physical locations can change • Software – sys.backup as a service is based on Bacula, a set of Open Source, enterprise ready, B l t f O S t i d computer programs.

sys backup user perspective sys.backup ‐ user perspective • To request the service: apt-get install bacula-cn To request the service: apt get install bacula cn • Within 24 hrs email is received with confirmation that full backup is successfully completed i e service that full backup is successfully completed i.e. service was successfully established • Support through CARNet sys.help for member S t th h CARN t h l f b sysadmins • Use existing sysadmin web portal for how-to’s on selective recovery as well as recommended bare- metal recovery metal recovery

sys backup – our perspective sys.backup – our perspective • Ticket is being opened by email from user after Ticket is being opened by email from user after bacula-cn install • Ticket contains all necessary info to add new • Ticket contains all necessary info to add new user/client to bacula director/server (currently manually updated) y p ) • Full backup for new client is scheduled in late night hours hours • Following day and if all goes well user is notified and ticket is closed ticket is closed

Current limitations and issues Current limitations and issues • only for full MI’s only for full MIs • bacula-cn runs only on cn-debian GNU/Linux distro • not available for Windows (for now) • “only” 100GB per user y p • can overwhelm the network for longer periods of time if run over slower link – a challenge for NOC time if run over slower link a challenge for NOC department 

Thank You Thank You Questions?