Summary of NIIF/HUNGARNET current storage developments 10 September - - PowerPoint PPT Presentation

▶
summary of niif hungarnet current storage developments
SMART_READER_LITE
LIVE PREVIEW

Summary of NIIF/HUNGARNET current storage developments 10 September - - PowerPoint PPT Presentation

Apr 25, 2023 189 likes •303 views

Summary of NIIF/HUNGARNET current storage developments 10 September 2010 SZKELYI Szabolcs 7 th TF-Storage Meeting NIIF Institute Pozna, Poland <szekelyi@niif.hu> Intro Nemzeti Informcis Infrastruktra Fejlesztsi Intzet

slide-1
SLIDE 1

SZÉKELYI Szabolcs NIIF Institute <szekelyi@niif.hu> 10 September 2010 7th TF-Storage Meeting Poznań, Poland

Summary of NIIF/HUNGARNET current storage developments

slide-2
SLIDE 2

Nemzeti Információs Infrastruktúra Fejlesztési Intézet

Page 2

NIIFI storage development status

Intro

  • Who we are
  • Hungarian NREN provider
  • What we do
  • Providing IPv4 and IPv6 transport services (HBONE) to

 academic institutions  research community  public collections, libraries

  • And services on top of it

 web  e-mail  videoconferencing  VoIP  supercomputing  grid

slide-3
SLIDE 3

Nemzeti Információs Infrastruktúra Fejlesztési Intézet

Page 3

NIIFI storage development status

Ongoing projects: HBONE+, TÁMOP

  • Established national funding to reengineer the current

infrastructure

  • Total financial range: €15M, €5M on distributed

computing and data storage

  • Infrastructure development
  • New 10GbE network
  • Service development
  • Videoconferencing
  • Trust Federations (AAI)
  • National storage network
  • IaaS cloud
  • http://www.hboneplus.hu/
slide-4
SLIDE 4

Nemzeti Információs Infrastruktúra Fejlesztési Intézet

Page 4

NIIFI storage development status

National storage network

  • HBONE-integrated
  • Installed raw capacity: 500 TB
  • 3 sites

 Dunaújváros: 240 TB; Sopron: 240 TB; Budapest: 20 TB

  • Planned total raw capacity: ~1.2 PB
  • iSCSI based
  • Low-level “block device” service
  • Self-service management
  • Higher level services
  • World-wide backup (“cloud” backup)
  • Backend storage for IaaS cloud
  • etc.
slide-5
SLIDE 5

Nemzeti Információs Infrastruktúra Fejlesztési Intézet

Page 5

NIIFI storage development status

Hardware

  • Fujitsu-Siemens Eternus DX80
  • Released June 8, 2009
  • Specific cost: €400 per TB
  • 4 x 1 GbE ports per storage system

 110 MBps per port read-write

performance

  • 120 x 1 TB disks per storage system
  • Energy saving

 Unused disks can turn off automatically

  • Redundant controllers
  • iSCSI interface

 no need for gateway

  • management through SSH
slide-6
SLIDE 6

Nemzeti Információs Infrastruktúra Fejlesztési Intézet

Page 6

NIIFI storage development status

Self-service management

  • Work in progress, release expected in spring 2011
  • Web based
  • API & GUI
  • Implemented in Python/Django
  • Functions:
  • RAID array management
  • Volume management
  • iSCSI target management
slide-7
SLIDE 7

Nemzeti Információs Infrastruktúra Fejlesztési Intézet

Page 7

NIIFI storage development status

Current possibilities and challenges

  • DIY – JBOD & frontend
  • Flexible :-)
  • Lack of human resources :-(
  • Performance and economic penalty :-(
  • More error-prone (?)
  • Buy more “enterprise-class” storage
  • Lack of features :-(

 Programmable management interface  Multiple (hundreds of) targets per IP address

  • Artificial limitations

 Number of connected hosts (“up to 64”?!?!), RAID arrays,

Volumes, etc.

  • Works out of the box :-)
slide-8
SLIDE 8

Nemzeti Információs Infrastruktúra Fejlesztési Intézet

Page 8

NIIFI storage development status

IaaS cloud

  • Work in progress, beta release in October 2010
  • Semi-public
  • Public for our users and member institutions
  • Each virtual disk is backed by a dedicated iSCSI target
  • Managed automatically using the API just mentioned...
  • Using KVM as virtualization technology
  • Using OpenNebula as cloud management system
  • System-level redundancy
  • Initial configuration:
  • ~60 nodes, 4 CPU cores and 12 GB RAM each
  • distributed to ~8 sites
  • Debian based, diskless, R/O NFS root
  • Supercool features, including...
slide-9
SLIDE 9

Nemzeti Információs Infrastruktúra Fejlesztési Intézet

Page 9

NIIFI storage development status

IaaS cloud features

  • 100% realistic virtual networks
  • Self-service management
  • L2 connectivity of virtual machines
  • Secure (L2) separation of virtual networks
  • Live migration of virtual machines between sites
  • Including virtual disks, networks, etc.
  • Thanks to iSCSI based virtual disks
  • QoS
  • Guaranteed minimum CPU performance for virtual

machines

  • Virtual machine systems
  • One-click deployment of grids, clusters, etc.
slide-10
SLIDE 10

SZÉKELYI Szabolcs NIIF Institute <szekelyi@niif.hu>

Thanks for your attention! Questions?