Bal4c Cloud AakeEdlund ,PhD KTHandSNIC,Sweden - PowerPoint PPT Presentation

Bal4c

 Cloud
 Aake
Edlund ,
PhD
 KTH
and
SNIC,
Sweden
 Northern
Europe
Cloud 
(Project
Manager) NEW
 Bal4cGrid 
(Project
Director)
 Bal4cGrid
Innova4on
Lab 
and
 Bal4cCloud 
(Ini<ator,
Manager)
 4th
Terena
TF
Storage
Mee<ng,
 1
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Bal4cGrid 
 ‐
the
 Founda4on 
 – Started
1 st
 of
May,
2008,
dura<on
‐
2
years
 – Con<nues
the
Bal<cGrid
project
(2005‐2008)
 – 13
partners
from
Bal<c
States,
Belarus,
Poland,
Sweden,
Switzerland
 – Financing
–
3
MEUR
 – Collabora<ng
project
for
EGEE
 – Suppor<ng
NGIs
and
their
collabora<on
 Normalized
compu<ng
hours
for
the
 Bal<cGrid
project
and
that
of
the

 first
six
months
of
Bal<cGrid‐II

 2
 4th
Terena
TF
Storage
Mee<ng,
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Mo4va4on 
 for 
 Bal4cCloud 
 Startup
and
prototyping
focus
 When
we
started,
cloud
was
considered
immature,
 and
only
for
startups
and
possibly
prototyping.

 This
suited
us
well,
knowing
that
we
had
not
been
 very
successful
in
a\rac<ng
bigger
companies.
 4th
Terena
TF
Storage
Mee<ng,
 3
 Copenhagen,
2009.Sept.15,
Bal<cCloud


The
Vision
 bgin.wordpress.com A
new
way
to
aGract
startups
 Ini<ated
in
January
20,
2009
 • A
program
for
early
stage
companies
in
our
region,

 • by
invi<ng
them
to
a
hands‐on
course
in
grid
and
cloud
compu<ng.

 • – A
course
prepared
and
run
by
us,
 on
our
resources
 as
well
as
on
donated
dito
 from
e.g.
Amazon.

 The
aim
with
the
course
is
to
help
early
stage
high‐tech
Internet
based
 • companies
to
try
their
services
on
new
pla_orms,
resul<ng
in
early
proof
 of
concepts
and
later
exploita<on
of
grid
and
cloud
in
the
region.

 On
top
of
the
course
we'll
build
a
network
of
innova<ve
companies
in
the
 • region.”
 4th
Terena
TF
Storage
Mee<ng,
 4
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Mo4va4on 
 for 
 Bal4cCloud 
 Complement
to
current
grid
services
 ‐ Low
number
of
applica<ons
and
applica<on
areas
in
BG.

 ‐ Need
of
elas<cy
‐
volume
on
demand
‐
a
way
to
handle
capacity
on
 the
fly,
to
balance
the
usage
 ‐ Too
steep
learning
curve
for
grid
users
 ‐ Low
acceptance
within
industry
–
so
far
 ‐ Complicated
to
adapt
new
applica<ons,
typically,
need
a
“project”
 to
do
that
 4th
Terena
TF
Storage
Mee<ng,
 5
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Mo4va4on 
 for 
 Bal4cCloud 
 So,
one
more
access
point
 
One
more,
hopefully,
easier
access
point
to
our
 Bal<cGrid
resources.

 4th
Terena
TF
Storage
Mee<ng,
 6
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Bal4c
Cloud
 How
it
all
fits
together 
 Bal<cGrid
 BC

 Planned
 BGi
‐
Bal<cGrid
Innova<on
Lab
 ac<vi<es
 SA1‐3,
 SME
 Bal<cCloud
 Courses
 NA1‐4,
JRA
 connec<vity
 4th
Terena
TF
Storage
Mee<ng,
 7
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Prac4cali4es &
Learning

 by
doing
 • Bal<cGrid
asked
one
center
per
country
to
install
a
cloud
 instance
 • SNIC
(Swedish
Na<onal
Infrastructure
for
Compu<ng)
 supported
the
coordina<on
of
the
work

 • Learning
by
doing
‐
what's
in
it
for
eScience,
really?
Is
industry
 interested?
 • Started
informa<on
gathering
and
sharing
through
our
site;
 went
to
cloud
expos
and
conferences
 • Took
early
contact
with
open
source
cloud
vendors,
decided
 to
focus
on
Eucalyptus
 4th
Terena
TF
Storage
Mee<ng,
 8
 Copenhagen,
2009.Sept.15,
Bal<cCloud


First
users
 Virtual
worlds
and
movies
 First
usage:
 1. Virtual
world
installa<ons
(Wonderland),
for
 the
Immersive
Educa<on
organiza<on
 2. Film
rendering,
for
Estonian
film
company
 4th
Terena
TF
Storage
Mee<ng,
 July
17,
2009
 9
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Open
source

 10
 “cloud
in
a
box”
 Our (main) choice: - Lead by Rich Wolski, UCSB. BC

 - Integrated with - Integrated with 4th
Terena
TF
Storage
Mee<ng,
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Major

 Concerns
 • Will
the
open
source
alterna<ves
be
supported
in
a
 sa<sfactory
way?
 – “Not
invented
here”
easily
becomes
“Not
supported
here”
 • Early
success
open
source
alterna<ves
branching
off
 a
private
version
–
think
Xen,
Eucalyptus,…
–
which
 branch
will
get
the
best
support?
 • Missing
standards
for
interoperability,
c
f
grids.
 • Lock‐in
and
de
facto
lock‐in,
the
bidding‐on‐a‐dollar
 syndrome
 4th
Terena
TF
Storage
Mee<ng,
 11
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Status
–
Bal4c
Cloud 
 See
hGp://cloud.bal4cgrid.eu
 4th
Terena
TF
Storage
Mee<ng,
 12
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Status
–
Estonia
‐
NICPB
(1/3)
 KVM‐based
setup
with
Eucalyptus
interface
 Evalua<ng:
 • other
virtualisa<on
technologies,
e.g.
vmware
solu<on
 • crea<on
of
the
virtual
private
networks
using
Eucalyptus,
 OpenVPN
and
dynamic
DNS
‐
to
be
able
to
provide
something
 like
the
recently
rolled
out
Amazon
Virtual
Private
Cloud
 (h\p://aws.amazon.com/vpc/)
 Usage:

 • primarily
NICPB
 • ImmersiveEduca<on
project
with
the
developement
and
 demo
resources
for
running
the
Project
Wonderland‐based
 virtual
worlds
 4th
Terena
TF
Storage
Mee<ng,
 13
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Status
–
Estonia
‐
NICPB
(2/3)
 The
KVM
infrastructure
is
also
used
as
a
pla_orm
for
the
 ongoing
 SME
collabora4on
‐
on‐demand
render
farm
crea4on .
The
plans
 are
to
make
it
controllable
by
Eucalyptus,
but
so
far
it
is
not
 capable
of
suppor<ng
Windows
machines
out
of
the
box
 (ongoing).
 Inves4ga4ng
the
crea4on
of
the
private
virtual
networks
 (using
 OpenVPN
and
dynamic
DNS
solu<ons)
to
be
able
to
provide
 something
like
the
recently
rolled
out
Amazon
 Virtual
Private
Cloud
(h\p://aws.amazon.com/vpc/).
 4th
Terena
TF
Storage
Mee<ng,
 14
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Status
–
Estonia
‐
NICPB
(3/3)
 Storage:

 – testbed
installa<on
of
the
hadoopFS
in
NICPB
with
SRM
interfaces.
 Trying
to
migrate
the
storage
infrastructure
from
dCache
to
HDFS.

 – Wins:
easier
administra<on,
cloud
flavor
‐
can
run
hadoop
jobs
much
 more
efficiently.
 Problems:
 – Eucalyptus
sw
is
s<ll
 too
alpha/pre‐beta .
The
1.6
_should_
be
be\er,
 incl.
support
for
mul<ple
data
centers
(availability
zones)
and
more
 robust
opera<ons,
but
it's
not
out
yet.
 – Accoun<ng
of
consumed
resources
is
complicated
–
the
virtualisa<on
 tools
are
not
making
an
accent
on
that.
 4th
Terena
TF
Storage
Mee<ng,
 15
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Status
‐
Latvia
‐
RTU
 Installa4on:
 Eucalyptus
installa<on,
xen,
4
cpu
 for
users.
HW
updates
expected
(user
 request).
 Usage:
 Submi\ed
simple
tests,
including
 students
tes<ng
cloud
 Issues:

 System
not
quite
stable.
“imho
so
far
not
 usable
for
serious
project”.
 4th
Terena
TF
Storage
Mee<ng,
 16
 Copenhagen,
2009.Sept.15,
Bal<cCloud


Status
‐
Belarus
–
UIIP
NASB
(1/3)
 Installa4on:
 – HW:
6
CPU,
24
cores
(enough
for
present
tasks);
 – Virtualisa<on:
Xen;
 – Cloud
technolgies:
Eucalyptus,
Walrus;
 – How
to
reach:
h\ps://80.94.168.123:8443/

 – Status:
3
GNU/Linux
images
available,
commonly
running
from
2
to
10
 instances.
 Usage :
 ‐ verified
by
regular
manual
monitoring
of
hosts
and
services
running
within
 the
cloud;
 ‐ used
by
UIIP
NASB
grid
team
for
designing
dynamic
grid
resource
 reserva<on
and
adjustment
mechanisms
for
UNICORE
sites
 4th
Terena
TF
Storage
Mee<ng,
 17
 Copenhagen,
2009.Sept.15,
Bal<cCloud