Dream in Cloud Jonathan Wisler, General Manager EMEA @jpwisler - - PowerPoint PPT Presentation

dream in cloud
SMART_READER_LITE
LIVE PREVIEW

Dream in Cloud Jonathan Wisler, General Manager EMEA @jpwisler - - PowerPoint PPT Presentation

Dream in Cloud Jonathan Wisler, General Manager EMEA @jpwisler Founders Top 100,000 Sites By Hosting Provider Source: Hostcabi.net Building maps for apps in the cloud Share your skiing with the world. Join the Snowciety Ski tracker


slide-1
SLIDE 1

Dream in Cloud

Jonathan Wisler, General Manager EMEA @jpwisler

slide-2
SLIDE 2

Founders

slide-3
SLIDE 3

Source: Hostcabi.net Top 100,000 Sites By Hosting Provider

slide-4
SLIDE 4
slide-5
SLIDE 5
slide-6
SLIDE 6
slide-7
SLIDE 7
slide-8
SLIDE 8
slide-9
SLIDE 9
slide-10
SLIDE 10
slide-11
SLIDE 11

Building maps for apps in the cloud

slide-12
SLIDE 12
slide-13
SLIDE 13

Share your skiing with the world. Join the Snowciety

slide-14
SLIDE 14

Ski tracker

slide-15
SLIDE 15

Friend finder

slide-16
SLIDE 16

Share your skiing

slide-17
SLIDE 17

Google Maps alternative

because they charge heavy users nowadays

slide-18
SLIDE 18
slide-19
SLIDE 19
slide-20
SLIDE 20
slide-21
SLIDE 21
slide-22
SLIDE 22

Freedom

create radical designs

slide-23
SLIDE 23
slide-24
SLIDE 24
slide-25
SLIDE 25

It is all Open Source

even the data from NASA

slide-26
SLIDE 26

data database renderer http server

slide-27
SLIDE 27

client

slide-28
SLIDE 28

OpenStreetMap

wikipedia for maps

slide-29
SLIDE 29

SRTM

Shuttle Radar Topography Mission

slide-30
SLIDE 30

Lots of data

  • ur cluster contains roughly 3,5 terabyte of unrendered data
slide-31
SLIDE 31

350 GB of OSM

PostgreSQL with PostGIS plugin

slide-32
SLIDE 32

3 TB of GEOTIFF

slide-33
SLIDE 33
slide-34
SLIDE 34

Mapnik

renderer

slide-35
SLIDE 35
slide-36
SLIDE 36

§

slide-37
SLIDE 37
slide-38
SLIDE 38
slide-39
SLIDE 39
slide-40
SLIDE 40
slide-41
SLIDE 41
slide-42
SLIDE 42
slide-43
SLIDE 43
slide-44
SLIDE 44
slide-45
SLIDE 45
slide-46
SLIDE 46
slide-47
SLIDE 47
slide-48
SLIDE 48
slide-49
SLIDE 49

Journey to get here

slide-50
SLIDE 50
slide-51
SLIDE 51
slide-52
SLIDE 52

Journey to get here

slide-53
SLIDE 53

§

slide-54
SLIDE 54

png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png png

256x256

png png png png png png png png png png

slide-55
SLIDE 55

Not only server-side

also client-side library to interact with map

slide-56
SLIDE 56

An Open-Source JavaScript Library for Mobile-Friendly Interactive Maps

slide-57
SLIDE 57

Apache httpd

No, not really the chopper

slide-58
SLIDE 58

Tile Stache

Translating Apache requests into Mapnik render commands

slide-59
SLIDE 59

Mapnik

the renderer from before

slide-60
SLIDE 60

Caching

Memcache, Disk, S3

slide-61
SLIDE 61

Caching

Memcache, Disk, S3

slide-62
SLIDE 62
slide-63
SLIDE 63

Importing data

takes a loooooooooooooooooooooooooooooooooooong time

slide-64
SLIDE 64

25GB

gzipped xml file

slide-65
SLIDE 65

and you know how well plain text can be gzipped

file is roughly 250GB unzipped

slide-66
SLIDE 66

3 weeks and counting :-| M1 Large Instance

7.5 GiB of memory, 4 EC2 Compute Units

slide-67
SLIDE 67

High-Memory Quadruple Extra Large Instance

68.4 GB of memory, 26 EC2 Compute Units, 24 EBS blocks RAID 1 $1.640 per Hour = $ 1180 / month

29 hours!

slide-68
SLIDE 68

Dedicated hardware

68 GB of memory, 8 Cores, 1 SATA disk $ 700 / month

10 hours

slide-69
SLIDE 69

Macbook Pro

16 GB of Memory, SSD

slide-70
SLIDE 70

8.5 hours

it is all about lots of memory and lots and lots of IO speed

slide-71
SLIDE 71

and that was just OSM!

slide-72
SLIDE 72

SRTM

Shuttle Radar Topography Mission

slide-73
SLIDE 73
slide-74
SLIDE 74

about a minute

per 1” x 1” file

slide-75
SLIDE 75

from -180,0 to 180,90

28.800 files

slide-76
SLIDE 76

20 days later

we were done importing

slide-77
SLIDE 77
slide-78
SLIDE 78

So now you know

how it is made

slide-79
SLIDE 79

Future?

More sources, better maps, and..

slide-80
SLIDE 80

Vector maps!

slide-81
SLIDE 81
slide-82
SLIDE 82
slide-83
SLIDE 83
slide-84
SLIDE 84
slide-85
SLIDE 85
slide-86
SLIDE 86

How do I get started?

Mapbox.com download TileMill

slide-87
SLIDE 87

Building your on OSM server (incl all build commands) http://weait.com/content/build-your-own-openstreetmap-server-lucid Working with terrain data (hillshading, slopeshading, color-relief) http://www.mapbox.com/tilemill/docs/guides/terrain-data/

for when viewing this presentation on Slideshare

Tutorials

slide-88
SLIDE 88

THANK YOU

@timanrebel

slide-89
SLIDE 89

Rate me!

GOTO Guide App

!