Mesosphere and Percona Server for MongoDB Jeff Sandstrom, Product - - PowerPoint PPT Presentation

Jeff Sandstrom, Product Manager (Percona) Ravi Yadav, Tech. Partnerships Lead (Mesosphere)

Mesosphere and Percona Server for MongoDB

PHYSICAL INFRASTRUCTURE MICROSERVICES, CONTAINERS, & DEV TOOLS VIRTUAL MACHINES PUBLIC CLOUDS DATA SERVICES, MACHINE LEARNING, & AI

Security & Compliance Application-Aware Automation Multitenancy Hybrid Cloud Management

100+ MORE Datacenter Edge

Datacenter and Cloud as a Single Computing Resource

Powered by Apache Mesos

20+ MORE

Unified hybrid cloud operations

Securely manage cloud, datacenter, and edge infrastructures from a single control plane

4

Mesosphere DC/OS

Intelligent resource pooling

Optimize workload density for highest utilization with resource guarantees

3

Broad workload coverage

Run today & tomorrow’s applications including traditional J2EE, containers, analytics & ML

1

Application-aware automation

Automate workload-specific operating procedures to “as-a-Service” anything from Kubernetes to data services

2

Mesos Architecture

3

3

Mesos Master Mesos Master Mesos Master Mesos Agent Mesos Agent Service

Cassandra Executor Cassandra Task

Cassandra Scheduler Container Scheduler Spark Scheduler

Spark Executor Spark Task

Mesos Agent Mesos Agent Service

Docker Executor Docker Task Spark Executor Spark Task

Two-level Scheduling

• 1. Agents advertise resources to Master
• 2. Master offers resources to Framework
• 3. Framework rejects / uses resources
• 4. Agent reports task status to Master

Stateful Problems

4

• Preparation before the main task
• Runtime execution against state

○ once ○ scheduled ○ user-defined arguments ○ maintenance

Stateful Problems

5

• Conditional recovery scenarios

○ Cassandra: replacing a dead node or dead seed node ○ HDFS: replacing a dead name node ○ HDFS: replacing a dead journal node

• Conditional deployment scenarios

○ HDFS: deployment

DC/OS Commons SDK

6

DC/OS Documentation Tools and Utilities Apache Mesos API Platform Feature Integration

Mongo Kafka Elastic

Finite State Machine Execution Plans Automated Recovery Universe Packaging App Configuration Networking & Discovery Storage Security Monitoring Offer Evaluation Resource Accounting Task Reconciliation Developer Environment Integration Test Framework Developer Guide Tutorials & Code Samples API Reference

Best Practices

Services SDK Platform

7

DC/OS SDK

• A declarative orchestration

abstraction for Apache Mesos and DC/OS.

• An Apache Mesos scheduler

factory. Use Cases

• MongoDB!
• Kubernetes
• Kafka
• Cassandra
• Elastic
• HDFS
• EdgeLB
• many more...

8

DC/OS SDK Features

• Rolling configuration / software updates
• Separate deployment / update plans
• Easy Mesos feature consumption

○ CNI, rlimits, readiness checks, running and finished goal states, discoverability of dns, persistent volumes, security features (proprietary) …

9

DC/OS SDK Features

• Horizontal scale out
• Vertical scaling
• Service discovery
• Virtual Networks (CNI)
• Readiness checks
• Health checks
• Custom recovery
• Persistent volumes
• Resource sets
• Operator friendly tools (API)
• Sidecars
• Placement constraints
• Configuration templating
• Rolling updates (configuration)
• Rolling upgrades (binaries)
• GPUs
• Fine-grained plan control
• Secrets (EE)
• Security (EE)
• TLS provisioning (EE)

10

Percona Server for MongoDB

COMMUNITY EDITION Free and open source ENTERPRISE

MongoDB Community Edition plus:

• Red Hat identity management

certification

• Kerberos & LDAP authentication
• Auditing
• SNMP support
• Encrypted storage engine
• In-memory storage engine
• Platform certifications: Windows,

RedHat/CentOS, Ubuntu, Amazon Linux

• Commercial licenses, warranty,

and indemnification

Subscription ($) Free and open source

Percona Memory Engine Hot Backups LDAP Authentication Database Auditing Log Redaction

COMMUNITY EDITION

11

Percona Server for MongoDB on DC/OS

• Simple installation of MongoDB via

UI or CLI

• Single-command installation for rapid

provisioning

• Multiple MongoDB Replica Sets within a

single DC/OS cluster

• Storage volumes for enhanced data

durability, known as Mesos Dynamic Reservations and Persistent Volumes

• Support for all Percona Server for

MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines

• Auto-configuration of MongoDB

Replica Set Configuration

• Auto-configuration of system-level users

for backups and user management

• CLI actions for Add/Update/Remove of

MongoDB Users

• Logical backup support with Amazon

Web Services S3 remote upload

• Support for auto-deploy of Hidden

Replica Set Member for zero-impact backups

• Percona Server for MongoDB Auditing

support

12

13

14

15

Participate in the PSMDB on DC/OS Beta!

1.Install DC/OS (https://dcos.io/install) 2.Search the DC/OS Catalog for percona-mongo 3.Install the percona-mongo package 4.Provide feedback to mesosphere@percona.com NOTE: Replica sets today, sharding later this year

16

Rate My Session

17

Resources

Documentation: https://docs.mesosphere.com/services/percona-mongo SDK https://github.com/mesosphere/dcos-commons https://mesosphere.github.io/dcos-commons/developer-guide/ https://docs.mesosphere.com/services/ops-guide/

Thank You!