SAHARA Project overview and update TELLES NOBREGA IRC: - - PowerPoint PPT Presentation

▶
sahara
SMART_READER_LITE
LIVE PREVIEW

SAHARA Project overview and update TELLES NOBREGA IRC: - - PowerPoint PPT Presentation

Jan 07, 2024 143 likes •271 views

May 2019 SAHARA Project overview and update TELLES NOBREGA IRC: TELLESNOBREGA EMAIL: TENOBREG@REDHAT.COM What does Sahara do? Data processing service Provides a way to deploy data processing clusters with minimum effort from

slide-1
SLIDE 1

SAHARA

Project overview and update

TELLES NOBREGA IRC: TELLESNOBREGA EMAIL: TENOBREG@REDHAT.COM

May 2019

slide-2
SLIDE 2

What does Sahara do?

  • Data processing service
  • Provides a way to deploy data

processing clusters with minimum effort from the user.

  • Provides the capability to manage

the clusters and submit jobs to them.

slide-3
SLIDE 3

Project background

  • First official release was Juno
  • 19 contributors for latest release
  • 3 ATC
slide-4
SLIDE 4

Quick Overview

  • Cluster

○ Node Group Templates ○ Cluster Templates

  • Jobs - EDP (Elastic Data Processing)

○ Data Sources ○ Job Binary ○ Job Templates

slide-5
SLIDE 5

Architecture

slide-6
SLIDE 6

New features & enhancements in Stein

➡

RELEASE OF APIv2 AS STABLE

  • APIv2 is here. Finally made it and it opens up new possibilities. Clean up of APIv1 and can be improved with

microversioning on the future.

➡

PYTHON 3 FIRST SUPPORT

  • Sahara now is able to run with python 3

➡

SPLIT PLUGIN FROM SAHARA CORE

  • Plugins now live outside of the Sahara main code
slide-7
SLIDE 7

SCALABILITY RESILIENCY MANAGEABILITY MODULARITY INTEROPERABILITY SECURITY USER EXPERIENCE

Stein release themes for Sahara

MAJOR FOCUS FOCUS NO INFO NOT A FOCUS NO INFO NO INFO NO INFO MINOR FOCUS MINOR FOCUS MINOR FOCUS MAJOR FOCUS NOT A FOCUS MAJOR FOCUS FOCUS

slide-8
SLIDE 8

Possible features & enhancements for Train

➡

IPv6 SUPPORT

  • Aligned with community goal to full support IPv6

➡

PYTHON SPARK EDP

  • We need to fix the running of Python Spark Jobs

➡

PYTHON 3 AS DEFAULT

  • Python 2 time is running out, we need to move to python 3 full support asap

➡

CASTELLAN INTEGRATION REVISIT

  • We have castellan integration, but not really.
slide-9
SLIDE 9

SCALABILITY RESILIENCY MANAGEABILITY MODULARITY INTEROPERABILITY SECURITY USER EXPERIENCE

Train release themes for Sahara

MAJOR FOCUS FOCUS NO INFO NOT A FOCUS NO INFO NO INFO NO INFO MINOR FOCUS MINOR FOCUS FOCUS MAJOR FOCUS NOT A FOCUS MAJOR FOCUS MINOR FOCUS

slide-10
SLIDE 10

We need your help!

  • QUESTION 1: What services would you like to see supported in

Sahara?

  • QUESTION 2: What are the main issues that you have while using

Sahara?

slide-11
SLIDE 11

@OpenStack

THANKS!

Questions?

  • penstack
  • penstack

OpenStackFoundation