EuroPython 2018 @ultrabug Gentoo Linux developer CTO at Numberly - - PowerPoint PPT Presentation

▶

May 17, 2023 394 likes •744 views

EuroPython 2018 @ultrabug Gentoo Linux developer CTO at Numberly The rise of Python in the data communities The rise of Python in the Data communities Europython 2018 The rise of Python Who has driven Tech over in the data communities

SLIDE 1

EuroPython 2018

SLIDE 2

@ultrabug

Gentoo Linux developer CTO at Numberly

SLIDE 3

The rise of Python in the data communities

Europython 2018

The rise of Python in the Data communities

SLIDE 4

The rise of Python in the data communities

Europython 2018

Who has driven Tech over the last ~10 years?

SLIDE 5

SLIDE 6

DATA

SLIDE 7

SLIDE 8

Data challenges (re)shaped the Tech industry

SLIDE 9

Software Engineering

SLIDE 10

Science

SLIDE 11

System / Network Operations

SLIDE 12

Data Analysis

SLIDE 13

Software Engineering System / Network Operations Science Data Analysis

DATA

SLIDE 14

“a general purpose programming language”

SLIDE 15

Software Engineering System / Network Operations Perl

SLIDE 16

2009: DevOps culture and SOA design emerge

Software Engineering System / Network Operations

SLIDE 17

DevOps fosters Python’s adoption by Ops

Software Engineering System / Network Operations

2009

DevOps culture SOA architectures 2010 WSGI 1.0.1 (PEP 3333) Flask uWSGI Gunicorn Fabric 2011-2012 Ansible SaltStack

SLIDE 18

Software Engineering System / Network Operations Science

SLIDE 19

Software Engineering System / Network Operations Science 2001 iPython 2006 numpy 2007 creation of scikits in scipy

2009

pandas scikit-learn 2012 numFOCUS 2014 Jupyter 2016 PyTorch

SLIDE 20

Software Engineering System / Network Operations Science Data Analysis

SLIDE 21

Software Engineering System / Network Operations Science Data Analysis

2009

pandas scikit-learn 2012 PyDATA 2014 Jupyter 2015 dask 2017 pyarrow ray project

SLIDE 22

Software Engineering System / Network Operations Science Data Analysis 2008 Cassandra

2009

MongoDB NoSQL influence 2011 Apache Hadoop Apache Kafka 2015 DataOps culture Event-Driven Architecture

SLIDE 23

2009 was cool :)

Software Engineering System / Network Operations Science Data Analysis

SLIDE 24

Source: https://www.economist.com/science-and-technology/2018/07/21/python-has-brought-computer-programming-to-a-vast-new-audience

SLIDE 25

Source: https://www.lemonde.fr/pixels/article/2018/07/25/je-n-imaginais-pas-que-python-connaitrait-un-tel-succes_5335917_4408996.html

GUIDO APPROVED

SLIDE 26

The rise of Python in the data communities

Europython 2018

The rise of Python in the Data communities

SLIDE 27

The rise of Python in the data communities

Europython 2018

The rise of Data in the Python communities

SLIDE 28

Data-Driven is (finally) coming

SLIDE 29

Software Engineering System / Network Operations

The way we build & deploy apps/platforms changes

Challenges

Packaging
Standalone build and runtime
Performance
Distributed applications

SLIDE 30

Operating Data Science at scale is still not solved

Challenges

Production deployment
Runtime integration
Performance
Scale
Graph computation

Software Engineering Science

SLIDE 31

Data paradigm is shifting to Event-Driven / Streams

Challenges

Runtime integration
Production deployment
Performance
Scale
Distributed databases

System / Network Operations Data Analysis

SLIDE 32

Take away

2009 DevOps, Scientists and Data Analysts start to adopt Python 2010 Python for the Web is becoming mature 2012 numFOCUS & PyData structurate Data in Python 2015 DataOps, Event-Driven Architecture and AI emerge 2018 Python is influenced by the Data challenges faced by Data Science, AI and the rest of its wide range of communities

SLIDE 33

Keep on rising, Python community!

SLIDE 34

Thanks

The rise of Python in the Data communities

@ultrabug

The rise of Data in the Python communities