Brendan Jackson Vice President, Analytics PDI Virtual Desktop In - - PowerPoint PPT Presentation

Brendan Jackson

Vice President, Analytics

PDI Virtual Desktop In Docker

Innovate In Your Swarm

Brandon Jackson

PDI Virtual Desktop in Docker

Containerize PDI to have visual development power in your swarm

• Seasoned healthcare finance and technology executive and

innovator

• Since 2005, has been applying data automation, process

improvement and analytics to a myriad of use cases

• Been deploying and maintaining Pentaho solutions for 7

years

• Very interested in machine learning applications,

automation, Python, Java, Docker and Nutanix

Monitor

03

Container Stats & Logs

Docker make performance stats more accessible.

Deploy

04

Secure Scaling Up & Out

Containers provide separation; protecting OS & App from workload and allow efficient scaling.

Package

01

Containers wrap up dependencies, configuration and patches.

Upgrade

02

Solid Tool Chains

Mixing and matching containerized PDI versions allows incremental upgrades to ETL sets.

The Problems

Packaging, upgrading, monitoring, and deploying SOLVED!

OS + JRE + PDI

PDI Virtual Desktop In A Container

• In production

running on a cluster, studying logs to troubleshoot is very time consuming.

• More efficient to

launch a virtual desktop

• Inside the

production environment.

Packaging An Application

• Docker containers are a widely accepted format for

packaging up an application and its dependencies.

• Organizations like Pentaho and Hewlett Packard

choose specific OS versions and patch levels for their applications to be installed upon, Ubuntu 16.04 and 14.04 respectively.

• Docker supports the concept of tagging container

image releases which can serve as snapshots for a complete set of release artifacts.

docker tag usbrandon/docker-pdi-xfce-vnc:7.1.0.4

Upgrading

• If you have designed your container well, upgrading should just be a matter of ‘docker run’ or ‘docker

pull’ of a specific version tag.

• The illustration shows pulling two different versions of HP’s Vertica Database and running them, with

no other required changes or parameters.

Monitoring

docker stats is a built in command that tells us all the important basics for each of

• ur running containers every second.

There are free stacks, which properly combine multiple containers, that provide performance monitoring. An excellent example was made by Stefan Prodan provided at https://github.com/stefanprodan/swarmprom

Running & Deploying

• Often you will make things like drivers

available through either named volumes or bind mounts.

• Configuration and passwords can be

injected by using Docker Swarm

• secrets. Secrets are presented on the

filesystem that appears within the container.

• This example could easily be

extended to run a cluster of PDI nodes.

docker run -d -p 5901:5901 -p 6901:6901 -e VNC_RESOLUTION=1024x768 --name spoon usbrandon/docker-pdi-xfce-vnc

CONNECT WITH ME

https://www.linkedin.com/in/usbrandon/

1500 Waters Ridge Dr. Lewisville, TX 75057

STONEGATE SENIOR LIVING

GET THE CODE

https://github.com/usbrandon/docker-pdi-xfce-vnc