Every SAS Cloud has a Silver Lining Letting your data reign in the - - PowerPoint PPT Presentation

▶

Sep 22, 2023 659 likes •893 views

Every SAS Cloud has a Silver Lining Letting your data reign in the cloud DSS SAS SYSTEM Current Single Virtual Server unit with 16 cores upgraded to 32 cores 256 Gb RAM 150 registered users Data collector from other government

SLIDE 1

Letting your data reign in the cloud

Every SAS Cloud has a Silver Lining

SLIDE 2

DSS SAS SYSTEM

 Current

 Single Virtual Server unit with 16 cores upgraded to 32 cores 256 Gb RAM  150 registered users  Data collector from other government departments and external bodies  Runs Models and builds reports from this data.  Processing time – Considerably long due to model running

 Goal

 Grow with increased data collection  Integrate with new tools  Deliver reports in shorter time frame  Increased analytical capabilities  Able to operate in the new DSS Infrastructure Hosting Zone (on premises cloud)

SLIDE 3

DATA IS JUST DATA ISN’T IT?

 Structured data captured from operational systems

 Customer interaction directly with company

 Purchase detail  Usage detail

 Addition of 3rd party data to add value to operational data  The beginning of CRM systems  Beginning of Data Mining

 Big Data

 Social media  Non customer interaction  Unstructured data  Anything that generates some form of data in large volumes

SLIDE 4

IN 1999, THE WORLD PRODUCED ABOUT 1.5 EXABYTES OF UNIQUE INFORMATION, OR ABOUT 250 MEGABYTES FOR EVERY MAN, WOMAN, AND CHILD ON EARTH.

SLIDE 5

IN 2008 THE WORLD PRODUCED 14.7 EXABYTES OF NEW INFORMATION, NEARLY TRIPLE THE VOLUME OF INFORMATION IN 2003.

SLIDE 6

WHAT WE DO WITH THE DATA

 1990  Descriptive Analytics –What happened and when did it happen?

 Standard reports  Ad – hoc reports  Simple drill down queries

 2000 - onwards  Predictive Analytics – based on what happened, what is likely to happen?

 Statistical Analysis  Forecasting  Predictive Modelling  Optimisation

SLIDE 7

ADVANCED ANALYTICS

 What happened?  Why did it happen?  When did it happen?  What caused it to happen?  Who made it happen?  Will it happen again?  What should we do to make happen /stop it from happening again?  What is the outcome of this event?

SLIDE 8

WHAT DO WE WANT FROM THE DATA?

 What do we want to know?  Why do we want to know?  When do we want to know?  Who will use the what we now know?  How will this knowledge be used?  What is the benefit of knowing this?

SLIDE 9

THE HARDWARE

It’s more than an abacus, coloured pencils, ruler, and graph paper

SLIDE 10

GETTING THE RIGHT BALANCE

For today and tomorrow

SLIDE 11

'It would take 7.2 billion people using electronic calculators 32 years,

r two million desktop computers working together for one minute,

to do the same calculation the computer can solve in just 60 seconds.' Sunway TaihuLight (10.65 million cores).

Probably Not

SLIDE 12

How about this?

Ummm, Yeah, No

SLIDE 13

THINGS TO CONSIDER

 You’ll always get more data  More analytics and reporting  More, More, More  Efficiency

 Fixed resources  Elastic/Scalable resources  Coding  Scheduling  Tools  $$$$$$

 ROI  Lost Time

SLIDE 14

JUST HOW FAST ARE THE $$$$?

Fixed resources Scalable/Elastic Resources

One User Many Users

SLIDE 15

IN BUSINESS

The difference between a great system and a bad system is

Being No. 1 Or Being No 1

SLIDE 16

IN GOVERNMENT

The difference between a good system and a bad system is

Wise use of taxpayers money Or Being asked questions by the Auditor General

SLIDE 17

GRID SERVER VS VIYA

Grid Server (on Premises or Cloud)

 Scalable (with limited CPU available)  On or off premises  Integrate other tools

 E.g. Hadoop etc.

 In house systems need to be maintained / upgraded  In house-Security by organisation

Viya (Cloud)

 Elastic (Virtually unlimited CPU)  Mainly off premises location  Integrate other tools

 E.g. Hadoop etc.

 Minimal maintenance required (Host)  Security by cloud host and

rganisation

SLIDE 18

Yes, I stole this from SAS

SLIDE 19

BEST OPTION

 SAS Grid Server configuration in an on premises cloud

 Resources in house  Meets government security protocols (ASD)  Internal systems and Infrastructure meet needs now and future  Integration with tools currently used by DSS

 Hadoop  Federation Server

 Easy to expand nodes due to virtual server environment  Node configuration to suit business needs  Advanced analytical capabilites

SLIDE 20 Grid Server (Controller) Data Tier Source and Target SAS Server Tier Client Tier Environment Administrators SAS Management Console Yarn Resource Manager Hadoop Administration ADFS Access Administration SAS Environment Manager End User SAS Enterprise Guide Hadoop Client jars and Config Files SAS Addin for Microsoft Office SASGSUB SAS Enterprise Miner OOZIE HIVE SAS Connect SAS Grid Server SAS Object Spawner SAS Workspace Server SAS Stored Process Server SAS Data Step Batch Server SAS Pooled Workspace Server HDFS Name Node Grid Server (Node N+1) Yarn Node Manager SAS Foundation SAS Connect SAS Grid Node SAS Object Spawner SAS Workspace Server SAS Stored Process Server SAS Data Step Batch Server SAS Pooled Workspace Server HDFS Data Node Grid Server (Node N) Yarn Node Manager SAS Foundation SAS Connect SAS Grid Node SAS Object Spawner SAS Workspace Server SAS Stored Process Server SAS Data Step Batch Server SAS Pooled Workspace Server HDFS Data Node Grid Server (Node 1) Yarn Node Manager SAS Foundation SAS Connect SAS Grid Node SAS Object Spawner SAS Workspace Server SAS Stored Process Server SAS Data Step Batch Server SAS Pooled Workspace Server HDFS Data Node Hadoop ERP, applications & other Sources Analytical data Warehouse/ marts HDFS Storage Shared Storage Clustered Metadata Server SAS Metadata Server SAS Data SAS SPDE SPDS Data User Home Directories SAS Grid Work Libraries Shared Projects SAS Depot SAS Config Files Hadoop config and client Jars RDBMS SAS Foundation HUE HttpFS Clustered Middle Tier Server SAS Web Server SAS Web Application Servers SAS Studio Mid-Tier SAS Web Infrastructure Platform

OK I took this from SAS too, but modified it a little

SLIDE 21

THANK YOU

Peter Stagg peter@decision-informatics.com www.linkedin.com/in/pstagg https://www.facebook.com/decisionInformatics