Unleashing the Power of GPUs over the Web Vishal Vaidyanathan - - PowerPoint PPT Presentation

▶
unleashing the power of gpus over the web
SMART_READER_LITE
LIVE PREVIEW

Unleashing the Power of GPUs over the Web Vishal Vaidyanathan - - PowerPoint PPT Presentation

Mar 27, 2023 466 likes •642 views

Unleashing the Power of GPUs over the Web Vishal Vaidyanathan Royal Caliber LLC GPUs are great... high compute throughput increasingly energy efficient high density but? http://onu.io

slide-1
SLIDE 1

Unleashing the Power

  • f GPUs over the Web

Vishal Vaidyanathan Royal Caliber LLC

slide-2
SLIDE 2

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

  • high compute throughput
  • increasingly energy efficient
  • high density

… but?

GPUs are great...

slide-3
SLIDE 3

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

  • high development time
  • unknown outcome for many algorithms
  • requires specialized talent
  • increased operational complexity

… but come at a price

slide-4
SLIDE 4

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

  • parallel algorithms are already challenging
  • CPUs and GPUs are far from ideal parallel

processors and interconnects lag far behind How can we bring scalable computation to the mainstream?

Scalable computing is hard!

slide-5
SLIDE 5

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

  • API for computation exposed over HTTP
  • Powered by hybrid CPU/GPU clusters
  • Built-in performance and scalability

To the cloud!

slide-6
SLIDE 6

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

Cloud accessibility

slide-7
SLIDE 7

Royal Caliber LLC

Composable blocks

  • basic transforms: sorting,

filtering, sampling, reduction, etc.

  • specializations: images,

matrices, graphs, video, audio, etc.

  • machine learning:

regression, classification, deep learning, NLP etc.

Broad suite of algorithms

Ready-to-use

  • fully automated prediction
  • image recognition
  • graph routing
slide-8
SLIDE 8

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

System Overview

API Service High Performance Compute Backend SDK

Thin wrappers in python, java, ruby, scala etc.

HTTP

Scheduler Browser UI

HTTP

slide-9
SLIDE 9

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

Functional Separation

API Service

HTTP

How

Parallelism, performance, scalability

What

application domain

slide-10
SLIDE 10

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

Built-in Task Parallelism

API Service

HTTP

y = f(x) z = g(y) w = h(x)

x y w z f g h

slide-11
SLIDE 11

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

Streaming, Visual, Fault Tolerant

API Service

HTTP

y = f(x) z = g(y) w = h(x)

x y w z f g h

slide-12
SLIDE 12

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

var api = new onu.API(); var labels = api.labelImage(url).readAsJson() labels = {‘tabby cat’: 0.7, ‘terrier’: 0.1, ...}

Demo: Image recognition

slide-13
SLIDE 13

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

var graph = api.newVariable(‘/datasets/wikipedia’) var ranks = api.pageRank(graph) var top = api.argsort(ranks).slice(1000) var topRanks = api.gather(ranks, top) var topNames = api.gather(graph.names, top) var dist = api.shortestPaths(graph, top, top) plot(...)

Demo: Graph analytics

slide-14
SLIDE 14

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

Demo: Automated Prediction

var model = api.autopred(data, {inCols:[0, 1, 2], outCols:[3]}) model.predict([0.5, 0.12, 2.3])

slide-15
SLIDE 15

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

  • HPC delivered as a service
  • ready-to-use and scalable
  • intuitive API for ML and data science
  • language agnostic

Summary: http://onu.io

slide-16
SLIDE 16

http://onu.io vishal@onutechnology.com Onu Technology, Inc.

Onu: Guha J., T. Sahai, Shriphani P., E. Elsen U.C. Davis: Prof. John Owens, Yangzihao Wang DARPA: Dr. Chris White, Brian Sandberg

Acknowledgements