Visualization and Nonphotorealistic Rendering Adrien Treuille - - PowerPoint PPT Presentation

visualization and nonphotorealistic rendering
SMART_READER_LITE
LIVE PREVIEW

Visualization and Nonphotorealistic Rendering Adrien Treuille - - PowerPoint PPT Presentation

Visualization and Nonphotorealistic Rendering Adrien Treuille Carnegie Mellon Universtiy Saturday, February 27, 2010 Outline Visualization Non-photorealistic Rendering Cutaway Illustration Contour Drawing Good photographs.


slide-1
SLIDE 1

Visualization and Nonphotorealistic Rendering

Adrien Treuille Carnegie Mellon Universtiy

Saturday, February 27, 2010
slide-2
SLIDE 2

Outline

  • Visualization
  • Non-photorealistic Rendering
  • Cutaway Illustration
  • Contour Drawing
  • Good photographs.
  • Map Drawing
  • Painting
Saturday, February 27, 2010
slide-3
SLIDE 3

Outline

  • Visualization
  • Non-photorealistic Rendering
  • Cutaway Illustration
  • Contour Drawing
  • Good photographs.
  • Map Drawing
  • Painting
Saturday, February 27, 2010
slide-4
SLIDE 4

Visualization

  • Goal: Use computer

graphics to understand data.

  • For virtual every data

type there is a corresponding visualization.

  • The importance of

graphics!

http://medvis.vrvis.at/fileadmin/hvr/images/headlarge.jpg Saturday, February 27, 2010
slide-5
SLIDE 5

Numerical Data

http://www.manifold.net/news/fly_through.jpg Saturday, February 27, 2010
slide-6
SLIDE 6

Graphs

http://www.wandora.org/wandora/wiki/images/Tree_graph_example.gif Saturday, February 27, 2010
slide-7
SLIDE 7

Graphs

http://www.designinginteractions.com/chapters/7 Saturday, February 27, 2010
slide-8
SLIDE 8

Geographic Data

http://flowingdata.com/wp-content/plugins/yet-another-photoblog/cache/g_econ.6zhzwniskpgcwwgs00okoco4s.7dm680981og04ocskgcsckco4.th.jpeg Saturday, February 27, 2010
slide-9
SLIDE 9

Flow Visualization

http://www.faculty.iu-bremen.de/llinsen/publications/ParkYuHotzKreylosLinsenHamann06.jpg Saturday, February 27, 2010
slide-10
SLIDE 10

3D Volume Data

http://medvis.vrvis.at/fileadmin/hvr/images/headlarge.jpg Saturday, February 27, 2010
slide-11
SLIDE 11

Example

Saturday, February 27, 2010
slide-12
SLIDE 12

Volume Rendering

  • Visualize Large dataset for scientific /

medical application.

  • Generally do not start with a 3D model.

CT Scan - White means higher radiodensity.

OUTPUT INPUT

Saturday, February 27, 2010
slide-13
SLIDE 13

Data Format

  • A cube of density values.
Saturday, February 27, 2010
slide-14
SLIDE 14

Large Datasets

CT Scan - White means higher radiodensity.

OUTPUT INPUT

  • C

T

  • r

M R I :

  • e

. g . 5 1 2 × 5 1 2 × 2 ≈ 5 M B

  • V

i s i b l e H u m a n :

  • 5

1 2 × 5 1 2 × 1 7 3 4 ≈ 4 3 3 M B

Saturday, February 27, 2010
slide-15
SLIDE 15

Two Options

  • Surface Rendering
  • Volume Rendering
Saturday, February 27, 2010
slide-16
SLIDE 16

Two Options

  • Surface Rendering
  • Volume Rendering
Saturday, February 27, 2010
slide-17
SLIDE 17

Surface Rendering

  • Threshold volume data.
  • Then run our favorite algorithm....
  • Hint: rhymes with “starching dudes”
Saturday, February 27, 2010
slide-18
SLIDE 18

Two Options

  • Surface Rendering
  • Volume Rendering
Saturday, February 27, 2010
slide-19
SLIDE 19

Two Options

  • Surface Rendering
  • Volume Rendering
Saturday, February 27, 2010
slide-20
SLIDE 20

Volume Rendering

  • Some data better visualized as a

volume, not a surface.

  • Idea: Use voxels and transparency.

Raytraced Isosurface Volume Rendering

Saturday, February 27, 2010
slide-21
SLIDE 21

Volume Rendering Pipeline Volume Rendering Pipeline

Data sets Rendering Sample Volume Transfer function Image

  • Data volumes come in all types: tissue density (CT), wind

speed, pressure, temperature, value of implicit function.

  • Data volumes are used as input to a transfer function, which

produces a sample volume of colors and opacities as output. – Typical might be a 256x256x64 CT scan

  • That volume is rendered to produce a final image.
Saturday, February 27, 2010
slide-22
SLIDE 22

Transfer Functions Transfer Functions

  • Transform scalar data values to RGBA values
  • Apply to every voxel in volume
  • Highly application dependent
  • Start from data histogram
Saturday, February 27, 2010
slide-23
SLIDE 23

Transfer Function Example Transfer Function Example

Mantle Convection

Scientific Computing and Imaging (SCI) University of Utah

Saturday, February 27, 2010
slide-24
SLIDE 24

Three Options

  • Ray Casting
  • Splatting
  • 3D Textures
Draw back to front Saturday, February 27, 2010
slide-25
SLIDE 25

Three Options

  • Ray Casting
  • Splatting
  • 3D Textures
Draw back to front Saturday, February 27, 2010
slide-26
SLIDE 26

Volume Ray Casting Volume Ray Casting

  • Ray Casting

– Integrate color and opacity along the ray – Simplest scheme just takes equal steps along ray, sampling opacity and color – Grids make it easy to find the next cell

Saturday, February 27, 2010
slide-27
SLIDE 27

Trilinear Interpolation Trilinear Interpolation

  • Interpolate to compute RGBA away from grid
  • Nearest neighbor yields blocky images
  • Use trilinear interpolation
  • 3D generalization of bilinear interpolation

Nearest neighbor Trilinear interpolation

Saturday, February 27, 2010
slide-28
SLIDE 28

Trilinear Interpolation Trilinear Interpolation

Bilinear interpolation Trilinear interpolation

Saturday, February 27, 2010
slide-29
SLIDE 29

Three Options

  • Ray Casting
  • Splatting
  • 3D Textures
Draw back to front Saturday, February 27, 2010
slide-30
SLIDE 30

Three Options

  • Ray Casting
  • Splatting
  • 3D Textures
Draw back to front Saturday, February 27, 2010
slide-31
SLIDE 31

Splatting Splatting

  • Alternative to ray tracing
  • Assign shape to each voxel (e.g., sphere or Gaussian)
  • Project onto image plane (splat)
  • Draw voxels back-to-front
  • Composite (a-blend)
Saturday, February 27, 2010
slide-32
SLIDE 32

Example

Saturday, February 27, 2010
slide-33
SLIDE 33

Three Options

  • Ray Casting
  • Splatting
  • 3D Textures
Draw back to front Saturday, February 27, 2010
slide-34
SLIDE 34

Three Options

  • Ray Casting
  • Splatting
  • 3D Textures
Draw back to front Saturday, February 27, 2010
slide-35
SLIDE 35

3D Textures 3D Textures

  • Alternative to ray tracing, splatting
  • Build a 3D texture (including opacity)
  • Draw a stack of polygons, back-to-front
  • Efficient if supported in graphics hardware
  • Few polygons, much texture memory

3D RGBA texture Draw back to front Viewpoint

Saturday, February 27, 2010
slide-36
SLIDE 36

Three Options

  • Ray Casting
  • Splatting
  • 3D Textures
Draw back to front Saturday, February 27, 2010
slide-37
SLIDE 37

Three Options

  • Ray Casting
  • Splatting
  • 3D Textures
Draw back to front Saturday, February 27, 2010
slide-38
SLIDE 38

Two Options

  • Surface Rendering
  • Volume Rendering
Saturday, February 27, 2010
slide-39
SLIDE 39

Two Options

  • Surface Rendering
  • Volume Rendering
Saturday, February 27, 2010
slide-40
SLIDE 40

Visualization

Saturday, February 27, 2010
slide-41
SLIDE 41

Outline

  • Visualization
  • Non-photorealistic Rendering
  • Cutaway Illustration
  • Contour Drawing
  • Good photographs.
  • Map Drawing
  • Painting
Saturday, February 27, 2010
slide-42
SLIDE 42

Basic Idea

  • Which best conveys “reality?”

source: Jos Stam. Photography changes what we think “reality” looks like.

Photograph. Painting.

A Rough Sea at a Jetty, 1650. Jacob van Ruysdael.

Computer Graphics

Duncan Brinsmead

Saturday, February 27, 2010
slide-43
SLIDE 43

Reality

  • This instance in time never happened!
  • Perhaps a better match of “subjective reality.”
  • Better illustration of “what was going on.”

A Rough Sea at a Jetty, 1650. - Jacob van Ruysdael.

Saturday, February 27, 2010
slide-44
SLIDE 44

NPR

  • This instance in time never happened!
  • Perhaps a better match of “subjective reality.”
  • Better illustration of “what was going on.”

A Rough Sea at a Jetty, 1650. - Jacob van Ruysdael.

Text

  • Perhaps we can do better graphics...
  • By doing non-photorealistic graphics!
Saturday, February 27, 2010
slide-45
SLIDE 45

NPR Pipeline

  • NPR Research often follows this pipeline...
http://www.ohsu.edu/library/hom/exhibits/exhimages/200706anatomy/bEf1a5.jpg

(1) Study Existing Rendering or Illustration Technique

u’ v’ Parameter space u 1 1 u (a) Object- aligned box cut (b) Transverse tube cut (c) Wedge tube cut 1 1 v 1 u w (d) Freeform window cut (e) Four-sided window cut 1 1 u v u’ u’ Model space u’ w’ v’ 2! 1 1 u v w u’ v’ w’ model space cutting volume model space cutting volume max extents parameter space cutting volume max extents parameter space cutting volume

(2) Extract General Aesthetic Rules

(b) Thorax

(3) “Algorithmicize” These Rules

Saturday, February 27, 2010
slide-46
SLIDE 46

Outline

  • Visualization
  • Non-photorealistic Rendering
  • Cutaway Illustration
  • Contour Drawing
  • Good photographs.
  • Map Drawing
  • Painting
Saturday, February 27, 2010
slide-47
SLIDE 47

Goal

Saturday, February 27, 2010
slide-48
SLIDE 48

Box Cut

Saturday, February 27, 2010
slide-49
SLIDE 49

Box Cut

Saturday, February 27, 2010
slide-50
SLIDE 50

Window Cut

Saturday, February 27, 2010
slide-51
SLIDE 51

Window Cut

Saturday, February 27, 2010
slide-52
SLIDE 52

Wedge Cut

Saturday, February 27, 2010
slide-53
SLIDE 53

Wedge Cut

Saturday, February 27, 2010
slide-54
SLIDE 54

Transverse Tube Cut

Saturday, February 27, 2010
slide-55
SLIDE 55

Transverse Tube Cut

Saturday, February 27, 2010
slide-56
SLIDE 56

Cut Taxonomy

u’ v’ Parameter space u 1 1 u (a) Object- aligned box cut (b) Transverse tube cut (c) Wedge tube cut 1 1 v 1 u w (d) Freeform window cut (e) Four-sided window cut 1 1 u v u’ u’ Model space u’ w’ v’ 2! 1 1 u v w u’ v’ w’ model space cutting volume model space cutting volume max extents parameter space cutting volume max extents parameter space cutting volume Saturday, February 27, 2010
slide-57
SLIDE 57

Results

(Source: Li et al. InteractiveCutawayIllustrationsofComplex3DModels)

Saturday, February 27, 2010
slide-58
SLIDE 58

Outline

  • Visualization
  • Non-photorealistic Rendering
  • Cutaway Illustration
  • Contour Drawing
  • Good photographs.
  • Map Drawing
  • Painting
Saturday, February 27, 2010
slide-59
SLIDE 59

Goal

http://www.cs.princeton.edu/gfx/pubs/Cole_2008_WDP/index.php Saturday, February 27, 2010
slide-60
SLIDE 60

Contours

n(p)·v(p) = 0 (

Saturday, February 27, 2010
slide-61
SLIDE 61

Suggestive Contours

n(p)·v(p) =

min

Saturday, February 27, 2010
slide-62
SLIDE 62

Examples

Suggestive Contours for Conveying Shape

Doug DeCarlo1 Adam Finkelstein2 Szymon Rusinkiewicz2 Anthony Santella1 Saturday, February 27, 2010
slide-63
SLIDE 63

More Examples

Where Do People Draw Lines? Forrester Cole, Aleksey Golovinskiy, Alex Limpaecher, Heather Stoddart Barros, Adam Finkelstein, Thomas Funkhouser, and Szymon Rusinkiewicz Saturday, February 27, 2010
slide-64
SLIDE 64

Outline

  • Visualization
  • Non-photorealistic Rendering
  • Cutaway Illustration
  • Contour Drawing
  • Good photographs.
  • Map Drawing
  • Painting
Saturday, February 27, 2010
slide-65
SLIDE 65

Goal

Saturday, February 27, 2010
slide-66
SLIDE 66

Problem

Saturday, February 27, 2010
slide-67
SLIDE 67

Idea

Figure 1

Saturday, February 27, 2010
slide-68
SLIDE 68

Example

Saturday, February 27, 2010
slide-69
SLIDE 69

Outline

  • Visualization
  • Non-photorealistic Rendering
  • Cutaway Illustration
  • Contour Drawing
  • Good photographs.
  • Map Drawing
  • Painting
Saturday, February 27, 2010
slide-70
SLIDE 70

Goal

Saturday, February 27, 2010
slide-71
SLIDE 71

Reality

Saturday, February 27, 2010
slide-72
SLIDE 72

Demo

Map Blast

Saturday, February 27, 2010
slide-73
SLIDE 73

Algorithm

(a) false intersections (b) missing intersections (c) inconsistent turn direction (d) overall route shape

  • riginal route

length angle shape N/A N/A

Rendering Effective Route Maps: Improving Usability Through Generalization

Maneesh Agrawala Chris Stolte Saturday, February 27, 2010
slide-74
SLIDE 74

Outline

  • Visualization
  • Non-photorealistic Rendering
  • Cutaway Illustration
  • Contour Drawing
  • Good photographs.
  • Map Drawing
  • Painting
Saturday, February 27, 2010
slide-75
SLIDE 75

Goal

Saturday, February 27, 2010
slide-76
SLIDE 76

Example

Impressionist

Saturday, February 27, 2010
slide-77
SLIDE 77

Example

Saturday, February 27, 2010
slide-78
SLIDE 78

Next Class

  • Exam Review!
Saturday, February 27, 2010