Low-Level Visual Abstractions User-Centric Scientific Visualization - - PowerPoint PPT Presentation

Stefan Bruckner

Low-Level Visual Abstractions User-Centric Scientific Visualization

Illustrative Visualization Definition: computer supported interactive and expressive visualizations of complex data through abstractions from traditional illustrations

2

Low-Level Abstraction Techniques Concerned with how different objects are presented Stylized depiction

Silhouettes and contours, pen and ink, stippling, hatching, ...

3

Media and Styles in Illustration

4

Non-Photorealistic Rendering

Definition: Computer-generated stylized depiction of the 3D synthetic scene or a real-world 2D capture.

5

[Lum and Ma 2002]

Shading Setup

6

Phong Local Illumination Model

7

Toon Shading

8

Shading Textures

9 Stefan Bruckner

Phong-Blinn shading contour enhancement cartoon shading metal shading

Cool-to-Warm Shading

10

[Gooch et al. 1998]

Exaggerated Shading

11

[Rusinkiewicz et al. 2006]

12

Geometry-Dependent Lighting

[Lee et al. 2005]

Lit Sphere Style Transfer

13

[Sloan et al. 2001]

Lit Sphere Concept Use a sphere map indexed by the eye-space normal to determine the color of a point

14

[Sloan et al. 2001]

Style Transfer Functions

15

Style Transfer Functions

16

[Bruckner and Groeller 2007]

Stylization and Abstraction of Photographs

17

[DeCarlo and Santella2002]

Smoothing Filter

1 1 1 1 1 1 1 1 1

18

1 2 1 2 4 2 1 2 1

Mean Filter Gaussian Filter

Edge-Detectors Filter

19

1 1 1 1

• 8

1 1 1 1

• 1

1

• 2

2

• 1

1

Laplacian Filter Sobel Filter

Bilateral Filter

20

[Tomasi and Manduchi 1998]

Stylization and Abstraction of Photographs

21

[DeCarlo and Santella2002]

Flow-Based Image Abstraction

22

[Kang et al. 2009]

Line-Integral Convolution Image Abstraction

23

[Kyprianidis and Kang 2011]

Line Drawing

24

Silhouette Extraction in Image Space Generated from the Depth map (Z-Buffer) Detect C0 surface discontinuities

25

[Hertzmann et al. 1999]

Inner Contour Extraction in Image Space Generated from the Normal map Detect C1 surface discontinuities

26

[Hertzmann et al. 1999]

Contour Composition in Image Space Combination Depth + Normal map

27

[Hertzmann et al. 1999]

Contour Extraction in Object Space

28

Gradient ∇ computed by a first-order derivative filter (Central Differences, Sobel) Gradient ∇ approximates normal vector of implicit surface N = -∇ / │∇│ contour= g(│∇│)(1-|N.V|)e V = view vector e = exponent determines silhouette range

[Csebfalvi et al. 2001] [Ebert and Rheingans 2000]

Outline Extraction for Volumes

Exponent between 4 and 16 is good choice

exponent too low!

29

[Hadwiger et al. 2006]

Gradient computation

30

• 1

1

• 1

1

• 2

2

• 1

1

Sobel Filter Central Differences

Problems of Implicit Surface Contours

Constant threshold on Thickness changes!

31

[Hadwiger et al. 2006]

Curvature: Second-Order Derivative How do small positional changes on the surface change the normal vector? “derivative” of normal Normal curvature in a direction First and second principal curvature: maximum: minimum: Obtained through eigenanalysis:

Characteristic equation Curvature directions Curvature magnitudes

32

[Kindlmann et al. 2003]

Curvature Computation Build on consecutive forward-backward differences to obtain Hessian matrix H Hessian contains curvature information N = -Δ f H = ∇ NT Curvature magnitudes: eigenvalues of 3x3 matrix Curvature directions: eigenvectors of 3x3 matrix

n

33

[Kindlmann et al. 2003]

Hessian Matrix Computation

34

• 1 1 0
• 2 2 0
• 1 1 0

0 -1 1 0 -2 2 0 -1 1

Eigenvalues & -vectors Computation

35

H v = λ v (H − λI )v = 0 det (H − λI) = 0

The Principal Curvature Domain

Maximum/minimum principal curvature magnitude Identification of different shapes in 2D domain Elliptical, parabolic, hyperbolic, umbilical points Feature lines: e.g., ridges and valleys

36

[Kindlmann et al. 2003]

Curvature Transfer Functions Color coding of curvature domain Paint features: ridge and valley lines

Def: locations of max curvature

37

[Kindlmann et al. 2003]

Curvature-Based Contour Threshold

Higher curvature in view direction needs higher threshold

38

[Kindlmann et al. 2003]

Curvature-Based Contour Threshold

Threshold dependent on curvature in view direction Thickness constant!

39

[Kindlmann et al. 2003]

Curvature-Based Light Warping

Ivan Viola

40

[Vergne et al. 2009]

Suggestive Contours

41

[DeCarlo et al. 2003]

Suggestive Contour Definition Almost contours: The suggestive contour generator is the set of minima of N.V in the direction of W

42

[DeCarlo et al. 2003]

Apparent Ridges Draw lines at rapid variation of normal with respect to the image position Aparent Ridge: loci of points that maximize view dependent curvature

43

[Judd et al. 2007]

Aparent Ridges vs Ridges

44

Stippling

45

[Secord 2002]

3D Texture-Based Stippling

46

[Krueger and Westermann 2007]

Conveying 3D Shape with Principal Curvature

47

[Interrante et al. 1998]

Hatching

48

Contour generation Contour extraction spline generation Set of aligned brush strokes applied to a spline Hatching Distribution function: evenly spaced streamlines Vectorfield is defined by principal curvature directions Stroke length is defined by shading intensity Multi-scale strokes

[Gerl 2006]

Thanks

Ivan Viola Meister Gröller Dough DeCarlo Adrian Secord Kevin Hulsey Mario Costa Sousa Eric Lum Amy and Bruce Gooch Gordon Kindlmann Markus Hadwiger Jiri Hladuvka Balazs Csebfalvi Tilke Judd Peter-Pike Sloan Moritz Gerl Takafumi Saito Anna Vilanova Jens Krüger Vittoria Interrante Romain Vergne Henry Kang and many others!

49

Slides have been compiled using slides, videos, images, and ideas from:

References

[www.khulsey.com] K. Hulsey, Hand-crafted illustration webpage, www.khulsey.com [Lum and Ma 2002] E. Lum and K.-L. Ma, Hardware-Accelerated Parallel Non-Photorealistic Volume Rendering, NPAR 2002 [Gooch et al. 1998] A. Gooch et al., A Non-Photorealistic Lighting Model for Automatic Technical Illustration, SIGGRAPH 1998 [Rusinkiewicz et al. 2006] S. Rusinkiewicz et al., Exaggerated Shading for Depicting Shape and Detail, SIGGRAPH 2006 [Lee et al. 2005] C. H. Lee et al., Light Collages: Lighting Design for Effective Visualization, IEEE Visualization 2004 [Vergne et al. 2009] R. Vergne et al. Light warping for enhanced surface depiction. ACM SIGGRAPH 2009 [Sloan et al. 2001] P. Sloan et al., The Lit Sphere: A Model for Capturing NPR Shading from Art, Graphics Interface 2001 [Bruckner and Groeller 2007] S. Bruckner and M. E. Groeller, Style Transfer Functions for Illustrative Volume Rendering, Eurographics2007 [Secord 2002] A. Secord, Weighted Voronoi Stippling, NPAR 2002 [Krueger and Westermann 2007] J. Krüger, R. Westermann, Efficient Stipple Rendering, IADIS Computer Graphics and Visualization 2007 [Interrante et al. 1998] V. Interrante et al., Conveying the 3D Shape of Smoothly Curving Transparent Surfaces via Texture, IEEE TVCG 1998 [Gerl 2006] M. Gerl, Volume Hatching for Illustrative Visualization, Master Thesis 2006 [DeCarlo and Santella2002] D. DeCarlo and A. Santella, Stylization and Abstraction of Photographs, SIGGRAPH 2002 [Tomasi and Manduchi 1998] C. Tomasi and R. Manduchi, Bilateral Filtering for Gray and Color Images, IEEE ICCV 1998 [Winnemoeller et al. 2006] H. Winnemoeller et al., Real-time Video Abstraction, SIGGRAPH 2006 [Kang et al. 2009] H. Kang et al. Flow-Based Image Abstraction, IEEE TVCG 2009 [Kyprianidis and Kang 2011] J. Kyprianidis and H.Kang, Image and Video Abstraction by Coherence-Enhancing Filtering, Eurographics 2011 [Hertzmann et al. 1999] A. Hertzmann et al., Introduction to 3D Non-Photorealistic Rendering: Silhouettes and Outlines, Course on Non- Photorealistic Rendering, SIGGRAPH 1999 [Csebfalvi et al. 2001] B. Csebfalvi et al., Fast Visualization of Object Contours by Non-Photorealistic Volume Rendering, Eurographics 2001 [Ebert and Rheingans 2000] David Ebert Penny Rheingans, Volume Illustration: Non-Photorealistic Rendering of Volume Models, IEEE Visualization 2000 [Hadwiger et al. 2006] Non-Photorealistic and Illustrative Techniques, Real-Time Volume Graphics Tutorial (www.real-time-volume- graphics.org), Eurographics2006 [Kindlmann et al 2003] G. Kindlmann et al., Curvature-Based Transfer Functions for Direct Volume Rendering: Methods and Applications, IEEE Visualization 2003 [DeCarlo et al. 2003] D. DeCarlo et al., Suggestive Contours for Conveying Shape, SIGGRAPH 2003 [Judd et al. 2007] T. Judd et al., Apparent Ridges for Line Drawings, SIGGRAPH 2007 50

Books on Non-Photorealistic Rendering

51