The Graphics Pipeline Steve Marschner CS 4620 Cornell University Cornell CS4620 Fall 2020 Steve Marschner • 1
Two approaches to rendering Cornell CS4620 Fall 2020 Steve Marschner • 2
Two approaches to rendering for each object in the scene { for each pixel in the image { if (object affects pixel) { do something } } } object order or rasterization Cornell CS4620 Fall 2020 Steve Marschner • 2
Two approaches to rendering for each object in the scene { for each pixel in the image { for each pixel in the image { for each object in the scene { if (object affects pixel) { if (object affects pixel) { do something do something } } } } } } object order image order or or rasterization ray tracing Cornell CS4620 Fall 2020 Steve Marschner • 2
Two approaches to rendering for each object in the scene { for each pixel in the image { for each pixel in the image { for each object in the scene { if (object affects pixel) { if (object affects pixel) { do something do something } } We did this first } } } } object order image order or or rasterization ray tracing Cornell CS4620 Fall 2020 Steve Marschner • 2
Two approaches to rendering for each object in the scene { for each pixel in the image { for each pixel in the image { for each object in the scene { if (object affects pixel) { if (object affects pixel) { do something do something } } We’ll do this now We did this first } } } } object order image order or or rasterization ray tracing Cornell CS4620 Fall 2020 Steve Marschner • 2
Overview • Standard sequence of transformations – efficiently move triangles to where they belong on the screen • Rasterization – how triangles are converted to fragments • Hidden surface removal – efficiently getting the right surface in front • Graphics pipeline – the efficient parallel implementation of object-order graphics Cornell CS4620 Fall 2020 Steve Marschner • 3
The Graphics Pipeline 1. A standard sequence of transformations Cornell CS4620 Fall 2020 Steve Marschner • 4
object space eye space screen space viewing projection modeling viewport transformation transformation transformation transformation normalized world space device coordinates Cornell CS4620 Fall 2020 Steve Marschner • 5
Demo Perspective viewing Cornell CS4620 Fall 2020 Steve Marschner • 6
The Graphics Pipeline 2. Rasterization Cornell CS4620 Fall 2020 Steve Marschner • 7
Rasterization • First job: enumerate the pixels covered by a primitive – simple definition: pixels whose centers fall inside • Second job: interpolate values across the primitive – e.g. colors computed at vertices – e.g. normals at vertices – e.g. texture coordinates Cornell CS4620 Fall 2020 Steve Marschner • 8
Rasterizing triangles • Input: – three 2D points (the triangle’s vertices in pixel space) – ( x 0 , y 0 ); ( x 1 , y 1 ); ( x 2 , y 2 ) – parameter values at each vertex • q 00 , …, q 0 n ; q 10 , …, q 1 n ; q 20 , …, q 2 n • Output: a list of fragments, each with – the integer pixel coordinates ( x , y ) – interpolated parameter values q 0 , …, q n Cornell CS4620 Fall 2020 Steve Marschner • 9
Rasterizing triangles • Summary 1 evaluation of linear functions on pixel grid 2 functions defined by parameter values at vertices 3 using extra parameters to determine fragment set Cornell CS4620 Fall 2020 Steve Marschner • 10
Incremental linear evaluation • A linear (affine, really) function on the plane is: • Linear functions are efficient to evaluate on a grid: Cornell CS4620 Fall 2020 Steve Marschner • 11
Incremental linear evaluation linEval(xm, xM, ym, yM, cx, cy, ck) { // setup qRow = cx*xm + cy*ym + ck; // traversal for y = ym to yM { qPix = qRow; for x = xm to xM { output(x, y, qPix); qPix += cx; } qRow += cy; } } c x = .005 ; c y = .005 ; c k = 0 (image size 100x100) Cornell CS4620 Fall 2020 Steve Marschner • 12
Rasterizing triangles • Summary 1 evaluation of linear functions on pixel grid 2 functions defined by parameter values at vertices 3 using extra parameters to determine fragment set Cornell CS4620 Fall 2020 Steve Marschner • 13
Defining parameter functions • To interpolate parameters across a triangle we need to find the c x , c y , and c k that define the (unique) linear function that matches the given values at all 3 vertices – this is 3 constraints on 3 unknown coefficients: (each states that the function agrees with the given value at one vertex) – leading to a 3x3 matrix equation for the coefficients: (singular iff triangle is degenerate) Cornell CS4620 Fall 2020 Steve Marschner • 14
Defining parameter functions • More efficient version: shift origin to ( x 0 , y 0 ) q ( x, y ) = c x ( x − x 0 ) + c y ( y − y 0 ) + q 0 q ( x 1 , y 1 ) = c x ( x 1 − x 0 ) + c y ( y 1 − y 0 ) + q 0 = q 1 q ( x 2 , y 2 ) = c x ( x 2 − x 0 ) + c y ( y 2 − y 0 ) + q 0 = q 2 – now this is a 2x2 linear system (since falls out): q 0 – solve using Cramer’s rule (see textbook): Cornell CS4620 Fall 2020 Steve Marschner • 15
Defining parameter functions linInterp(xm, xM, ym, yM, x0, y0, q0, x1, y1, q1, x2, y2, q2) { // setup q = 1 q = 0 det = (x1–x0)*(y2–y0) – (x2–x0)*(y1–y0); cx = ((q1–q0)*(y2–y0) – (q2–q0)*(y1–y0)) / det; cy = ((q2–q0)*(x1–x0) – (q1–q0)*(x2–x0)) / det; qRow = cx*(xm–x0) + cy*(ym–y0) + q0; // traversal (same as before) for y = ym to yM { qPix = qRow; for x = xm to xM { output(x, y, qPix); qPix += cx; q = 0 } qRow += cy; } } Cornell CS4620 Fall 2020 Steve Marschner • 16
Interpolating several parameters linInterp(xm, xM, ym, yM, n, x0, y0, q0[], x1, y1, q1[], x2, y2, q2[]) { // setup for k in 0 to n // compute cx[k], cy[k], qRow[k] // from q0[k], q1[k], q2[k] // traversal for y = ym to yM { for k = 0 to n, qPix[k] = qRow[k]; for x = xm to xM { output(x, y, qPix); for k = 0 to n, qPix[k] += cx[k]; } for k = 0 to n, qRow[k] += cy[k]; } } Cornell CS4620 Fall 2020 Steve Marschner • 17
Rasterizing triangles • Summary 1 evaluation of linear functions on pixel grid 2 functions defined by parameter values at vertices 3 using extra parameters to determine fragment set Cornell CS4620 Fall 2020 Steve Marschner • 18
Clipping to the triangle • Interpolate three barycentric coordinates across the plane – recall each barycentric coord is 1 at one vert. and 0 at the other two • Output fragments only when all three are > 0. Cornell CS4620 Fall 2020 Steve Marschner • 19
Pixel-walk (Pineda) rasterization • Conservatively visit a superset of the pixels you want • Interpolate linear functions • Use those functions to determine when to emit a fragment Cornell CS4620 Fall 2020 Steve Marschner • 20
Clipping • Rasterizer tends to assume triangles are on screen – particularly problematic to have triangles crossing the plane z = 0 • After projection, before perspective divide – clip against the planes x/w , y/w , z/w = 1 , –1 (6 planes) – primitive operation: clip triangle against axis-aligned plane Cornell CS4620 Fall 2020 Steve Marschner • 21
Clipping a triangle against a plane • 4 cases, based on sidedness of vertices – all in (keep) – all out (discard) – one in, two out (one clipped triangle) – two in, one out (two clipped triangles) Cornell CS4620 Fall 2020 Steve Marschner • 22
Rasterizing triangles: edge cases • Exercise caution with rounding and arbitrary decisions – need to visit these pixels once – but it’s important not to visit them twice! Cornell CS4620 Fall 2020 Steve Marschner • 23
The Graphics Pipeline 3. Hidden surface removal Cornell CS4620 Fall 2020 Steve Marschner • 24
Hidden surface elimination • We have discussed how to map primitives to image space – projection and perspective are depth cues – occlusion is another very important cue Cornell CS4620 Fall 2020 Steve Marschner • 25
Back face culling • For closed shapes you will never see the inside – therefore only draw surfaces that face the camera – implement by checking n . v Cornell CS4620 Fall 2020 Steve Marschner • 26
Back face culling • For closed shapes you will never see the inside – therefore only draw surfaces that face the camera – implement by checking n . v Cornell CS4620 Fall 2020 Steve Marschner • 26
Back face culling • For closed shapes you will never see the inside – therefore only draw surfaces that face the camera – implement by checking n . v Cornell CS4620 Fall 2020 Steve Marschner • 26
Back face culling • For closed shapes you will never see the inside – therefore only draw surfaces that face the camera – implement by checking n . v n v n v Cornell CS4620 Fall 2020 Steve Marschner • 26
Painter’s algorithm • Simplest way to do hidden surfaces • Draw from back to front, use overwriting in framebuffer Cornell CS4620 Fall 2020 Steve Marschner • 27
Painter’s algorithm • Simplest way to do hidden surfaces • Draw from back to front, use overwriting in framebuffer Cornell CS4620 Fall 2020 Steve Marschner • 27
Recommend
More recommend
