CS 327E Class 12 December 2, 2019 Announcements CIS Survey: Your - - PowerPoint PPT Presentation

▶
cs 327e class 12
SMART_READER_LITE
LIVE PREVIEW

CS 327E Class 12 December 2, 2019 Announcements CIS Survey: Your - - PowerPoint PPT Presentation

Mar 21, 2023 203 likes •350 views

CS 327E Class 12 December 2, 2019 Announcements CIS Survey: Your voice matters . Milestone 12: Presentation Schedule GCP credits: check your balance and request second coupon if needed. 1) What infrastructure components does

slide-1
SLIDE 1

CS 327E Class 12

December 2, 2019

slide-2
SLIDE 2

Announcements

  • CIS Survey: Your voice matters.
  • Milestone 12: Presentation Schedule
  • GCP credits: check your balance and request second coupon if needed.
slide-3
SLIDE 3

1) What infrastructure components does BigQuery depend on?

A. Colossus B. Borg C. Jupiter D. All of the above

slide-4
SLIDE 4

2) What do the authors mean by "BigQuery is truly a serverless database"?

A. BigQuery is simple to use B. BigQuery is a front-end app C. BigQuery only needs a small amount of compute

slide-5
SLIDE 5

3) What component orchestrates a BigQuery query?

A. Airflow B. Composer C. Dremel D. Colossus

slide-6
SLIDE 6

Query Plan Example

slide-7
SLIDE 7

4) What type of file format does BigQuery use to store its records?

A. Row-oriented file format B. Column-oriented file format C. Parquet

slide-8
SLIDE 8

Row-oriented file format

2019-12-01 6252012 ab123xy 209.99 RECEIVED 2019-12-01 2019-12-01 2019-12-01

  • rder_date
  • rder_no

7651095 2430289 0823012

cust_id amount_paid

  • rder_status

gb773az 1bb83qz keb9129 1000.20 59.10 9.99 SHIPPED IN_TRANSIT FULFILLED

slide-9
SLIDE 9

Column-oriented file format

2019-12-01 6252012 ab123xy 209.99 RECEIVED 2019-12-01 2019-12-01 2019-12-01

  • rder_date
  • rder_no

7651095 2430289 0823012

cust_id amount_paid

  • rder_status

gb773az 1bb83qz keb9129 1000.20 59.10 9.99 SHIPPED IN_TRANSIT FULFILLED

slide-10
SLIDE 10

5) What type(s) of failures does Borg protect BigQuery from?

A. Machine failures B. Disk failures C. Network failures D. All of the above

slide-11
SLIDE 11

Hands-on Exercise

git clone https://github.com/cs327e-fall2019/snippets.git

  • r

git pull origin master to pull down the latest code 5 Relevant Files: 01_college_workflow.py + 02_college_workflow.py Student_single.py + Student_cluster.py + Takes_single.py

slide-12
SLIDE 12

Practice Problem

Run and fix 02_college_workflow.py

slide-13
SLIDE 13

Practice Problem

Run and fix 02_college_workflow.py

What was the cause of the error? A. Syntax error B. Logic error C. All of the above