designing for discovery in the era of data intensive
play

DESIGNING FOR DISCOVERY IN THE ERA OF DATA-INTENSIVE ASTRONOMY Sarah - PowerPoint PPT Presentation

Jun 23, 2023 •261 likes •1.42k views

DESIGNING FOR DISCOVERY IN THE ERA OF DATA-INTENSIVE ASTRONOMY Sarah Hegarty with A/Prof Christopher Fluke, Dr Aidan Hotan (CSIRO), & Dr Amr Hassan (Monash) Melbourne University | August 29th, 2018 Making Discoveries in Astronomy

  1. The Discovery Workflow Telescopes + Data Reduction Data Analysis (aka “thinking”) Compare with models, other = data, and publish Contextualise, and debate with colleagues Adapted from Norris (2010) Sarah Hegarty | Melbourne University | August 29th, 2018

  2. The Discovery Workflow Telescopes Data + Information Data Reduction Data Analysis Knowledge (aka “thinking”) Compare with models, other = Understanding data, and publish Contextualise, and debate with Wisdom colleagues Adapted from Norris (2010) Sarah Hegarty | Melbourne University | August 29th, 2018

  3. The Discovery Workflow Telescopes Data + Information Data Reduction Data Analysis New Knowledge (aka “thinking”) Compare with models, other = New Understanding data, and publish Contextualise, and debate with New Wisdom colleagues Adapted from Norris (2010) Sarah Hegarty | Melbourne University | August 29th, 2018

  4. What Do We Know About Making Discoveries in Astronomy? Sarah Hegarty | Melbourne University | August 29th, 2018

  5. What Do We Know About Making Discoveries in Astronomy? Discoveries strongly follow technological developments that ● open up new parameter space Sarah Hegarty | Melbourne University | August 29th, 2018

  6. What Do We Know About Making Discoveries in Astronomy? Discoveries strongly follow technological developments that ● open up new parameter space Many of the most exciting discoveries are serendipitous ● Sarah Hegarty | Melbourne University | August 29th, 2018

  7. What Do We Know About Making Discoveries in Astronomy? Discoveries strongly follow technological developments that ● open up new parameter space Many of the most exciting discoveries are serendipitous ● Visual inspection of the data can be invaluable ● Sarah Hegarty | Melbourne University | August 29th, 2018

  8. What Do We Know About Making Discoveries in Astronomy? Discoveries strongly follow technological developments that ● open up new parameter space Many of the most exciting discoveries are serendipitous ● Visual inspection of the data can be invaluable ● Individual expertise, and familiarity with the data and the ● instrument, are crucial in recognising something new Sarah Hegarty | Melbourne University | August 29th, 2018

  9. What Do We Know About Making Discoveries in Astronomy? Discoveries strongly follow technological developments that ● open up new parameter space Many of the most exciting discoveries are serendipitous ● Visual inspection of the data can be invaluable ● Individual expertise, and familiarity with the data and the ● instrument, are crucial in recognising something new → Developing this expertise through training is key Sarah Hegarty | Melbourne University | August 29th, 2018

  10. What Do We Know About Making Discoveries in Astronomy? Discoveries strongly follow technological developments that ● open up new parameter space Many of the most exciting discoveries are serendipitous ● Visual inspection of the data can be invaluable ● Individual expertise, and familiarity with the data and the ● instrument, are crucial in recognising something new → Developing this expertise through training is key ● Discoveries are the end result of effective workflows Sarah Hegarty | Melbourne University | August 29th, 2018

  11. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  12. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  13. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  14. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  15. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  16. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  17. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● ~20Tb/night Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  18. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● ~20Tb/night Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  19. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● ~20Tb/night Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  20. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● ~20Tb/night Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  21. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● ~20Tb/night Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  22. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● ~20Tb/night Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  23. What Do We Know About Making Discoveries in Astronomy? Planning Discoveries strongly follow technological developments that ● Technological open up new parameter space Development Training Many of the most exciting discoveries are serendipitous ● + Visual inspection of the data can be invaluable ● ~20Tb/night Individual expertise, and familiarity with the data and the Expertise ● instrument, are crucial in recognising something new → Developing this expertise through training is key = ● Discoveries are the end result of effective workflows Visualisation Serendipity capabilities Sarah Hegarty | Melbourne University | August 29th, 2018

  24. How can we capitalise on the discovery potential of data-intensive astronomy? → Understand how we make discoveries Sarah Hegarty | Melbourne University | August 29th, 2018

  25. How can we capitalise on the discovery potential of data-intensive astronomy? → Understand how we make discoveries → Use this understanding to “design in” discovery when we build data-intensive workflows Sarah Hegarty | Melbourne University | August 29th, 2018

  26. Designing Effective Discovery Workflows Automated pipelines and machine-learning approaches are essential for data-intensive astronomy but We must integrate a role for the human astronomer alongside automated methods to maintain discovery mechanisms that we know to be important Manual Inspection 60% 40% 0% 100% 80% 20% 0% 20% 60% 40% 80% 100% Automated Inspection Fine-tune to maximise discovery Adapted from Fluke et al. (2016) Sarah Hegarty | Melbourne University | August 29th, 2018

  27. Responding to the Data-Intensive Discovery Challenge Director: A/Prof Christopher Fluke Sarah Hegarty | Melbourne University | August 29th, 2018

  28. Responding to the Data-Intensive Discovery Challenge Director: A/Prof Christopher Fluke Sarah Hegarty | Melbourne University | August 29th, 2018

  29. Responding to the Data-Intensive Discovery Challenge Sarah Hegarty | Melbourne University | August 29th, 2018

  30. Responding to the Data-Intensive Discovery Challenge Designing Out Data Artefacts: Better Beamforming for ASKAP Sarah Hegarty | Melbourne University | August 29th, 2018

  31. Responding to the Data-Intensive Discovery Challenge Designing Out Data Artefacts: Building eResearch Workflows: Better Beamforming for ASKAP Theoretical Astrophysical Observatory and: Deeper, Wider, Faster Sarah Hegarty | Melbourne University | August 29th, 2018

  32. Responding to the Data-Intensive Discovery Challenge Understanding the Astronomer’s Role: Designing Out Data Artefacts: Building eResearch Workflows: Better Beamforming for ASKAP PerSieve Theoretical Astrophysical Observatory and: Deeper, Wider, Faster Sarah Hegarty | Melbourne University | August 29th, 2018

  33. A Case Study: Deeper, Wider, Faster A detection and follow-up program for fast transients (Cooke+, in prep.) Sarah Hegarty | Melbourne University | August 29th, 2018

  34. A Case Study: Deeper, Wider, Faster A detection and follow-up program for fast transients (Cooke+, in prep.) Nugent, 2015 Sarah Hegarty | Melbourne University | August 29th, 2018

  35. A Case Study: Deeper, Wider, Faster A detection and follow-up program for fast transients (Cooke+, in prep.) Targets transients on timescales from ❏ hours down to seconds Nugent, 2015 Sarah Hegarty | Melbourne University | August 29th, 2018

  36. A Case Study: Deeper, Wider, Faster A detection and follow-up program for fast transients (Cooke+, in prep.) Targets transients on timescales from ❏ hours down to seconds Aims to achieve real-time, ❏ multiwavelength observations, and rapid multiwavelength follow up Nugent, 2015 Sarah Hegarty | Melbourne University | August 29th, 2018

  37. A Case Study: Deeper, Wider, Faster A detection and follow-up program for fast transients (Cooke+, in prep.) Targets transients on timescales from ❏ hours down to seconds Aims to achieve real-time, ❏ multiwavelength observations, and rapid multiwavelength follow up Courtesy J. Cooke Sarah Hegarty | Melbourne University | August 29th, 2018

  38. A Case Study: Deeper, Wider, Faster A detection and follow-up program for fast transients (Cooke+, in prep.) Targets transients on timescales from ❏ hours down to seconds Aims to achieve real-time, ❏ multiwavelength observations, and rapid multiwavelength follow up Courtesy J. Cooke Sarah Hegarty | Melbourne University | August 29th, 2018

  39. A Case Study: Deeper, Wider, Faster Andreoni & Cooke, 2018 Sarah Hegarty | Melbourne University | August 29th, 2018

  40. A Case Study: Deeper, Wider, Faster Figure: Meade+, 2017 Sarah Hegarty | Melbourne University | August 29th, 2018

  41. A Case Study: Deeper, Wider, Faster 3 square degree FOV ~60 CCD images / 40 seconds 2048 x 4096 pixels each Figure: Meade+, 2017 Sarah Hegarty | Melbourne University | August 29th, 2018

  42. A Case Study: Deeper, Wider, Faster 3 square degree FOV ~60 CCD images / 40 seconds JPEG2000 data compression 2048 x 4096 pixels each (Vohl+, 2017) Figure: Meade+, 2017 Sarah Hegarty | Melbourne University | August 29th, 2018

  43. A Case Study: Deeper, Wider, Faster 3 square degree FOV ~60 CCD images / 40 seconds JPEG2000 data compression ‘Mary’ data reduction 2048 x 4096 pixels each (Vohl+, 2017) pipeline (Andreoni+, 2017) Figure: Meade+, 2017 Sarah Hegarty | Melbourne University | August 29th, 2018

  44. A Case Study: Deeper, Wider, Faster Andreoni+, 2017 Sarah Hegarty | Melbourne University | August 29th, 2018

  45. A Case Study: Deeper, Wider, Faster Visual inspection by 3 square degree FOV volunteer astronomers ~60 CCD images / 40 seconds JPEG2000 data compression ‘Mary’ data reduction 2048 x 4096 pixels each (Vohl+, 2017) pipeline (Andreoni+, 2017) Figure: Meade+, 2017 Sarah Hegarty | Melbourne University | August 29th, 2018

  46. A Case Study: Deeper, Wider, Faster Meade+, 2017 Sarah Hegarty | Melbourne University | August 29th, 2018

  47. A Case Study: Deeper, Wider, Faster Photos courtesy B. Meade Sarah Hegarty | Melbourne University | August 29th, 2018

  48. A Case Study: Deeper, Wider, Faster Integrating the visualisation, analysis and assessment work of volunteer astronomers as part of the DWF workflow would allow us to: Photos courtesy B. Meade Sarah Hegarty | Melbourne University | August 29th, 2018

  49. A Case Study: Deeper, Wider, Faster Integrating the visualisation, analysis and assessment work of volunteer astronomers as part of the DWF workflow would allow us to: Continue capitalising on the expertise and crucial discovery skills of these astronomers ❏ Photos courtesy B. Meade Sarah Hegarty | Melbourne University | August 29th, 2018

  50. A Case Study: Deeper, Wider, Faster Integrating the visualisation, analysis and assessment work of volunteer astronomers as part of the DWF workflow would allow us to: Continue capitalising on the expertise and crucial discovery skills of these astronomers ❏ Simplify and streamline the discovery workflow, and remove margin for error ❏ Photos courtesy B. Meade Sarah Hegarty | Melbourne University | August 29th, 2018

  51. A Case Study: Deeper, Wider, Faster Integrating the visualisation, analysis and assessment work of volunteer astronomers as part of the DWF workflow would allow us to: Continue capitalising on the expertise and crucial discovery skills of these astronomers ❏ Simplify and streamline the discovery workflow, and remove margin for error ❏ Better understand the discovery process itself ❏ Photos courtesy B. Meade Sarah Hegarty | Melbourne University | August 29th, 2018

  52. A Case Study: Deeper, Wider, Faster Andreoni+, 2017 Sarah Hegarty | Melbourne University | August 29th, 2018

  53. PerSieve Sarah Hegarty | Melbourne University | August 29th, 2018

  54. PerSieve An application for interactive visualisation and assessment - in real time, in the browser ❏ Sarah Hegarty | Melbourne University | August 29th, 2018

  55. PerSieve An application for interactive visualisation and assessment - in real time, in the browser ❏ Integrates visualisation and the human astronomer into DWF’s automated pipeline ❏ Sarah Hegarty | Melbourne University | August 29th, 2018

  56. PerSieve An application for interactive visualisation and assessment - in real time, in the browser ❏ Integrates visualisation and the human astronomer into DWF’s automated pipeline ❏ Sarah Hegarty | Melbourne University | August 29th, 2018

  57. February 2018 DWF Observing Campaign During a four-night, Subaru-led DWF observing campaign, PerSieve was used successfully as ❏ the primary visualisation and analysis tool Sarah Hegarty | Melbourne University | August 29th, 2018

  58. February 2018 DWF Observing Campaign During a four-night, Subaru-led DWF observing campaign, PerSieve was used successfully as ❏ the primary visualisation and analysis tool Over 30 astronomers participated on-site ❏ Sarah Hegarty | Melbourne University | August 29th, 2018

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Topics The Scientific Data Deluge Data-Intensive Scientific Discovery NSF OCI Data/Viz Task

Topics The Scientific Data Deluge Data-Intensive Scientific Discovery NSF OCI Data/Viz Task

Topics The Scientific Data Deluge Data-Intensive Scientific Discovery NSF OCI Data/Viz Task Force Report Sharing Research Data Reproducible Research Supporting the Data Life Cycle The Future? Topics The Scientific Data Deluge

1.17k views • 52 slides
The Moore/Sloan Data Science Environments: Advancing Data-Intensive

The Moore/Sloan Data Science Environments: Advancing Data-Intensive

The Moore/Sloan Data Science Environments: Advancing Data-Intensive Discovery Ed Lazowska Bill & Melinda Gates Chair in Computer Science & Engineering

1.03k views • 58 slides
Data-Intensive Workfmows A journey to a Holistjc Framework for Data-Intensive Workfmows Ian

Data-Intensive Workfmows A journey to a Holistjc Framework for Data-Intensive Workfmows Ian

Data-Intensive Workfmows A journey to a Holistjc Framework for Data-Intensive Workfmows Ian Corner Design and Implementatjon Lead May 2016 INFORMATION MANAGEMENT AND TECHNOLOGY (IMT) CSIRO Data-Intensive Workfmows Holistjc

919 views • 61 slides
Turning Data Into Business Value Qwertee 101: Finding Your Next Data Partner Data-Intensive

Turning Data Into Business Value Qwertee 101: Finding Your Next Data Partner Data-Intensive

Turning Data Into Business Value Qwertee 101: Finding Your Next Data Partner Data-Intensive Software Services We cover the full scope of data-intensive application development. From data engineering, machine learning to production-ready cloud

212 views • 9 slides
Closing in on discovery Through intensive, systematic exploration Fraser Range: Encouraging

Closing in on discovery Through intensive, systematic exploration Fraser Range: Encouraging

ASX Code: ORN Closing in on discovery Through intensive, systematic exploration Fraser Range: Encouraging Ni-Cu-PGE drill results from Peninsula 23 targets defined within the project area, follow up ground work imminent Investor

402 views • 25 slides
What is Advanced Research Computing? Data Supercomputing Computationally Mining Intensive

What is Advanced Research Computing? Data Supercomputing Computationally Mining Intensive

Accelerate Discovery with ACENET www.acceleratediscovery.ca What is Advanced Research Computing? Data Supercomputing Computationally Mining Intensive High Parallel Performance Big Data Storage Computing Computing (HPC) High

399 views • 4 slides
MapReduce Data Intensive Computing Data-intensive computing is a class of parallel

MapReduce Data Intensive Computing Data-intensive computing is a class of parallel

MapReduce Data Intensive Computing Data-intensive computing is a class of parallel computing applications which use a data parallel approach to processing large volumes of data typically terabytes or petabytes in size and typically

1.01k views • 51 slides
and Observational Science The Convergence of Data-Intensive and Compute-Intensive Infrastructure

and Observational Science The Convergence of Data-Intensive and Compute-Intensive Infrastructure

The Revolution in Experimental and Observational Science The Convergence of Data-Intensive and Compute-Intensive Infrastructure Professor Tony Hey Chief Data Scientist STFC tony.hey@stfc.ac.uk The Background X-Info The evolution of

826 views • 60 slides
for Data Intensive Scalable Computing CAP3 Gene Assembly Program Compute intensive

for Data Intensive Scalable Computing CAP3 Gene Assembly Program Compute intensive

Architecture and Performance of Runtime Environments for Data Intensive Scalable Computing CAP3 Gene Assembly Program Compute intensive application Embarrassingly parallel operation All runtimes performs equally well Measured

150 views • 3 slides
Data- Intensive

Data- Intensive

Data- Intensive DISLIB - Member of Graph500 Steering Committee What

475 views • 24 slides
Data-Intensive Research in Education: NSF Initiatives in Big Data and Data Science Chris

Data-Intensive Research in Education: NSF Initiatives in Big Data and Data Science Chris

Data-Intensive Research in Education: NSF Initiatives in Big Data and Data Science Chris Dede Harvard University Chris_Dede@harvard.edu www.gse.harvard.edu/faculty/christopherdede My Current Role in Data-Intensive Research in

1.08k views • 66 slides
Big Data, Big Problem Data-intensive systems are highly complex Manipulate large-scale

Big Data, Big Problem Data-intensive systems are highly complex Manipulate large-scale

Towards Big Data Provenance Daniel Deutch Blavatnik School of Computer Science, Raymond and Beverly Sackler Faculty of Exact Sciences Tel Aviv University cartoon by T. Gregorius Big Data, Big Problem Data-intensive systems are highly

358 views • 6 slides
Data-Intensive Applications on Numerically-Intensive Supercomputers David Daniel / James Ahrens

Data-Intensive Applications on Numerically-Intensive Supercomputers David Daniel / James Ahrens

Data-Intensive Applications on Numerically-Intensive Supercomputers David Daniel / James Ahrens Los Alamos National Laboratory July 2009 Operated by the Los Alamos National Security, LLC for the DOE/NNSA Interactive visualization of a

279 views • 10 slides
CS 245: Principles of Data-Intensive Systems Instructor: Matei Zaharia cs245.stanford.edu

CS 245: Principles of Data-Intensive Systems Instructor: Matei Zaharia cs245.stanford.edu

CS 245: Principles of Data-Intensive Systems Instructor: Matei Zaharia cs245.stanford.edu Outline Why study data-intensive systems? Course logistics Key issues and themes A bit of history CS 245 2 My Background PhD in 2013 Open source

1.1k views • 51 slides
10-08035 LA-UR- Approved for public release; distribution is unlimited. Title: Data-Intensive

10-08035 LA-UR- Approved for public release; distribution is unlimited. Title: Data-Intensive

10-08035 LA-UR- Approved for public release; distribution is unlimited. Title: Data-Intensive Computing on Numerically-Intensive Supercomputers Author(s): Ahrens James P. 113788 CCS-7, Fasel Patricia K. 090207 CCS-3, Habib Salman 109589

875 views • 56 slides
Data-Intensive Distributed Computing 431/631 (Fall 2020) Part 1: Introduction to Big Data Ali

Data-Intensive Distributed Computing 431/631 (Fall 2020) Part 1: Introduction to Big Data Ali

Data-Intensive Distributed Computing 431/631 (Fall 2020) Part 1: Introduction to Big Data Ali Abedi These slides are available at https://www.student.cs.uwaterloo.ca/~cs451/ 1 1 2 3 Big Data 4 Lets see what big data is and where it

778 views • 44 slides
Property Recommendations for all Australians September 2016 Glenn Bunker Data Science Manager

Property Recommendations for all Australians September 2016 Glenn Bunker Data Science Manager

Property Recommendations for all Australians September 2016 Glenn Bunker Data Science Manager Ben Kuai Senior Developer - Data Change the way the world experiences property Change the way the world experiences property Change the way the

380 views • 27 slides
Evaluating Ontological Fit Jaimie Murdock Cameron Buckner Colin Allen The Representation

Evaluating Ontological Fit Jaimie Murdock Cameron Buckner Colin Allen The Representation

Evaluating Ontological Fit Jaimie Murdock Cameron Buckner Colin Allen The Representation Problem What is the best way to encode data? Depends on the data Depends on the purpose Fields Data structures Visualization

494 views • 24 slides
HCI and Recommender Systems Joseph A. Konstan konstan@umn.edu 1 Whats wrong with these? 2

HCI and Recommender Systems Joseph A. Konstan konstan@umn.edu 1 Whats wrong with these? 2

10/24/2015 HCI and Recommender Systems Joseph A. Konstan konstan@umn.edu 1 Whats wrong with these? 2 1 10/24/2015 3 4 2 10/24/2015 5 What was wrong? 6 3 10/24/2015 ALL ARE SHOWING ME THE SAME RECOMMENDATIONS AS LAST TIME!!!

153 views • 13 slides
Exploiting social networks for Internet search Alan Mislove Krishna Gummadi Peter

Exploiting social networks for Internet search Alan Mislove Krishna Gummadi Peter

Exploiting social networks for Internet search Alan Mislove Krishna Gummadi Peter Druschel Max Planck Institute for Software Systems Rice University HotNets 2006 Search in the Internet Web has transformed information

816 views • 43 slides
Strings Joan Boone jpboone@email.unc.edu Summer 2020 Slide 1 Topics Part 1 Basic string

Strings Joan Boone jpboone@email.unc.edu Summer 2020 Slide 1 Topics Part 1 Basic string

INLS 560 Programming for Information Professionals Strings Joan Boone jpboone@email.unc.edu Summer 2020 Slide 1 Topics Part 1 Basic string operations Part 2 Modify, search, replace, and splitting strings Part 3 Text analysis

650 views • 30 slides
Recommendation Systems part 2 School for advanced sciences of School for advanced sciences of

Recommendation Systems part 2 School for advanced sciences of School for advanced sciences of

Recommendation Systems part 2 School for advanced sciences of School for advanced sciences of Luchon Luchon 2015 2015 Debora Donato debora@stumbleupon.com Today presentation Similarity-based methods User-similarity Item-similarity

494 views • 28 slides
The serendipity of EW baryogenesis Graldine SERVANT DESY/U.Hamburg Higgs Cosmology workshop,

The serendipity of EW baryogenesis Graldine SERVANT DESY/U.Hamburg Higgs Cosmology workshop,

The serendipity of EW baryogenesis Graldine SERVANT DESY/U.Hamburg Higgs Cosmology workshop, Kavli Royal Society Centre, March 28 2017 DESY Aim: Exploring the cosmological interplay between Flavour dynamics and EW baryogenesis A rich

1.07k views • 66 slides
BACKGROUND LAUNCHED OUR FIRST DIGITAL GALLERY IN 2008 LSTA GRANT STARTED WITH 1500

BACKGROUND LAUNCHED OUR FIRST DIGITAL GALLERY IN 2008 LSTA GRANT STARTED WITH 1500

BACKGROUND LAUNCHED OUR FIRST DIGITAL GALLERY IN 2008 LSTA GRANT STARTED WITH 1500 IMAGES FROM THREE POPULAR COLLECTIONS FLOOD OF 1937, HISTORIC HOMES DISTRICT, AFRICAN-AMERICAN COMMUNITY OVER 10,000 IMAGES IN FIRST FOUR YEARS

378 views • 27 slides

More recommend