rekognizing patterns
play

Rekognizing patterns IN TRODUCTION TO AW S BOTO IN P YTH ON - PowerPoint PPT Presentation

Sep 25, 2022 •219 likes •937 views

Rekognizing patterns IN TRODUCTION TO AW S BOTO IN P YTH ON Maksim Pecherskiy Instructor Rekognition INTRODUCTION TO AWS BOTO IN PYTHON So what is Rekognition anyway? Detecting Objects in an image Extracting Text from Images INTRODUCTION

  1. Rekognizing patterns IN TRODUCTION TO AW S BOTO IN P YTH ON Maksim Pecherskiy Instructor

  2. Rekognition INTRODUCTION TO AWS BOTO IN PYTHON

  3. So what is Rekognition anyway? Detecting Objects in an image Extracting Text from Images INTRODUCTION TO AWS BOTO IN PYTHON

  4. Why not build our own? Use Rekognition if: Quick but good Keep code simple Recognize many things Build a model if: Custom requirements Security implications Large volumes INTRODUCTION TO AWS BOTO IN PYTHON

  5. I am not a computer vision expert INTRODUCTION TO AWS BOTO IN PYTHON

  6. INTRODUCTION TO AWS BOTO IN PYTHON

  7. INTRODUCTION TO AWS BOTO IN PYTHON

  8. INTRODUCTION TO AWS BOTO IN PYTHON

  9. INTRODUCTION TO AWS BOTO IN PYTHON

  10. Upload an image to S3 Initialize S3 Client s3 = boto3.client( 's3', region_name='us-east-1', aws_access_key_id=AWS_KEY_ID, aws_secret_access_key=AWS_SECRET ) Upload a �le s3.upload_file( Filename='report.jpg', Key='report.jpg', Bucket='datacamp-img') INTRODUCTION TO AWS BOTO IN PYTHON

  11. Object detection INITIATE THE CLIENT rekog = boto3.client( 'rekognition', region_name='us-east-1', aws_access_key_id=AWS_KEY_ID, aws_secret_access_key=AWS_SECRET) INTRODUCTION TO AWS BOTO IN PYTHON

  12. Object detection DETECT! response = rekog.detect_labels( Image={'S3Object': { 'Bucket': 'datacamp-img', 'Name': 'report.jpg' }, MaxLabels=10, MinConfidence=95 ) INTRODUCTION TO AWS BOTO IN PYTHON

  13. INTRODUCTION TO AWS BOTO IN PYTHON

  14. INTRODUCTION TO AWS BOTO IN PYTHON

  15. INTRODUCTION TO AWS BOTO IN PYTHON

  16. INTRODUCTION TO AWS BOTO IN PYTHON

  17. INTRODUCTION TO AWS BOTO IN PYTHON

  18. Text detection PERFORM DETECTION response = rekog.detect_text( Image={'S3Object': { 'Bucket': 'datacamp-img', 'Name': 'report.jpg' } } ) INTRODUCTION TO AWS BOTO IN PYTHON

  19. INTRODUCTION TO AWS BOTO IN PYTHON

  20. INTRODUCTION TO AWS BOTO IN PYTHON

  21. INTRODUCTION TO AWS BOTO IN PYTHON

  22. Summary Detect objects in an image Count instances Learn a new AWS Service .detect_labels() Recognize text in an image Word vs line detections When to build our own .detect_text() INTRODUCTION TO AWS BOTO IN PYTHON

  23. Let's do some computer vision! IN TRODUCTION TO AW S BOTO IN P YTH ON

  24. Comprehending text IN TRODUCTION TO AW S BOTO IN P YTH ON Maksim Pecherskiy Data engineer

  25. AWS Translate console INTRODUCTION TO AWS BOTO IN PYTHON

  26. Translating text Initialize client translate = boto3.client('translate', region_name='us-east-1', aws_access_key_id=AWS_KEY_ID, aws_secret_access_key=AWS_SECRET) Translate text response = translate.translate_text( Text='Hello, how are you?', SourceLanguageCode='auto', TargetLanguageCode='es') INTRODUCTION TO AWS BOTO IN PYTHON

  27. Translating text INTRODUCTION TO AWS BOTO IN PYTHON

  28. Translating text translated_text = translate.translate_text( Text='Hello, how are you?', SourceLanguageCode='auto', TargetLanguageCode='es')['TranslatedText'] INTRODUCTION TO AWS BOTO IN PYTHON

  29. Detecting language Initialize boto3 Comprehend client comprehend = boto3.client('comprehend', region_name='us-east-1', aws_access_key_id=AWS_KEY_ID, aws_secret_access_key=AWS_SECRET) Detect dominant language response = comprehend.detect_dominant_language( Text="Hay basura por todas partes a lo largo de la carretera.") INTRODUCTION TO AWS BOTO IN PYTHON

  30. Detecting language INTRODUCTION TO AWS BOTO IN PYTHON

  31. Understanding sentiment INTRODUCTION TO AWS BOTO IN PYTHON

  32. Understanding sentiment Detect text sentiment response = comprehend.detect_sentiment( Text="DataCamp students are amazing.", LanguageCode='en') INTRODUCTION TO AWS BOTO IN PYTHON

  33. Understanding sentiment INTRODUCTION TO AWS BOTO IN PYTHON

  34. Understanding sentiment sentiment = comprehend.detect_sentiment( Text='Maksim is amazing.', LanguageCode='en')['Sentiment'] INTRODUCTION TO AWS BOTO IN PYTHON

  35. Review Initialize client translate = boto3.client('translate', region_name='us-east-1', aws_access_key_id=AWS_KEY_ID, aws_secret_access_key=AWS_SECRET) Translate text response = translate.translate_text( Text='Hello, how are you?', SourceLanguageCode='auto', TargetLanguageCode='es') INTRODUCTION TO AWS BOTO IN PYTHON

  36. Review Initialize boto3 Comprehend client comprehend = boto3.client('comprehend', region_name='us-east-1', aws_access_key_id=AWS_KEY_ID, aws_secret_access_key=AWS_SECRET) Detect dominant language response = comprehend.detect_dominant_language( Text="Hay basura por todas partes a lo largo de la carretera.") INTRODUCTION TO AWS BOTO IN PYTHON

  37. Review Detect text sentiment response = comprehend.detect_sentiment( Text="Maksim is amazing.", LanguageCode='en') INTRODUCTION TO AWS BOTO IN PYTHON

  38. Let's practice! IN TRODUCTION TO AW S BOTO IN P YTH ON

  39. Case Study: Scooting Around! IN TRODUCTION TO AW S BOTO IN P YTH ON Maksim Pecherskiy Data Engineer

  40. The Quandary INTRODUCTION TO AWS BOTO IN PYTHON

  41. The Quandary INTRODUCTION TO AWS BOTO IN PYTHON

  42. The Data service_request_id image lat long public_description Hay un scooter 93494 report_113439.jpg 32.723138 -117.128237 electrico en sidewalk -117.1281408 This scooter helped me 101502 report_134938839.jpg 32.7077658 move a mattress! There is a scooter 101520 report_272819.jpg 32.77605567 -117.100004 blocking the sidewalk 32.68899358 -117.0584723 I tripped on a stupid 101576 report_3722938.jpg scooter INTRODUCTION TO AWS BOTO IN PYTHON

  43. Final Product INTRODUCTION TO AWS BOTO IN PYTHON

  44. Final Product INTRODUCTION TO AWS BOTO IN PYTHON

  45. Final Product INTRODUCTION TO AWS BOTO IN PYTHON

  46. Final Product INTRODUCTION TO AWS BOTO IN PYTHON

  47. Final Product INTRODUCTION TO AWS BOTO IN PYTHON

  48. Initialize boto3 service clients. Initialize rekognition client rekog = boto3.client('rekognition', region_name='us-east-1', aws_access_key_id=AWS_KEY_ID, aws_secret_access_key=AWS_SECRET) Initialize comprehend client comprehend = boto3.client('comprehend', region_name='us-east-1', aws_access_key_id=AWS_KEY_ID, aws_secret_access_key=AWS_SECRET) INTRODUCTION TO AWS BOTO IN PYTHON

  49. Initialize boto3 service clients Initialize translate client translate = boto3.client('translate', region_name='us-east-1', aws_access_key_id=AWS_KEY_ID, aws_secret_access_key=AWS_SECRET) INTRODUCTION TO AWS BOTO IN PYTHON

  50. Translate all descriptions to English for index, row in df.iterrows(): desc = df.loc[index, 'public_description'] if desc != '': resp = translate_fake.translate_text( Text=desc, SourceLanguageCode='auto', TargetLanguageCode='en') df.loc[index, 'public_description'] = resp['TranslatedText'] INTRODUCTION TO AWS BOTO IN PYTHON

  51. Translate all descriptions to English service_request_id image lat long public_description Electric scooter on 93494 report_113439.jpg 32.723138 -117.128237 sidewalk -117.1281408 This scooter helped me 101502 report_134938839.jpg 32.7077658 move a mattress! There is a scooter 101520 report_272819.jpg 32.77605567 -117.100004 blocking the sidewalk 32.68899358 -117.0584723 I tripped on a stupid 101576 report_3722938.jpg scooter INTRODUCTION TO AWS BOTO IN PYTHON

  52. Detect text sentiment for index, row in df.iterrows(): desc = df.loc[index, 'public_description'] if desc != '': resp = comprehend.detect_sentiment( Text=desc, LanguageCode='en') df.loc[index, 'sentiment'] = resp['Sentiment'] INTRODUCTION TO AWS BOTO IN PYTHON

  53. Detect text sentiment service_request_id image lat long sentiment public_desc NEGATIVE Electric scoo 93494 report_113439.jpg 32.723138 -117.128237 sidewalk This scooter 101502 report_134938839.jpg 32.7077658 -117.1281408 POSITIVE helped me m mattress! There is a sc 101520 report_272819.jpg 32.77605567 -117.100004 NEGATIVE blocking the sidewalk 32 68899358 -117 0584723 NEGATIVE I tripped on 101576 report 3722938 jpg INTRODUCTION TO AWS BOTO IN PYTHON

  54. Detect scooter in image df['img_scooter'] = 0 for index, row in df.iterrows(): image = df.loc[index, 'image'] response = rekog.detect_labels( # Specify the image as an S3Object Image={'S3Object': {'Bucket': 'gid-images', 'Name': image}} ) for label in response['Labels']: if label['Name'] == 'Scooter': df.loc[index, 'img_scooter'] = 1 break INTRODUCTION TO AWS BOTO IN PYTHON

  55. Detect scooter in image service_request_id image img_scooter sentiment lat long 93494 report_113439.jpg 1 NEGATIVE 32.723138 -117.128237 101502 report_134938839.jpg 1 POSITIVE 32.7077658 -117.1281408 101520 report_272819.jpg 0 NEGATIVE 32.77605567 -117.100004 101576 report 3722938 jpg 1 NEGATIVE 32 68899358 -117 0584723 INTRODUCTION TO AWS BOTO IN PYTHON

  56. Final count! Select only rows where there was a scooter image and that have negative sentiment pickups = df[((df.img_scooter == 1) & (df.sentiment == 'NEGATIVE'))] num_pickups = len(pickups) 332 Scooters! INTRODUCTION TO AWS BOTO IN PYTHON

  57. Let's practice! IN TRODUCTION TO AW S BOTO IN P YTH ON

  58. Wrap up IN TRODUCTION TO AW S BOTO IN P YTH ON Maksim Pecherskiy Data Engineer

  59. AWS Services INTRODUCTION TO AWS BOTO IN PYTHON

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Design Patterns Applications Programming What is design patterns? The design patterns are

Design Patterns Applications Programming What is design patterns? The design patterns are

10/26/2011 G52APR Design Patterns Applications Programming What is design patterns? The design patterns are language- Design Patterns 1 independent strategies for solving common object-oriented design problems. Jiawei Li (Michael)

316 views • 8 slides
More Design Patterns Horstmann ch.10.1,10.4 Design patterns Structural design patterns

More Design Patterns Horstmann ch.10.1,10.4 Design patterns Structural design patterns

More Design Patterns Horstmann ch.10.1,10.4 Design patterns Structural design patterns Adapter Composite Decorator Proxy Behavioral design patterns Iterator Observer Strategy Template method

777 views • 16 slides
Design Patterns in Eiffel Dr. Till Bay design patterns? [Design Patterns] are

Design Patterns in Eiffel Dr. Till Bay design patterns? [Design Patterns] are

Design Patterns in Eiffel Dr. Till Bay design patterns? [Design Patterns] are descriptions of communicating objects and classes that are customized to solve a general design problem in a particular context. Design Patterns,

1.44k views • 69 slides
Design Patterns 1 What are Design Patterns? Design patterns describe common (and successful)

Design Patterns 1 What are Design Patterns? Design patterns describe common (and successful)

Design Patterns 1 What are Design Patterns? Design patterns describe common (and successful) ways of building software. 2 What are Design Patterns? A pattern describes a problem that occurs often, along with a tried solution to the

727 views • 48 slides
Algorithm Design Patterns and Anti-Patterns Algorithm design patterns. Ex. Greed. O(n log n)

Algorithm Design Patterns and Anti-Patterns Algorithm design patterns. Ex. Greed. O(n log n)

Algorithm Design Patterns and Anti-Patterns Algorithm design patterns. Ex. Greed. O(n log n) interval scheduling. Divide-and-conquer. O(n log n) FFT. Dynamic programming. O(n 2 ) edit distance. Duality. O(n 3 ) bipartite

626 views • 21 slides
Design Patterns (1) CSE 331 University of Washington Michael Ernst Outline Introduction to

Design Patterns (1) CSE 331 University of Washington Michael Ernst Outline Introduction to

Design Patterns (1) CSE 331 University of Washington Michael Ernst Outline Introduction to design patterns Creational patterns (constructing objects) Structural patterns (controlling heap layout) Behavioral patterns (affecting

532 views • 38 slides
Patterns of Projects: From Adrenaline Junkies to Template Zombies Tim Lister Patterns

Patterns of Projects: From Adrenaline Junkies to Template Zombies Tim Lister Patterns

Patterns of Projects: From Adrenaline Junkies to Template Zombies Tim Lister Patterns QuickTime and a TIFF (Uncompressed) decompressor are needed to see this picture. Lets look at some Project Patterns More Patterns Lets look at

592 views • 27 slides
Privacy Design Patterns and Anti-Patterns Patterns Misapplied and Unintended Consequences Nick

Privacy Design Patterns and Anti-Patterns Patterns Misapplied and Unintended Consequences Nick

Privacy Design Patterns and Anti-Patterns Patterns Misapplied and Unintended Consequences Nick Doty & Mohit Gupta UC Berkeley, School of Information Privacy-by-Design ... in practice for designers and developers of technologies document

266 views • 11 slides
Principles and Patterns 26 February, 2020 Recap Principles Patterns Inheritance Anti-patterns

Principles and Patterns 26 February, 2020 Recap Principles Patterns Inheritance Anti-patterns

Principles and Patterns 26 February, 2020 Recap Principles Patterns Inheritance Anti-patterns Lecture overview agile development agile design principles and patterns software testing Principles and Patterns Recap Principles

1.04k views • 89 slides
1 A step backwards? Our first set of patterns & componentization Patterns are not reusable

1 A step backwards? Our first set of patterns & componentization Patterns are not reusable

References Last update: 18 April 2007 Erich Gamma, Ralph Johnson, Richard Helms, John Software Architecture Vlissides: Design Patterns , Addison-Wesley, 1994 Bertrand Meyer Jean-Marc Jezequel, Michel Train, Christine Mingins: Design Patterns

79 views • 7 slides
Patterns 2020/4/12 Structural Design Patterns Creational Structural Behavioral Design

Patterns 2020/4/12 Structural Design Patterns Creational Structural Behavioral Design

Poly- mor- phism Abstra ction Class OOP Inheri -tance En- capsu- lation Structural Design Kuan-Ting Lai Patterns 2020/4/12 Structural Design Patterns Creational Structural Behavioral Design Patterns Design Patterns Design

931 views • 30 slides
1 Closed Patterns and Max-Patterns Closed Patterns and Max-Patterns A long pattern contains a

1 Closed Patterns and Max-Patterns Closed Patterns and Max-Patterns A long pattern contains a

Mining Frequent Patterns, Association and Correlations: Basic Concepts and Methods n Basic Concepts n Frequent Itemset Mining Methods n Which Patterns Are Interesting?Pattern Evaluation Data Mining: Mining Frequent Patterns Methods

169 views • 12 slides
Factory Patterns: Factory Method and Abstract Factory Design Patterns In Java Bob Tarr

Factory Patterns: Factory Method and Abstract Factory Design Patterns In Java Bob Tarr

Factory Patterns: Factory Method and Abstract Factory Design Patterns In Java Bob Tarr Factory Patterns Factory Patterns G Factory patterns are examples of creational patterns G Creational patterns abstract the object instantiation process.

422 views • 23 slides
Oscillation Patterns in RegCM4 Contents Teleconnections & Oscillation Patterns

Oscillation Patterns in RegCM4 Contents Teleconnections & Oscillation Patterns

C LIMATE R ESEARCH IN THE D EPARTMENT OF P HYSICS J. Ciarlo`, M ALTA C LIMATE T EAM 14-19 th March 2011 How Oscillation Patterns effect one another How Oscillation Patterns effect aerosol transport Oscillation Patterns in RegCM4 Contents

621 views • 17 slides
Patterns (controller) SWEN-343 From Fowler, Patterns of Enterprise Application Architecture

Patterns (controller) SWEN-343 From Fowler, Patterns of Enterprise Application Architecture

Web Presentation Patterns (controller) SWEN-343 From Fowler, Patterns of Enterprise Application Architecture Objectives Look at common patterns for designing Web-based presentation layer behavior Model-View-Control Handling user input

266 views • 23 slides
Lecture 20 Next lecture: Design Patterns 1 Structural patterns (controlling heap layout)

Lecture 20 Next lecture: Design Patterns 1 Structural patterns (controlling heap layout)

CSE 331 Outline Software Design and Implementation Introduction to design patterns Creational patterns (constructing objects) Lecture 20 Next lecture: Design Patterns 1 Structural patterns (controlling heap layout)

370 views • 12 slides
CYCL ING IN T HE WIL DE RNE SS Sue Spa no MD, F ACE P, F AWM Dire c to r, Wilde rne ss

CYCL ING IN T HE WIL DE RNE SS Sue Spa no MD, F ACE P, F AWM Dire c to r, Wilde rne ss

CYCL ING IN T HE WIL DE RNE SS Sue Spa no MD, F ACE P, F AWM Dire c to r, Wilde rne ss Me dic ine F e llo wship Unive rsity o f Ca lifo rnia Sa n F ra nc isc o F re sno CALIFORNIA TO SOUTH AMERICA Ste ve Sto ltz MD, F ACP

885 views • 51 slides
!"#$%&'( !"#$%&'()*+),' -./0./--' )'&&*(+( !"#$%&'(

!"#$%&'( !"#$%&'()*+),' -./0./--' )'&&*(+( !"#$%&'(

!"#$%&'( !"#$%&'()*+),' -./0./--' )'&&*(+( !"#$%&'( )'&&*(+( ,-'.&%( ! ! T.S' "Y' @;U' !+33+"A' -..S' /&'"&*%(01(2'$34( V.S' 8C%4)AC8' 9MQ)8' Z=-Z<' [-' U.S'

415 views • 10 slides
!"#$%&'( !"#$%&'()*#+',#-.#/' 0123200' )'&&*(+( !"&*,'$-.( 4

!"#$%&'( !"#$%&'()*#+',#-.#/' 0123200' )'&&*(+( !"&*,'$-.( 4

!"#$%&'( !"#$%&'()*#+',#-.#/' 0123200' )'&&*(+( !"&*,'$-.( 4 ! 5.67)6$' 8 ! 9#$$.:;'<6)='):#'>.;&$'$)'$&#':#?$' 4 ! @A+".:;'$)'BCD$)=DE'FG1HI1'=.:C$#D'

338 views • 11 slides
Savtchenko et al., AIRS Science Mtng, Oct, 2008 Savtchenko et al., AIRS Science Mtng, Oct, 2008

Savtchenko et al., AIRS Science Mtng, Oct, 2008 Savtchenko et al., AIRS Science Mtng, Oct, 2008

Savtchenko et al., AIRS Science Mtng, Oct, 2008 Savtchenko et al., AIRS Science Mtng, Oct, 2008 Savtchenko et al., AIRS Science Mtng, Oct, 2008 Conversion to NetCDF, standard retrieval browse, and other services in Mirador,

692 views • 25 slides
URBAN MICRO-MOBILITY AND DATA FOR PLANNING AND POLICYMAKING IIASA iTEM4 Fourth International

URBAN MICRO-MOBILITY AND DATA FOR PLANNING AND POLICYMAKING IIASA iTEM4 Fourth International

URBAN MICRO-MOBILITY AND DATA FOR PLANNING AND POLICYMAKING IIASA iTEM4 Fourth International Transport Energy Modeling workshop October 30, 2018 Regina Clewlow, Ph.D. CEO & Co-Founder Populus www.populus.ai MOBILITY SERVICES HAVE

401 views • 15 slides
Engineering Problems Identifying problems appropriate for engineering solutions Some Examples of

Engineering Problems Identifying problems appropriate for engineering solutions Some Examples of

Engineering Problems Identifying problems appropriate for engineering solutions Some Examples of Engineering Problems and Projects that follow the Design Process Identify Problem -> Define Requirements -> Design a Solution (PSU

590 views • 25 slides
Threads and concurrency: what problems arise? Concurrent access to shared resources can cause

Threads and concurrency: what problems arise? Concurrent access to shared resources can cause

Threads and concurrency: what problems arise? Concurrent access to shared resources can cause problems, the computer executes very quickly, sequential intuition goes out the window see the Producer/Consumer example for what can happen

278 views • 4 slides
Gabriola Island Local Trust Committee BACKGROUND Ten significant policies in the Official

Gabriola Island Local Trust Committee BACKGROUND Ten significant policies in the Official

Gabriola Island Local Trust Committee BACKGROUND Ten significant policies in the Official Policies Community Plan (OCP) related to climate adopted by change and greenhouse gas emission the Local Trust reduction Committee (LTC) in 2010

413 views • 25 slides

More recommend