analyzing pwned passwords with spark
play

Analyzing Pwned Passwords with Spark Kelley Robinson - PowerPoint PPT Presentation

Apr 27, 2023 •256 likes •606 views

Analyzing Pwned Passwords with Spark Kelley Robinson @kelleyrobinson Developer Evangelist + @KELLEYROBINSON BIG DATA & SECURITY Spark: then and now The state of passwords Spark in action Big Data Security BIG DATA & SECURITY

  2. Analyzing Pwned Passwords with Spark Kelley Robinson @kelleyrobinson Developer Evangelist

  4. +

  5. @KELLEYROBINSON BIG DATA & SECURITY Spark: then and now The state of passwords Spark in action Big Data ∩ Security

  6. BIG DATA & SECURITY @KELLEYROBINSON

  7. BIG DATA & SECURITY @KELLEYROBINSON Apache Spark Ecosystem

  8. @KELLEYROBINSON BIG DATA & SECURITY Spark Abstractions Then RDD (Resilient Distributed Dataset) DataFrames / Datasets Now

  9. @KELLEYROBINSON BIG DATA & SECURITY RDDs • Immutable & distributed collection • Unstructured data • Low-level transformation and control https://databricks.com/blog/2016/07/14/a-tale-of-three-apache-spark-apis-rdds-dataframes-and-datasets.html

  10. BIG DATA & SECURITY @KELLEYROBINSON https://databricks.gitbooks.io/databricks-spark-knowledge-base/content/best_practices/prefer_reducebykey_over_groupbykey.html

  11. @KELLEYROBINSON BIG DATA & SECURITY Datasets • Structured data • Strongly typed • Fast https://databricks.com/blog/2016/07/14/a-tale-of-three-apache-spark-apis-rdds-dataframes-and-datasets.html

  12. @KELLEYROBINSON BIG DATA & SECURITY Datasets • Structured data • Strongly typed • Fast • SQL DSLs

  13. BIG DATA & SECURITY @KELLEYROBINSON Apache Spark Ecosystem

  14. BIG DATA & SECURITY @KELLEYROBINSON Scala has the most robust language API

  15. BIG DATA & SECURITY @KELLEYROBINSON https://www.slideshare.net/databricks/composable-parallel-processing-in-apache-spark-and-weld

  16. BIG DATA & SECURITY @KELLEYROBINSON https://twitter.com/CamJo89/status/996497423621996544

  17. @KELLEYROBINSON BIG DATA & SECURITY Spark: then and now The state of passwords Spark in action Big Data ∩ Security

  21. @KELLEYROBINSON BIG DATA & SECURITY Spark: then and now The state of passwords Spark in action Big Data ∩ Security

  22. https://twitter.com/dog_rates/status/986762231290490881

  23. @KELLEYROBINSON BIG DATA & SECURITY Benefits Fast Flexible Good for exploration Proven for large systems

  24. @KELLEYROBINSON BIG DATA & SECURITY Challenges Opaque error messages Operationalizing Documentation http://heather.miller.am/blog/launching-a-spark-cluster-part-1.html

  26. BIG DATA & SECURITY @KELLEYROBINSON 👎💰 The missing Spark documentation https://jaceklaskowski.gitbooks.io/mastering-apache-spark/content/

  27. @KELLEYROBINSON BIG DATA & SECURITY Spark: then and now The state of passwords Spark in action Big Data ∩ Security

  28. BIG DATA & SECURITY @KELLEYROBINSON

  29. @KELLEYROBINSON

  30. BIG DATA & SECURITY

  31. THANK YOU! @kelleyrobinson

  32. BIG DATA & SECURITY @KELLEYROBINSON Spark Resources • Apache Spark • Jacek's Spark Documentation • Zeppelin • RDDs vs. Datasets • Running Spark on a Cluster Security Resources • Pwned Passwords • Reverse SHA1 hashes • LastPass and 1Password • 2FA Guides

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

User Authentication and Passwords Storing Passwords Selecting Passwords CSS322: Security and

User Authentication and Passwords Storing Passwords Selecting Passwords CSS322: Security and

CSS322 Passwords Authentication Passwords Entropy User Authentication and Passwords Storing Passwords Selecting Passwords CSS322: Security and Cryptography Sirindhorn International Institute of Technology Thammasat University Prepared by

670 views • 28 slides
Analyzing astronomical data with Apache Spark Julien Peloton In collaboration with Christian

Analyzing astronomical data with Apache Spark Julien Peloton In collaboration with Christian

Analyzing astronomical data with Apache Spark Julien Peloton In collaboration with Christian Arnault & St ephane Plaszczynski Laboratoire de lAcc el erateur Lin eaire Statistical challenges for large-scale structure in the

407 views • 20 slides
Intr Intro o to Spark to Spark and Spark and Spark SQL SQL AMP Camp 2014 Michael Armbrust -

Intr Intro o to Spark to Spark and Spark and Spark SQL SQL AMP Camp 2014 Michael Armbrust -

Intr Intro o to Spark to Spark and Spark and Spark SQL SQL AMP Camp 2014 Michael Armbrust - @michaelarmbrust What is Apache Spark? Fast and general cluster computing system, interoperable with Hadoop, included in all major distros

667 views • 43 slides
Good Passwords, Bad Passwords, and How to See the Difference David Klaftenegger Department of

Good Passwords, Bad Passwords, and How to See the Difference David Klaftenegger Department of

Good Passwords, Bad Passwords, and How to See the Difference David Klaftenegger Department of Information Technology Uppsala University, Sweden 20. January 2020 Caveat Auditor Background Passwords this talk contains opinions Diceware

447 views • 43 slides
Analyzing Weather Data with Apache Spark Jeremie Juban Tom Kunicki Introduction Who we

Analyzing Weather Data with Apache Spark Jeremie Juban Tom Kunicki Introduction Who we

Analyzing Weather Data with Apache Spark Jeremie Juban Tom Kunicki Introduction Who we are Professional Services Division of The Weather Company What we do Aviation Energy Insurance Retail Apache

443 views • 19 slides
PASSWORDS CS682: Advanced Security Topics Vasiliki Panteli 3/9/2020 Passwords 1 Passwords

PASSWORDS CS682: Advanced Security Topics Vasiliki Panteli 3/9/2020 Passwords 1 Passwords

PASSWORDS CS682: Advanced Security Topics Vasiliki Panteli 3/9/2020 Passwords 1 Passwords Passwords is a user authentication mechanism that is widely adopted for many years Methods for user authentication: Something you know

901 views • 52 slides
Security: Some Fun with Passwords How to handle Passwords: the Basics Rainbow Attacks Not

Security: Some Fun with Passwords How to handle Passwords: the Basics Rainbow Attacks Not

CSCE Intro to Computer Systems Security - Passwords Security: Some Fun with Passwords How to handle Passwords: the Basics Rainbow Attacks Not too long ago Hi, I forgot my password! Let me help you. What is your name? My Name is John

369 views • 5 slides
Spark Code Camp Discover Spark Streaming & Spark SQL Project Overview Focus on Spark

Spark Code Camp Discover Spark Streaming & Spark SQL Project Overview Focus on Spark

Spark Code Camp Discover Spark Streaming & Spark SQL Project Overview Focus on Spark Streaming and Spark SQL Explored Streaming API of Apache Spark on Ukko Cluster Window based Stream Content Direct Stream content

221 views • 9 slides
Setting Strong Encrypted Passwords Configuring Password Encryption for Clear Text Passwords Cisco

Setting Strong Encrypted Passwords Configuring Password Encryption for Clear Text Passwords Cisco

Setting Strong Encrypted Passwords Configuring Password Encryption for Clear Text Passwords Cisco IOS stores passwords in clear text in network device configuration files for several features such as passwords for local and remote CLI sessions,

354 views • 13 slides
STUDENT PASSWORDS GUI DEL I NES FOR 2 0 1 9 -2 020 S T U D E N T S , U P D A T E Y O U R P A

STUDENT PASSWORDS GUI DEL I NES FOR 2 0 1 9 -2 020 S T U D E N T S , U P D A T E Y O U R P A

STUDENT PASSWORDS GUI DEL I NES FOR 2 0 1 9 -2 020 S T U D E N T S , U P D A T E Y O U R P A S S W O R D F R O M H O M E ! Students: Update your password this summer from home! Student passwords were reset on 7/3/2019. Please follow the

525 views • 14 slides
Spark Technology 1. Spark main objectives 2. RDD concepts and operations 3. SPARK application

Spark Technology 1. Spark main objectives 2. RDD concepts and operations 3. SPARK application

10/05/2019 Big Data : Informatique pour les donnes et calculs massifs 7 SPARK technology Stphane Vialle Stephane.Vialle@centralesupelec.fr http://www.metz.supelec.fr/~vialle Spark Technology 1. Spark main objectives 2. RDD concepts

818 views • 39 slides
High Integrity Ada with SPARK Praxis Critical Systems 1 SPARK and the SPARK Examiner What is

High Integrity Ada with SPARK Praxis Critical Systems 1 SPARK and the SPARK Examiner What is

High Integrity Ada with SPARK Praxis Critical Systems 1 SPARK and the SPARK Examiner What is SPARK? A sub-language of Ada 83 and 95 with particular properties that make it ideally suited to the most critical of applications: completely

848 views • 10 slides
Passwords in the Wild Passwords in the Wild Who am I...? My blog... SkullSecurity.org Random

Passwords in the Wild Passwords in the Wild Who am I...? My blog... SkullSecurity.org Random

Passwords in the Wild Passwords in the Wild Who am I...? My blog... SkullSecurity.org Random research, rants, etc. Nmap dev news Password database I post updates to Twitter https://twitter.com/iagox86 My job... Tenable Network Security

990 views • 88 slides
User Authentication Storing Passwords Selecting Passwords ITS335: IT Security Tokens

User Authentication Storing Passwords Selecting Passwords ITS335: IT Security Tokens

ITS335 User Authentication Authentication Passwords User Authentication Storing Passwords Selecting Passwords ITS335: IT Security Tokens Biometrics Sirindhorn International Institute of Technology Summary Thammasat University Prepared

663 views • 40 slides
Pwned: Protecting Yourself in the 2019 By Dallin Warne 1 Why are you a target? 99% Money

Pwned: Protecting Yourself in the 2019 By Dallin Warne 1 Why are you a target? 99% Money

Pwned: Protecting Yourself in the 2019 By Dallin Warne 1 Why are you a target? 99% Money 1% Everything else (revenge, activism, hate, espionage, etc) Why do they do it? Because it works. 3% 5% clicks on phishing links, down

581 views • 23 slides
Crypto with Passwords Lecture 22 Passwords Password or passphrase: Low-entropy shared secret

Crypto with Passwords Lecture 22 Passwords Password or passphrase: Low-entropy shared secret

Crypto with Passwords Lecture 22 Passwords Password or passphrase: Low-entropy shared secret Typical goal: client authenticating to server, without being tied to a device holding a cryptographic key. On authentication, a session key should be

344 views • 11 slides
Using XSL and mod_transform in Apache Applications Paul Querna chip@OutOfOrder.cc What is XSL?

Using XSL and mod_transform in Apache Applications Paul Querna chip@OutOfOrder.cc What is XSL?

Using XSL and mod_transform in Apache Applications Paul Querna chip@OutOfOrder.cc What is XSL? Extensible Stylesheet Language (XSL) A family of Standards for XML by the W3C: XSL Transformations (XSLT) XML Path Language (Xpath)

4.45k views • 29 slides
Bi BigDebug : : Interactive Debugger for Bi Big Data

Bi BigDebug : : Interactive Debugger for Bi Big Data

Bi BigDebug : : Interactive Debugger for Bi Big Data Analytics in Apache Spark MUHAMMAD ALI GULZAR, MATTEO INTERLANDI, TYSON CONDIE,

390 views • 16 slides
Production Docker Image for Apache Airflow Airflow Summit 2020 - 14.07.2020 Production

Production Docker Image for Apache Airflow Airflow Summit 2020 - 14.07.2020 Production

Production Docker Image for Apache Airflow Airflow Summit 2020 - 14.07.2020 Production Container Image for Apache Airflow Airflow Summit 2020 - 14.07.2020 Hi! Jarek Potiuk Apache Airflow: PMC Member and Committer Polidea:

1.5k views • 45 slides
Introduction to Apache Spark Slides from: Patrick Wendell - Databricks What hat is is Sp

Introduction to Apache Spark Slides from: Patrick Wendell - Databricks What hat is is Sp

Introduction to Apache Spark Slides from: Patrick Wendell - Databricks What hat is is Sp Spark? rk? Fast st and Expr pressiv essive Cluster Computing Engine Compatible with Apache Hadoop Efficient ficient Usa sabl ble Rich APIs

1.18k views • 25 slides
Architecture recovery of Apache 1.3 A case study Bernhard Grne, Andreas Knpfel, Rudolf

Architecture recovery of Apache 1.3 A case study Bernhard Grne, Andreas Knpfel, Rudolf

Architecture recovery of Apache 1.3 A case study Bernhard Grne, Andreas Knpfel, Rudolf Kugel Hasso Plattner Institute for Software Systems Engineering P.O.Box 900460, D14440 Potsdam, Germany E-mail: {groene, knoepfel,

309 views • 7 slides
!" #$% &'()*+,-. "/0+(1 2(0,.-3 !"# $%&'"#( )&*++%, %-+.#'/

!" #$% &'()*+,-. "/0+(1 2(0,.-3 !"# $%&'"#( )&*++%, %-+.#'/

!" #$% &'()*+,-. "/0+(1 2(0,.-3 !"# $%&'"#( )&*++%, %-+.#'/ 0"1 2# /&34 &5+6/ )&*++%7 ! 4 5,6(7/890(6 6,0+),:9+(6 0/0+(1 ! 471;0+ (<()/ => ?;1'*-/ ,- +@( :*/ *)(* 90(0 0;1( A;)1 ;A B*6;;' !

748 views • 39 slides
Sudipto Das, Divy Agrawal, Amr El Abbadi Department of Computer Science University of California

Sudipto Das, Divy Agrawal, Amr El Abbadi Department of Computer Science University of California

Sudipto Das, Divy Agrawal, Amr El Abbadi Department of Computer Science University of California at Santa Barbara ElasTraS: An Elastic Transactional Data Store in the Cloud Paradigm Shift in Computing 6/30/09 ElasTraS: An Elastic Transactional

545 views • 18 slides
The Apache Way Ross Gardler @rgardler rgardler@apache.org A collaborative slidedeck with

The Apache Way Ross Gardler @rgardler rgardler@apache.org A collaborative slidedeck with

The Apache Way Ross Gardler @rgardler rgardler@apache.org A collaborative slidedeck with contributions from ${ASF_Members} (in particular Justin Erenkrantz, Isabel Drost and Lars Eilebrecht ) Who is this Ross Gardler? Ross Gardler Vice

578 views • 33 slides

More recommend