Crowford Crowd Investment Data Portal Group 13 LABBE, Kevin Patrick - - PowerPoint PPT Presentation

▶

Sep 09, 2023 468 likes •868 views

Crowford Crowd Investment Data Portal Group 13 LABBE, Kevin Patrick Joseph MARTYNAVA, Karina THOMPSON, Julien Edward Topics Crowdfunding basics Schema Mapping / ER (Gathering Data) Data Fusion (Data Analysis) Data Portal

SLIDE 1

Crowford

Crowd Investment Data Portal

Group 13

LABBE, Kevin Patrick Joseph MARTYNAVA, Karina THOMPSON, Julien Edward

SLIDE 2

Topics

Crowdfunding basics
Schema Mapping / ER (Gathering Data)
Data Fusion (Data Analysis)
Data Portal

SLIDE 3

Crowdfunding

Crowdfunding
Schema mapping / ER
Data fusion
Data Portal

SLIDE 4

Crowdfunding

Fund a project by a large number of people
Start-up, Video games, charity…
Crowdfunding
Schema
Data fus
Data Po

SLIDE 5

Crowdfunding

over 2 billions $
100K projects
10 milion contributors
Crowdfunding
Schema
Data fus
Data Po

SLIDE 6

Crowford

Gather projects from different sources
Predict if a project will be successful or not
Crowdfunding
Schema
Data fus
Data Po

SLIDE 7

Schema Mapping / ER

Crowdfunding
Schema mapping / ER
Data Fusion
Data Portal

Gathering data

SLIDE 8

Crowdfunding
Schema mapping / ER
Data Fusion
Data Portal

Data Sources

SLIDE 9

Same structure
Same theme (fund projects)
Crowdfunding
Schema mapping / ER
Data Fusion
Data Portal

Data Sources

SLIDE 10

Crowdfund data

Project Idea (Pen, Video game, Product…) Packages / Perks What you get / Money Author(s)

SLIDE 11

SLIDE 12

SLIDE 13

SLIDE 14

Crawling

Crowdfunding
Schema mapping / ER
Data Fusion
Data Portal

SLIDE 15

Crawling

Use JavaScript to generate project page
Private API that generate JSON
Python script w/ http2 that generate requests
Crowdfunding
Schema mapping / ER
Data Fusion
Data Portal

SLIDE 16

https://www.indiegogo.com/private_api/explore? filter_funding=&filter_percent_funded=&filter_q uick=new&filter_status=&pg_num=2

SLIDE 17

Crawling

Have to extract data from websites
2 Spider bots (crawlers) using Scrapy
Crowdfunding
Schema mapping / ER
Data Fusion
Data Portal

SLIDE 18

Crawling w/ Scrapy

Python Framework for extracting data
Write Spider (crawling bots)
Parse data and extract with xpath
Export data (Schema mapping)

SLIDE 19

SLIDE 20

Initialize the spider

SLIDE 21

Download and extract data
Export the item

SLIDE 22

Export the item

SLIDE 23

Data scheme

Author Project Perks / Packages

Crowdfunding
Schema mapping / ER
Data Fusion
Data Portal

SLIDE 24

Project Author Project Summary Perks / Packages

Crowdfunding
Schema mapping / ER
Data Fusion
Data Portal

Data scheme

SLIDE 25

Data scheme

Project / Author
Project / Perks
Recommendation : Project / Related_Project
ER for multiple authors / perks / projects…
Crowdfunding
Schema mapping / ER
Data Fusion
Data Portal

SLIDE 26

Results

Our working set
36 000 projects
65 000 authors
over 230 000 perks
Crowdfunding
Schema mapping / ER
Data Fusion
Data Portal

SLIDE 27

Data fusion

Crowdfunding
Schema mapping /
Data Fusion
Data Portal

And other data analysis

SLIDE 28

Recommendation

Use buzzwords in project description
Use n-grams (word combination)
Similarity measures using Pairwise metrics
Linear kernels
Can be used for data fusion
Crowdfu
Schema
Data Fusion
Data Por

SLIDE 29

Success Prediction

How much money has been collected
How much time
The average pledge
…
Crowdfu
Schema
Data Fusion
Data Por

SLIDE 30

Success Prediction

Random Forests Logistic regression RESULT 1 RESULT 2 COMPARISON RESULT

Crowdfu
Schema
Data Fusion
Data Por

SLIDE 31

Data Portal

Crowdfunding
Schema mapping / ER
Data fusion
Data Portal

SLIDE 32

Goal

Browse successful projects

Crowdfunding
Schema mappin
Data fusion
Data Portal

SLIDE 33

DataBase

PostgreSQL

SLIDE 34

DataBase

PostgreSQL

Web Interface Django

SLIDE 35

DataBase

PostgreSQL

Web Interface Django Project List Project Info

SLIDE 36

Web Interface

Project list
Filter
Access project page
Allows you to download the datasets
Crowdfunding
Schema mappin
Data fusion
Data Portal

SLIDE 37

Demo

SLIDE 38