Who? Networks of social entities Max Kemman University of - PowerPoint PPT Presentation

Who? Networks of social entities Max Kemman University of Luxembourg December 13, 2016 Doing Digital History: Introduction to Tools and Technology

Today • Final assignment • Preparing the data with Palladio • (Cleaning the date column with Google Spreadsheets) • Visualising with Palladio • Next time

Final assignment Some additional info about the final assignment The computers in the TIC-Lab are powerful enough to work with all mails in Google Spreadsheets (You may also use Excel if you prefer, but more difficult for me to help when you're stuck) Create a selection and argument why this selection Deadline: 20 January 2017 23:59 You receive grades on Friday 27 January 2017

Final assignment data All data is in Moodle in folder Final Assignment : • allmails-metadata.csv & allmails-metadata.ods • allmails-ner.csv & allmails-metadata.ods (including mentioned people, organisations, locations) • allmails-geocoded.csv (about 108k locations) • Folder with text files per 1k

Preparing the data with Palladio To visualize the coded data, we will use Palladio: http://hdlab.stanford.edu/palladio/ First we need to prepare the data for Palladio

Loading the data Click Start We will use the 1000mails-cleandate.csv file from Moodle in the Who folder) Drag the CSV file onto the text input field Click Load

Preparing the data You will get a list of the columns from the spreadsheet You can already give your project a title and your data table as well Do not close this tab or refresh, you will have to start over! Let's look at several columns

From Sort the values by Frequency Check the data type Click Close

Date To set the data type to date we need the format: YYYY-MM-DD In our original CSV the format included the clock, but here we have the data in the right format so it's automatically recognised See next section for how to clean the date Click Close

People This contains the named entities per email To separate multiple people in an email, enter the delimiter | in the Multiple values box Click Close

People This contains the named entities per email To separate multiple people in an email, enter the delimiter | in the Multiple values box Click Close

Cleaning the date column with Google Spreadsheets Here we used Google Spreadsheets, but also possible in Excel & LibreOffice You can skip this for now, but important for final assignment

Cleaning the Date field Select the Date column, and go to Format > Number > More Formats > More date and time formats

Cleaning the Date field Select the appropriate option YYYY-MM-DD and click Apply

Cleaning the Date field The Date column will now have the appropriate form

Exporting the CSV Click File > Download as > Comma-separated values (.csv, current sheet)

Visualising with Palladio Now let's look at the network by selecting Graph at the top bar As a source, choose the From and close the popup As a target, choose the To and close the popup Wait and watch the result!

Palladio Graph Settings Try the two Highlighting check-boxes Try Size nodes What can we learn from this graph?

Facet To filter for certain attributes, select Facet in the lower-left corner As a Dimension select From and close the popup Now you can select to filter emails only from one person You could alternatively filter emails mentioning a specific person, location, or organisation To refine even further, we can select more facets by selecting the Dimension and selecting more options To remove a facet, delete the red trashcan in the lower right corner

Facet selection from From column

Facet selection from People column

Timeline We can also create a timeline of the emails by clicking Timeline Drag the mouse in the timeline to create a bar that acts as a filter And drag the bar to move it around so you can see how the network develops: you could compare months or years To remove the timeline filter, delete the red trashcan in the lower right corner

Timeline

Filtering one part of the timeline

Filtering another part of the timeline

Why filtering? The network can become quite large when you have more emails, or when you select one of the people, locations, organisations columns in the graph Filtering will help to be able to read the spaghetti/graph See next slide an example of a spaghetti ball (trying to do this might make your computer quite slow)

Sharing To export a graph, click the Download button in the settings (the lower one). This will export an SVG file that you can embed in your HTML report with img src Palladio Graph.svg alt graph

To export the entire workspace, click the upper Download button. This will export a JSON file that you can load next time (see next slide)

If you previously exported your workspace, you can load it in by selecting "Load an existing project" and choosing the JSON file. Also useful to share with project partners

For next time 20 December Wrap-up