Data Sharing Approaches and Activities in the U.S. Richard Glassco - PowerPoint PPT Presentation

Data Sharing Approaches and Activities in the U.S. Richard Glassco Noblis Consultant to USDOT Office of Operations: Research & Development

Connected Data Systems (CDS) Program Vision – Showing how emerging data can transform surface transportation systems management Mission – The CDS Program seeks to develop scalable data management and delivery methods, □ Exploiting the potential of high-volume multi-source data from connected and automated vehicles, connected travelers with mobile devices & other sources, □ To enhance current operational practices & transform surface transportation system management U.S. Department of Transportation 2 ITS Joint Program Office

CDS Program Goals  The CDS Program will □ provide transportation system operating agencies and their partners □ with tools and guidance that will allow them to ▪ collect and exchange data from connected vehicles and mobile devices ▪ extract value from those data ▪ share data with others U.S. Department of Transportation 3 ITS Joint Program Office

Initiatives of the CDS Program 1. Leveraging Emerging Data Sources 2. Optimizing Data Generation and Transmission 3. Harnessing Next Generation Analytics 4. Developing Advanced Data Management Systems 5. Enhancing Legacy Transportation Management Systems 6. Enabling Stakeholders' Research and Use of Connected Vehicle Data U.S. Department of Transportation 4 ITS Joint Program Office

Research Data Exchange (RDE) • www.its-rde.net • Promotes: •Sharing Collecting & providing access to •Archived & real-time connected vehicle & traveler data U.S. Department of Transportation 5 ITS Joint Program Office

Data Environments in the RDE  14 Current Data Environments: □ CV data from Leesburg, Ann Arbor, Orlando, and Detroit □ Road Weather warnings from Detroit demo □ Multi-modal traffic and signal data from Pasadena, Seattle, Portland, and San Diego □ Probe data from Southeast Michigan testbed  8 Data Environments Coming Soon - Dynamic Mobility Applications □ Multi-Modal Intelligent Signal Systems (MMITSS) □ Intelligent Network Flow Optimization (INFLO) □ Integrated Dynamic Transit Operation (IDTO)  25+ New Data Sets to Be Added to RDE in 2016 U.S. Department of Transportation 6 ITS Joint Program Office

RDE C ONTENT : F EATURES  Advanced Search Capabilities  Multiple File Download Capability  FAQs  External Links  Contact Information  Standard Metadata documentation  Map of Data Location  Registered Research Projects  Sample Data Files U.S. Department of Transportation 7 ITS Joint Program Office

Identifying and Adding Data to the RDE New data sets are added to the RDE as they become available: Data Submission Process □ From other USDOT projects  Researchers invited to submit □ From outside submissions data to add to RDE □ Use “Contact Us” link under the “About” pull-down menu.  USDOT reviews & assesses potential data: □ Value □ Quality  Data added to RDE when it passes this review & criteria U.S. Department of Transportation 8 ITS Joint Program Office

Process for Submitting Data U.S. Department of Transportation 9 ITS Joint Program Office

K EY A SPECTS OF E ACH P HASE : K EY A SPECTS OF E ACH P HASE :  Engage data providers to identify data sources and assess the data source’s content. Decide if data source(s) have research/application potential.  Explore the data by obtaining a sample , and assess the sample for its research value. Decide if data sample will be of sufficient value to continue capture effort.  Obtain complete data sets. Decide on structure for data. Prepare the data for public posting or secure storage.  Post the data and release for public access. U.S. Department of Transportation 10 ITS Joint Program Office

Data Sharing Challenges  Ease of Use for the Data Structure the data files for easy use – no mammoth files □ Comprehensive documentation □  Real-Time vs. Archived Data Determine most useful method of providing data for access and use □  Data Quality Check data quality before, during, and after data collection. □ Verify quality before transmitting for evaluation and sharing to the public □  Timeliness Get data quality checked, documented & available as soon as possible □ U.S. Department of Transportation 11 ITS Joint Program Office

Key Issues Considered to Post Data Key Issues Considered to Post Data  The government must have written rights to distribute or allow others to use the data on RDE  The data must not contain sensitive information (e.g., personally Identifiable Information (PII))  The data must be documented  The data is in a common non-proprietary format  The data has been quality checked U.S. Department of Transportation 12 ITS Joint Program Office

Metadata Documents  Guidance for Metadata Documentation based on ASTM 2468-05 Standard  Required Fields: □ Description of data collection procedures □ Time and location of collected data □ Contact information □ For each data element: ▪ Type (e.g., integer, float, character) ▪ Units ▪ Field length ▪ Max and min values, if applicable ▪ Definitions of codes, if applicable U.S. Department of Transportation 13 ITS Joint Program Office

RDE Registered Users U.S. Department of Transportation 14 ITS Joint Program Office

RDE Artifacts U.S. Department of Transportation 15 ITS Joint Program Office

RDE Sessions per Week U.S. Department of Transportation 16 ITS Joint Program Office

Breakout of Registered RDE Users 600 45% 517 41% 40% 500 35% 400 30% 318 25% 25% 300 20% 192 200 15% 15% 10% 102 82 8% 100 6% 43 5% 3% 17 1% 0 0% University Private For Profit Private Non-Profit Individual Federal State Government Local Government Government Total Number of Registered Users Percentage of Registered Users U.S. Department of Transportation 17 ITS Joint Program Office

Number of File Downloads per Quarter U.S. Department of Transportation 18 ITS Joint Program Office

RDE Collaboration Page U.S. Department of Transportation 19 ITS Joint Program Office

Example of Using RDE Data for Research Project Result Congestion can be predicted with 77% accuracy in 100-feet roadway segments more than 30 minutes in advance using Basic Safety Messages U.S. Department of Transportation 20 ITS Joint Program Office

How We Can Coordinate  Post FOT-NET files on the RDE as new data environments  Coordinate for RDE to “Federate” with FOT-NET files □ Include links to FOT-NET files □ Include in search capabilities  USDOT to take advantage of FESTA guidance □ FESTA guidance has been incorporated in design of Connected Vehicle Pilot program deployment and evaluation  USDOT participation in updating FESTA guidance for data collection  FOT-NET to review USDOT guidance  Coordinated planning for future workshops U.S. Department of Transportation 21 ITS Joint Program Office

How We Can Coordinate  FOT-NET members can publicize RDE to working groups and committees U.S. Department of Transportation 22 ITS Joint Program Office

How We Can Coordinate  U.S. BSM Emulator Simulator can simulate the generation of European Cooperative Awareness Messages (CAM) to compare to U.S. Probe Data Messages, tied to a traffic simulation model (VISSIM or Paramics) U.S. Department of Transportation 23 ITS Joint Program Office

Questions Ariel Gold USDOT FHWA Office of Operations R&D Ariel.Gold@dot.gov Jon Obenberger USDOT FHWA Office of Operations R&D Jon.Obenberger@dot.gov U.S. Department of Transportation 24 ITS Joint Program Office