Unm anned Aerial System s: A Look Into UAS at ODOT Tim Burkholder, - PDF document

10/6/2016 Ohio Department of Transportation John R. Kasich, Governor Jerry Wray, Director Unm anned Aerial System s: A Look Into UAS at ODOT Tim Burkholder, PS Kyle Ince, EI Mapping Manager Transportation Engineer Division of Engineering Division of Engineering Office of CADD and Mapping Services Office of CADD and Mapping Services July 20 16 ODOT’s Current Position Flight Operation Testing Accuracy Assessment ODOT Business Policy Processing Workflow Deliverables Several active COAs LAW-52 and Deer Creek State Park Section 333 Exemption Flying under Part 107 A Look Into UAS at ODOT 2 1

10/6/2016 ODOT’s Current Platform : SenseFly eBee RTK Weight = 1.61 lb including camera Wingspan = 38 in. Material = EPP foam, carbon structure & composite parts Propulsion = Electric pusher propeller, 160 W brushless DC motor Battery = 11.1 V, 2150 mAh A Look Into UAS at ODOT 3 SenseFly eBee RTK Hardware Connects directly into the CORS RTK network for survey grade accuracy and real time corrections. (L1/ L2, GPS and GLONASS) 3 cm horizontal and 5 cm vertical accuracy without ground control pts.* Canon WX (18.2 MP) auto-triggering camera 40 min. max flight time During the duration of this presentation the eBee RTK can map a 4.5 square mile area (lowest resolution at the highest altitude) More typical flight 50 acres (2.5 cm per pixel) in less than 10 minutes* *Perpendicular flight lines A Look Into UAS at ODOT 4 2

10/6/2016 SenseFly eBee RTK Software eMotion Flight Planning and Control Software Postflight Terra 3D  Pix4D Professional Photogrammetry Software A Look Into UAS at ODOT 5 eMotion Flight Pla nning a nd Control Softw a re Planning Allows user to use 3D mission planning to plan the perfect flight. Simulation Puts the perfect flight plan to the test in 3D with the UAS safely on the ground. Monitoring and Control Using the same interface the operator can control and monitor the UAS in flight A Look Into UAS at ODOT 6 3

10/6/2016 Postflight Terra 3D Check in the Field Provides a quick quality report in the field to insure proper coverage and accuracy Generate Orthos, 3D m odels & Point Clouds Creates deliverables directly into the remote sensing workflow. (.las and georeferenced tiff images) A Look Into UAS at ODOT 7 Rem ote Sensing Deliverables Orthomosiac Raster 3D Point Cloud in .las format DSM in a geoTIFF 3D Textured Mesh Contours Imagery in .tif format A Look Into UAS at ODOT 8 4

10/6/2016 ODOT Best Practices and Workflow Processing Site Flight Planning Simulation and Preparation Operations Deliverables A Look Into UAS at ODOT 9 Planning Site Reconnaissance Obstacles Trees Utilities Airports Safe Zones Primary and Alternate Landing Sites Access Control A Look Into UAS at ODOT 10 5

10/6/2016 Sim ulation A Look Into UAS at ODOT 11 Site Preparation Ground Truth Day of Flight Conditions Obstacles Weather Site Access Internet Connection Line of Sight A Look Into UAS at ODOT 12 6

10/6/2016 Flight Operations Pre-flight checks Airframe Condition Wings, Propeller, Pitot Tube, Ground Proximity Sensor, Batteries, Camera, etc. Crew Briefing on Operations Flight Plan Upload Check parameters, set landing point, etc. Document Operations and variables A Look Into UAS at ODOT 13 Flight A Look Into UAS at ODOT 14 7

10/6/2016 Post Flight PAPERWORK!!!!! Flight, Resolution Altitude, Battery Voltage Flight Time, Wind Data check Overlap Sidelap Photo Quality A Look Into UAS at ODOT 15 Data Downloading and Processing Downloading Flight Data Logs Command module (computer) UAS on-board log Images Meta Data Infusing Geo-tagging Images Writing header information A Look Into UAS at ODOT 16 8

10/6/2016 Structure from Motion Structure from Motion is a photogram m etric technique used to estim ate 3D structures with 2D photos. A Look Into UAS at ODOT 17 Structure from Motion Sim ilar to how stereo vision works 3D LiDAR and Imagery Photogrammetry Camera Captures Software Identifies and Extracts Geometry to Overlapping Images Matches Thousands of Calculate Pixel while in Motion Keypoints Positioning A Look Into UAS at ODOT 18 9

10/6/2016 Final Processing Software Packages PostFlight Terra 3D, Pix4D, Agisoft, and Context Capture Inputs Control (Ground Truth) Geotagged Images A Look Into UAS at ODOT 19 Ground Control A Look Into UAS at ODOT 20 10

10/6/2016 Deliverable Creation Point cloud Exported in multiple formats Example .las Orthophoto Exported in google tiles and geotiff Textured Mesh Meshed surface with the orthophoto referenced A Look Into UAS at ODOT 21 Deliverable Creation Continued A Look Into UAS at ODOT 22 11

10/6/2016 Orthophoto A Look Into UAS at ODOT 23 Deer Creek Test Outlined area was tested against our m anned aircraft & topographic surveying using a total station. A Look Into UAS at ODOT 24 12

10/6/2016 Deer Creek Test Flight @ 235.4 AGL 60 % Lateral & Flight @ 353.5 AGL 60 % Lateral & 75% Longitudinal Overlap 75% Longitudinal Overlap A Look Into UAS at ODOT 25 Deer Creek Test Flight @ 353.5 AGL 60 % Lateral & Com bined Flights @ 353.5 and 235.4 75% Longitudinal Overlap A Look Into UAS at ODOT 26 13

10/6/2016 Pros vs. Cons Pros Affordability Compared to conventional data collection Accessibility (except over live traffic) Safety Removes human interaction from dangerous situations Field to finish capabilities A Look Into UAS at ODOT 27 Pros vs. Cons Cons Accuracy Determining viability Inability to traverse live traffic Specialized training Liability Issues Black-Box type Software Enormous amounts of data A Look Into UAS at ODOT 28 14

10/6/2016 Lim itations with Photography Inability to triangulate key points across water Photogrammetric problem Structure from Motion without the m otion Objects can’t move within photos Example vegetation A Look Into UAS at ODOT 29 Cam era Variables When choosing a cam era: Megapixels are not the most important part Fixed Focal Length*** Stable photography Fast exposure times with less image blur Metric lens A Look Into UAS at ODOT 30 15

10/6/2016 Platform s A Look Into UAS at ODOT 31 Sensors A Look Into UAS at ODOT 32 16

10/6/2016 eBee Plus A Look Into UAS at ODOT 33 ODOT Moving Forward Reviewing FAA guidelines to evaluate ODOT safety and policy needs that will need to be required above FAA regulations (i.e. may require additional observers, liability insurance, develop additional privacy policies, public notifications, etc.) Once all specifications and policies are in place, will develop prequalification process for contractors and consultants Will evaluate program expansion to DOT District Survey Offices As well as expansion to other business areas within ODOT A Look Into UAS at ODOT 34 17

10/6/2016 Hurdles with the Start of a UAS Program Waviers and Regulations Rogue Operators Over 583 UAS sightings reported by pilots in the last 6 months Latest Report by the FAA Aug-2015  Jan-2016 Halted firefighting operations in California wildfires Preparing the Proper Workflow and Safety Plan Deciding and Evaluating a Platform Sensors and Airframe A Look Into UAS at ODOT 35 Ohio Contacts/ Inform ation for UAS Indiana/ Ohio UAS Center and Test Com plex: http:/ / www.dot.state.oh.us/ Divisions/ uas/ Pages/ default.aspx Ohio Departm ent of Transportation: http:/ / www.dot.state.oh.us/ Divisions/ Engineering/ CaddMapping/ Survey/ Page s/ UnmannedAerialVehicles.aspx A Look Into UAS at ODOT 36 18

10/6/2016 Questions? Tim Burkholder, P.S. Mapping Manager Tim othy.Burkholder@dot.ohio.gov Kyle Ince, EI Transportation Engineer Kyle.Ince@dot.ohio.gov A Look Into UAS at ODOT 37 19