OSTRACAM U NDERWATER S TEREO I MAGING O LIVER T HIO , P AUL K ILLAM , - - PowerPoint PPT Presentation

ostracam
SMART_READER_LITE
LIVE PREVIEW

OSTRACAM U NDERWATER S TEREO I MAGING O LIVER T HIO , P AUL K ILLAM , - - PowerPoint PPT Presentation

OSTRACAM U NDERWATER S TEREO I MAGING O LIVER T HIO , P AUL K ILLAM , C HRISTINA L IM , C AIO M OTTA OBJECTIVE T O AID D R . O AKLEY AND HIS TEAM IN THEIR STUDY OF O STRACODS BY PROVIDING 3D VIDEO DATA OF THEIR BIOLUMINESCENT DISPLAYS WHAT ARE


slide-1
SLIDE 1

OSTRACAM

OLIVER THIO, PAUL KILLAM, CHRISTINA LIM, CAIO MOTTA UNDERWATER STEREO IMAGING

slide-2
SLIDE 2

OBJECTIVE

TO AID DR. OAKLEY AND HIS TEAM IN THEIR STUDY OF OSTRACODS BY

PROVIDING 3D VIDEO DATA OF THEIR BIOLUMINESCENT DISPLAYS

slide-3
SLIDE 3

WHAT ARE OSTRACODS?

  • OSTRACODS ARE SMALL, BIOLUMINESCENT

SHRIMP, ABOUT THE SIZE OF A SESAME SEED.

  • OSTRACODS USE BIOLUMINESCENT DISPLAYS TO

WARD OFF PREDATORS AND ATTRACT MATES ONLY AT NIGHT WHEN THERE IS NO MOON.

  • THIS RESULTS IN IMPRESSIVE DISPLAYS SEEN IN

WARM, SHALLOW WATERS AROUND THE WORLD.

slide-4
SLIDE 4

WHY OSTRACODS?

  • THERE ARE AROUND 200 SPECIES OF BIOLUMINESCENT OSTRACODS, MANY

HAVING DISTINCT DIFFERENCES IN THEIR BIOLUMINESCENT DISPLAYS

  • INTENSITY
  • DURATION
  • SIZE
  • COORDINATION
  • BY CATALOGUING THESE DISPLAYS AND MATCHING THEM WITH THE GENETIC

DIFFERENCES BETWEEN OSTRACOD SPECIES, WE CAN:

  • FURTHER OUR KNOWLEDGE OF BIOLUMINESCENCE
  • LEARN HOW TO UTILIZE BIOLUMINESCENCE IN FUTURE GENETIC ENGINEERING

EXPERIMENTS

slide-5
SLIDE 5

ADVERSE CONDITIONS

  • SYSTEM MUST:
  • BE SUBMERGED IN SALT WATER
  • BE PROTECTED AGAINST SALT WATER CORROSION
  • BE OPERATED IN A FULL DIVING SUIT
  • HANDLE DIFFERENTIALS IN PRESSURE AS IT IS BROUGHT DEEPER
  • GATHER VISUAL DATA WITH NO AMBIENT LIGHT
  • GATHER HIGH ENOUGH QUALITY DATA TO PERFORM 2D -> 3D STEREO

MAPPING

  • AT 30 FPS
slide-6
SLIDE 6

THE CAMERA SYSTEM

  • TWO ULTRA-LOW-LIGHT WATEC 910H CAMERAS IN A STEREO

CONFIGURATION

  • CONTAINED WITHIN CUSTOM-MADE WATERPROOF “CAMERA TUBES”
  • 3D-PRINTED CAMERA MOUNTS
  • WATERPROOF CONNECTORS TO THE MAIN BOX
  • VIDEO DATA IS SENT TO A MOBILEMULETM 2100 2-CHANNEL MOBILE

DVR

slide-7
SLIDE 7

WATERPROOFING

  • O-RING SEALS ON THE CAMERA TUBES
  • O-RING SEALS ON THE MAIN BOX
  • WATERPROOF CONNECTORS FOR THE CAMERAS

AND FUTURE ADDITIONAL INSTRUMENTATION

slide-8
SLIDE 8

HARDWARE IMPROVEMENTS DELAYED TO YEAR 3

  • NEW BOARD USING A LOWER-FOOTPRINT DECREASED COMPLEXITY

MICROCONTROLLER

  • NEW INSTRUMENTATION:
  • GPS TRACKING
  • TEMPERATURE
  • WATER PRESSURE
  • PH
  • SALINITY
slide-9
SLIDE 9

VIDEO RESULTS

slide-10
SLIDE 10

POSTPROCESSING

1. CORRECT FOR THE FISHBOWL EFFECT GENERATED BY THE SPHERICAL

APERTURE OF THE WATERPROOF CAMERA TUBE

2. SEARCH FOR IDENTIFIABLE FEATURES FROM BOTH CAMERAS AND MAP THEM

TOGETHER

3. GENERATE A RECTIFIED FRAME 4. CREATE A DISPARITY MAP USING THE RECTIFIED IMAGES 5. USE THE DISPARITY MAP TO GENERATE A DEPTH MAP

slide-11
SLIDE 11

Example

slide-12
SLIDE 12

DISTORTION CORRECTION

  • USING A CALIBRATION CHECKERBOARD, IDENTIFY THE CHECKERBOARD

PATTERN

  • USE CHECKERBOARD INTERSECTIONS TO ESTIMATE THE CAMERA PARAMETERS
slide-13
SLIDE 13

Rectification

  • IDENTIFY SURFACE FEATURES
  • MAP THEM TOGETHER
slide-14
SLIDE 14

RECTIFICATION

  • OVERLAY CORRECTED FRAMES FROM BOTH CAMERAS TO GENERATE A

RECTIFIED FRAME, USING THE STEREO PARAMETERS

slide-15
SLIDE 15

Disparity Map

  • APPLY BLOCK MATCHING TO THE RECTIFIED IMAGES TO GENERATE A DISPARITY

MAP

slide-16
SLIDE 16

Disparity Map

  • APPLY BLOCK MATCHING TO THE RECTIFIED IMAGES TO GENERATE A DISPARITY

MAP

slide-17
SLIDE 17

GENERATE DEPTH MAP

  • GENERATE A DEPTH MAP USING THE DISPARITY MAP USING GEOMETRY
  • DISTANCE = BASE_OFFSET * FOCAL_LENGTH / DISPARITY
slide-18
SLIDE 18

GENERATE DEPTH MAP

  • GENERATE A DEPTH MAP USING THE DISPARITY MAP USING GEOMETRY
  • DISTANCE = BASE_OFFSET * FOCAL_LENGTH / DISPARITY

BLUE IS CLOSER, YELLOW IS FURTHER

slide-19
SLIDE 19

DE-NOISING

slide-20
SLIDE 20

QUESTIONS?