890 likes | 1.14k Views
Combining 3D Shape, Color, and Motion for Robust Anytime Tracking. David Held, Jesse Levinson, Sebastian Thrun , and Silvio Savarese. Goal: Fast and Robust Velocity Estimation. Our Approach: Alignment Probability. P 1. P 2. Annealed Dynamic Histograms. P 4. P 3. Spatial Distance
E N D
Combining 3D Shape, Color, and Motion for Robust Anytime Tracking David Held, Jesse Levinson, Sebastian Thrun, and Silvio Savarese Goal: Fast and Robust Velocity Estimation Our Approach: Alignment Probability P1 P2 Annealed Dynamic Histograms P4 P3 • Spatial Distance • Color Distance (if available) • Probability of Occlusion
Combining 3D Shape, Color, and Motion for Robust Anytime Tracking David Held, Jesse Levinson, Sebastian Thrun, and Silvio Savarese Goal: Fast and Robust Velocity Estimation t+1 t Baseline: Centroid Kalman Filter Annealed Dynamic Histograms Local Search Poor Local Optimum! Baseline: ICP Actual Motion Occlusions
Combining 3D Shape, Color, and Motion for Robust Anytime Tracking David Held, Jesse Levinson, Sebastian Thrun, and Silvio Savarese Goal: Fast and Robust Velocity Estimation Our Approach: Alignment Probability P1 P2 Annealed Dynamic Histograms P4 P3 • Spatial Distance • Color Distance (if available) • Probability of Occlusion
Motivation Quickly and robustly estimate the speed of nearby objects
System Camera Images Laser Data
System Camera Images Laser Data Previous Work (Teichman, et al)
System Camera Images Velocity Estimation Laser Data This Work Previous Work (Teichman, et al)
Velocity Estimation t+1 t
Velocity Estimation t+1 t
Velocity Estimation t+1 t
Velocity Estimation t+1 t Actual Motion Occlusions
ICP Baseline Local Search Poor Local Optimum!
Velocity Estimation t+1 t
Velocity Estimation t+1 t
Velocity Estimation t+1 t
Velocity Estimation t+1 t
Velocity Estimation t+1 t
Velocity Estimation t+1 t Xt
Velocity Estimation t+1 t Xt
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model Constant velocity Kalman filter
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model
Tracking Probability Measurement Model Motion Model k
Tracking Probability Measurement Model Motion Model k Sensor noise Sensor resolution
Color Probability Probability Delta Color Value
Including Color Probability Delta Color Value
Including Color Probability Delta Color Value