1 / 38

Smart Cameras

Smart Cameras. David Brady Duke University. Smart Products. Legacy Cameras. Experts vs. Big Data. http://www.bollzy.com/blog/guide-dachat-comment-bien-choisir-son-appareil-photo/camera-robot/. Literal vs. Abstract Processing. Visual Cortex. ISP Pipeline. 图像处理管道.

atanya
Download Presentation

Smart Cameras

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Smart Cameras David Brady Duke University

  2. Smart Products

  3. Legacy Cameras

  4. Experts vs. Big Data http://www.bollzy.com/blog/guide-dachat-comment-bien-choisir-son-appareil-photo/camera-robot/

  5. Literal vs. Abstract Processing Visual Cortex ISP Pipeline 图像处理管道 https://en.wikipedia.org/wiki/Color_image_pipeline

  6. System Cameras Traditional system camera -camera back - Lens family • Future system camera • Camputer • Microcamera family

  7. Two Papers and a Patent

  8. DISP Super Cameras Argus 360 array 1998 AWARE gigapixel array 2012 COMPI thin camera array 2003 COMPI IR array 2007 Aqueti Mantis Camera 2017 q360 broadcast array 2015 hG 500 megapixel cameras 2015

  9. Super Cameras in Kunshan

  10. Camera Roadmap

  11. Mantis Array Camera

  12. NVidia Deepstream SDK https://developer.nvidia.com/deepstream-sdk

  13. Camputers

  14. Smart Cameras in the Classroom

  15. Smart Camera Subsystems Size, weight, power and cost per captured pixels are critical factors. Cost per pixel must account for processing, storage and broadcast costs, in addition to camera costs. DISP array cameras focus on radical reduction in SWaP and cost per pixel.

  16. Smart Camera Optics Due to limited aperture size diffraction and Geometric aberration Geometric aberration free Luneberg lens

  17. Discrete Luneberg lens Performance of two layered Luneberg lens approximation

  18. Challenges for spherical focal surfaces • Curved image sensors are not available • Focus is over non-planar manifold Focusing motion

  19. Discrete microcameras array • Utilizing mass produced CMOS sensor • Focusing independently Monocentric multiscale (MMS) architecture

  20. System comparison The information density of the MMS architecture is ten times even more than hundreds times larger than traditional lens architecture.

  21. Potential Improvemetns Microcamera with high complexity Too big and bulky. Far from the physical limit Vignetting over the overlapping field

  22. Galilean multiscale design Negative power group for aberration cancellation Eliminating vignetting

  23. Designexample Specifications: • Effective focal length: • Aperture size: • Aptina MT9F002 CMOS sensor 4.25mm 11.20mm 13.10mm 47.64mm

  24. Comparisonof size of optics More than 10 times smaller Note: The mark (M) used on the table represents microcamera

  25. Future Cameras Aqueti proposes a “system camera” using families of microcameras arranged to address various imaging requirements. The parallel microcamera approach enables much greater capacity per unit camera volume and much lower cost than the conventional approach. The sensor is integrated with the lens at manufacturing and never separated thereafter. • “System cameras” use families of lenses to address various imaging requirements • -FoV • -ifov • -zoom

  26. High resolution Panocam 18 cm

  27. Drone Cam 12 cm

  28. Multiscale Camera 9 cm 8 cm

  29. 360 Camera 15 cm

  30. Design instance 3 EFFL=25mm F/#=2.5 FoV=70 by 50° 32.6mm 68 mm

  31. Sampling and Processing in Smart Cameras Time space and spectra are fungible in computational system cameras.

  32. HierarchicalReconstruction Filtersize32 Residualblocks 8*8*32 64*64*64 256*256*1 Filtersize16 256*256*1 64*64*64 16*16*16 64*64*64 128*128*64 Filtersize8 256*256*1 32*32*2 128*128*64 128*128*64 MeasurementRatio1/8 Blue arrow represents deconvolution represents adding

  33. Results Groundtruth Batchsize8 Batchsize8&32 Batchsize8,16&32+hierarchical

  34. Results Groundtruth Batchsize8 Batchsize8&32 Batchsize8,16&32+hierarchical

  35. RGBimages Groundtruth Groundtruth Batchsize8,16&32+hierarchical Batchsize8,16&32+hierarchical

  36. 未来的相机

More Related