Mirrorless and Lighting - NVIDIA

1 Mirrorless and LightingDominic HillenbrandOctober, 2014 NVIDIAD esign of HeadlampsRound shape like eyesLine style-designLamp defines brand-signature especially DRLNVIDIAR ound shape like eyesDesign of HeadlampsLine style-designLamp defines brand-signature especially DRL Lamp design directly relates to sales First step in new car designsNVIDIAD esign of Mirrorless CarsLine style-designLamp defines brand-signature especially DRLSide cameras replace mirrorsNVIDIAD esign, Safety and glare, LED replacement,Camera repair/calibrationVehicle Manufacturer Good design sells GovernmentCustomerRegulationsAccidentsNV IDIAE xample: Upcoming Rear-Mirror CMS Flip-mirror due to liability/government approval Night time: head lamps cause halos Positions of cameras crucial - conflicts with design Display limited dynamic range, requires tone mapping Challenges:Ref: CMS provides wider (unobstructed) field of view Overlays feasibleECUM onitorCameraNVIDIAFlip-mirror: Liability/ApprovalFlip mirror: display vs.

2 GlassDisplayGlassLeverRef: : Upcoming Rear-Mirror CMS Flip-mirror due to liability/government approval Night time: head lamps cause halos Positions of cameras crucial - conflicts with design Display limited dynamic range, requires tone mapping Challenges:Ref: CMS provides wider (unobstructed) field of view Overlays feasibleECUM onitorCameraNVIDIAE xample: Upcoming Rear-Mirror CMS Flip mirror due to liability/government approval Night time: head lamps cause halos Positions of cameras crucial - conflicts with design Display limited dynamic range, requires tone mapping Challenges:Ref: mirrors still presentNVIDIAB igger Challenge: Side mirrorsSide cameras replace mirrors Mirrorless affects with mirrors may beperceived old-fashioned Reduced wind resistance Capability to eliminate blind spots Impact hazard / No broken mirrors Stricter regulation (CMS can be sold - only if the side mirrors are retained!) UNECE Addendum 45: Regulation No. 46 refers to ISO/FDIS 16505 Ref: to side-mirrors: NVIDIA bast study 2014 - tunnel Ref: Study on Camera Monitor Systems - Eike A.

3 Schmidt, Rainer Krautscheid -Informal Group on Camera Monitor Systems in Reg. No. 46 Berlin, - Bundesanstalt f r Stra enwesenVehicle disappears for about 1sNVIDIA bast study 2014 direct sun lightRef: Study on Camera Monitor Systems - Eike A. Schmidt, Rainer Krautscheid -Informal Group on Camera Monitor Systems in Reg. No. 46 Berlin, - Bundesanstalt f r Stra enwesenNo meaningful picture for about 2sNVIDIA bast study 2014 nightRef: Study on Camera Monitor Systems - Eike A. Schmidt, Rainer Krautscheid -Informal Group on Camera Monitor Systems in Reg. No. 46 Berlin, - Bundesanstalt f r Stra enwesen Smear / blooming No discomfort glare Point light sources are displayed as points light sourcesNVIDIAUNECE Regulation No. 46: Monitor PlacementwithMirrorsBased on: Annex 12 # - Camera Monitor arrangement OICALink : UK proposal for CMS monitor arrangement - Paris, 5th June 2014 Department for TransportNVIDIAUNECE Regulation No. 46: Monitor PlacementCMS1:1 monitorplacementBased on: Annex 12 # - Camera Monitor arrangement OICALink : UK proposal for CMS monitor arrangement - Paris, 5th June 2014 Department for TransportNVIDIAUNECE Regulation No.

4 46: Monitor PlacementOICA proposalfrom June 2014 Central DisplayContinuous viewBased on: Annex 12 # - Camera Monitor arrangement OICALink : UK proposal for CMS monitor arrangement - Paris, 5th June 2014 Department for TransportNVIDIAT akeawaysUpcoming CMSR eplace rear mirrors1:1 camera to monitorProcessing mappingColor calibrationLens undistortionFuture CMS Replace side andrear-mirrors Continuous central monitorsProcessingStitching of multiple FOVsChallengesNight time Halos/blooming/flickerDynamic rangeMotion blurChallengesGhosting / ArtefactsProcessor performanceRegulationLiabilityStep from image processing to advanced computer vision/graphicsNVIDIAF ront Lighting Technology - Innovations 1991-94 HIDLow beamHigh Intensity Discharge (HID)HIDlow + high beam20012006-2008 LEDlow + High beamLASERHigh beam booster2014 AFSNo. 123 AdaptiveFront LightingHIDNo. 98 LED No. 112 leveling-Change of LED/light source-Color boundaries-Dynamic turn indicator-Variable Intensity DRL-Adaptive Driving Beam SystemLED Matrix UNECE regulationsRegulation &Technology always in flux hot topics DRL No.

5 87201X Pixel-Light ResearchNVIDIAA daptive Driving BeamRef: Regulatory Impacts of Advanced Lighting Systems - Stephan Berlitz Ref: : Lighting Roadmap 2020 - Stephan Berlitz - ISAL 2013 ProceedingsPreventglare foroncomingvehiclesLED Matrix NVIDIAC ompute Optimal light distributionSystem Architecture of a fully adaptive Headlamp System(Stereo)-CameraRadarLIDARN avigation SystemVehicle SpeedSteeringWheel-AngleYaw-RateRain-Sen sorLight SensorCar-2-XSensor Fusion3D-EnvironmentModelActuation of Light ModuleTranslate lightdistribution SensingProcessingActuationRef: First approach to reach the goal of a fully adaptiveHeadlamp - Ingo Hoffmann et al. ISAL 2013 ProceedingsNVIDIAP arallels: CG- and automotive Lighting Pixel LightProgram controls physical Lighting of sceneComputer graphics scene rendered to 1024x768 pixels Shader-Programs determine virtual Lighting 3D-models required for accurate lightingNVIDIAO utlookPixel-LightResearch group of Prof. Dr. Cornelius Neumann at KITM atrix light: 50 pixelResearch prototype: 12 million pixelAcquiring 3D-environment models Passive: Stereo-camera Active Feedback Camera & Head lampHead lamp emits structured lightHead lamp pulses - time of flightRef: Pixel Lighting An Automotive Lighting ResearchHead Lamp - Steffen Michenfelder, Prof.

6 Dr. Cornelius NeumannISAL 2013 ProceedingsRef: Automatische Justage eines hochaufl senden Scheinwerfers Boris Kubitza et 2013 ProceedingsPixel Light 6 HD projectorsNVIDIA