Compared to driver state monitoring systems (DMS), or even occupant monitoring systems (OMS) for which we have experienced huge advances in terms of safety regulations and technology in recent years, the approach to in-cabin monitoring systems for public transport is relatively recent but closer than many might think.
Are near-infrared (NIR) cameras key to enabling in-vehicle sensing advances to pass the Euro NCAP adequation and safety assessment?
Traditionally, if we can use that term to talk about technology as recent as in-cabin and driver monitoring systems, camera positioning has been bound above the dashboard and the center stack. But, are these camera placements optimal? Are these able to faithfully monitor the other occupants as well and not just the driver? Why stick to only these positions? Opening the door to simulation can help optimize the system without wasting budget, but let’s start from the beginning.
If you are an OEM, or simply you are involved in any of the automotive interior sensing systems development stages, surely you are familiar with the Euro NCAP* requirements to assess the adequation and safety of the new in-cabin monitoring systems. And if you are not, do not worry, because we will break them down throughout this article.
SHARE Just like on a spooky Halloween night, anything sudden and unexpected could happen during a car trip… So better make sure your in-cabin monitoring system is well trained right? Driver monitoring, occupant monitoring, autonomous driving, and other autonomous deep learning-based visual systems… are critical use cases in which the safety of the occupants is …
Trick or treat, don’t let your in-cabin monitoring system AI be tricked! Read More »
In this article we will try to answer several questions: why is the near infrared band key for (camera-based) in-cabin monitoring systems to perform well in low light? Why is simulating the NIR a challenge? What solutions have been used so far to simulate it? How does Anyverse simulate it?
Why should you seriously consider synthetic data to train and validate in-cabin monitoring systems? What are the advantages of synthetic data versus real-world data to train these systems? And why are many DMS/OMS developers already implementing synthetic data in their data generation pipelines?
There are several in-cabin monitoring use cases, and likewise, they have different data needs, hence, different data challenges that you need to overcome if you want to successfully train the deep learning models behind the systems.
Whether it’s DMS, OMS, or any other interior camera system, acquiring data to develop in-cabin monitoring systems is challenging. But… Why is that? Why is acquiring real-world data particularly hard for the in-cabin monitoring use case?
DMS, OMS, HMI… We are heading 2022 and there is no doubt that interior sensing applications are rising exponentially, and they will continue to do so in the coming months.
