Smart Eye - King of automotive’s Interior Sensing AI?

APRIL 27, 2021

Smart Eye’s approach to data collection and privacy

In one of the most well-known clichés, the eyes are the mirror of the soul. But no matter how worn-out the saying is, it might help explain why the idea of someone analyzing images of their eye movements makes some people feel a bit uneasy.

At Smart Eye, collecting video data of humans is essential for developing the technology that eventually winds up in cars or labs all over the world. Images of eye and head movements are what enable us to further scientific research and save lives on the roads. And in order to make our systems as advanced and accurate as possible, they need access to large banks of video data.

But of course, accuracy shouldn’t come at the cost of anyone’s privacy. We realize that in the context of personal data, footage of someone’s head and eye movements can feel especially personal. That’s why we want to walk you through how we gather video data – and what we are doing in order to protect the privacy of the people behind that data.

Why do we collect data?

Before we get into the specifics of the data collection process, we need to let you know why we collect video data in the first place.

Our eye tracking technology is partly based on machine learning, making data collection a crucial part of developing and improving on our software. Think of it as trying to learn a new language. It would be impossible if you didn’t have access to examples of people speaking the language, or sentences written in it. It’s the same with our eye tracking algorithms – there is no way to teach our technology to recognize gaze patterns without feeding it images of eye and head movements. This process is what we refer to as training our software.

Once we’ve developed a finished product, it needs to be continuously tested in order to make sure it lives up to our customers’ expectations. This process is called validation and uses the same types of data as the training of the system.

These two processes, the training and validation of our systems, are our only reasons for collecting video data. Once our products are sold and installed into a vehicle or a research lab, the product has no need for storing any video data. While data collection is unavoidable during the system’s development phase, it is not necessary for the system to work.

How do we collect data?

Our training and validation data come from test sessions with fully informed and consenting participants. These sessions take place in both stationary and driven settings. In the stationary settings – either a lab or in the driver’s seat of a parked car – we have full control of what types of data we are able to gather. Meanwhile, the tests performed in a moving car allow us to observe the participant at their most natural behavior.

Whether the tests take place in a stationary or driven setting, they start with a camera that captures an infrared image of the test participant’s head and upper body. The infrared light generates a sequence of greyscale images, which is all the information our systems need in order to analyze the test participant’s eye movements. The sequence of images, along with the output from our systems, are then saved for evaluation.

The GDPR and legal protection of personal data

Even though we place high value in privacy, our test participants can rest assured that their personal data is protected by legal measures as well. With our headquarters located in Sweden, Smart Eye follows European regulations concerning personal data, including the General Protection Regulation (GDPR). The GDPR regulates the management of personal data and is described by the European Union as the toughest privacy and security law in the world. And since Smart Eye is registered as a European company, the GDPR also applies to any data collection associated with our offices in the United States, China and Japan. In fact, we are required to make sure any data we collect, or even receive, from other parts in the world is in accordance with the GDPR.

Where does the data end up?

Generally speaking, the more data you have access to when developing a product based on machine learning, the better. So, in order to make our technology as accurate as possible, we need access to very large amounts of data. And when that data includes video content of people, we need to make sure our system for storing it is practically bulletproof.

From the second the data is recorded, the only people with access to it are the developers at Smart Eye who use it for development projects. Any newly collected data is temporarily stored on the computers used for recording the data. The recording computers and all intermediate systems are kept in Smart Eye premises and security is ensured by state-of-the art security mechanisms, like policy-based access control such as user rights through login and passwords. But the long-term destination for the data is at our servers at high-security data centers in Gothenburg, Sweden.

As any scientist would tell you, data and data collection is the very foundation of research and development . And when you develop technology that is built on filmed footage of people’s eye movement, you need to handle that data with great care. At Smart Eye, the data we collect is one of our most valuable assets , and we spare no effort in making sure it is secure.

16 tykkäystä

Ohimenevä ongelma.

10 tykkäystä

On toki, mutta voinee vaikuttaa tuotantomääriin pitkälle 2022. Ei hyvä juttu ja mietin viikottain pitäiskö myydä Smartit ja tulla myöhemmin takas junaan.

Harmillisesti ennustan että dms lykätään niin pitkälle kuin mahdollista oem toimesta.

edit:

“— essential components that help power everything in a vehicle from infotainment systems to power steering — could cost the global auto industry up to 3.1 million vehicles and more than $61 billion this year, according to a forecast from industry consulting firm Alix Partners.”

Eli joku noin 5% vähemmän kiesejä pelkästään tänä vuonna.

Mutta paljonko DMS ja muuta kehittyneempää tekniikkaa jätetään malleista pois pulan vuoksi, se lienee tärkein kysymys?

3 tykkäystä

Tässäpä mielenkiintoinen lyhyt twiitti. Tämän voi tulkita monella tavalla, mutta odotellaan kuullaanko myöhemmin enemmän.

12 tykkäystä

PSA taitaa mennä kilpailijan leiritykseen, mutta tässä DS9:n ohjaamosta voi bongata IR-kameran myöskin tuosta ratin päältä. Ihan hyvä, että teknologia yleistyy ja menee juurikin premium-mallit edellä kuten alalla jaetut winnit ja DMS-talot itse kertovat.

Lisäys: Genesiksen kolmas malli, jossa DMS on siis G70. Näköjään siihen ovat siirtäneet IR valot mittariston yläosasta mittariston alaosaan. Vahva veikkaus Smart inside.

28 tykkäystä

Saikos tätä tolla SEYE tickerillä jotenkin Google Sheetsiin vai pitääkö seurata SE9 tickerillä?

1 tykkäys

Cenkoksen rapsasta löytyy muuten heidän forecastit pahimmalle kilpailijalle. Ei muuten sen katsomisen jälkeen tarvitse paljoa pohtia kumpi on houkuttelevampi sijoitus ainakin muutamien vuosien tähtäimellä…

19 tykkäystä

Three United States senators on Monday [proposed legislation] that would require all new cars in the United States to have driver-monitoring systems within six years. Two of the legislation’s sponsors—Ed Markey (D-Mass.) and Richard Blumenthal (D-Conn.)—recently sent a letter to federal regulators expressing concern about last week’s fatal Tesla crash in Texas.

42 tykkäystä

Ei uutta mutta Smartin ja Volvon ym. tutkimusprojektista juttua.

(Varmaan näillä näytöillä Seeingiä menee volvoihin… not! :sunglasses:)

https://www.saferresearch.com/news/re-engage-new-safer-associated-project-will-support-safer-transition-between-automated-and

Lisäys: OMS on tulossa

22 tykkäystä

Ette usko kuinka kuumeisesti olen etsinyt…mutta aikaisemmin Hyundain SmartSense ja Driver Attention Warning (DAW) on ollut rattitunnistuksella ja lane keeping assistilla tehty. RedEye epäilee että 2022 alkaen DMS-kamera tulisi vakiona hoitamaan tätä… Ioniq 5:ssa on tietääkseni SmartSense päivitetty versiosta 1.5 versioon 2 (?), mutta DAW:n yksityiskohdista ei meinaa löytyä infoa. Noh nyt tuli tämä vastaan:

Se on jo tiedossa, että Hyundai hoitaa takapenkin OMS:n infraääni-/vast. Sensoreilla mutta DMS muuttuminen kameraan on avainkysymys.

Mitäs mieltä olette tuosta poiminnasta?

Lisäys:

Hyundai sivuilla näin :cold_face:

Lisäys2: pistin pikku viestin Hyundai Europelle :relaxed::laughing: wish me luck :sunglasses:

113 tykkäystä

Tässä odotellessa voi tosiaan todeta owners manuaalien olevan hyvä paikka tiedusteluun.

Tucson 2022 ei ole DMS cameraa. Varmistin manuaalista.

Seuraavaksi Ioniq 5 manuaalia pitää alkaa kytätä.

http://webmanual.hyundai.com/

16 tykkäystä

https://inf.news/en/auto/e4cce9d71e5038e9afc0687bac3f1bef.html

In addition, it is worth mentioning that the DMS driver fatigue monitoring system can detect the driver’s driving state through the camera, and will immediately alert when the system detects that the driver is in a fatigue state. It is a very warm design.

DMS:ää pukkaa autoihin, ei kylläkään hajua kenen.

5 tykkäystä

Tuleeko huominen osari ulos ennen pörssin avausta? Smartin sivuilla mainitaan vain päivä, ei kellonaikaa.

4 tykkäystä

Veikkaan Suomen aikaa 9-11 väliä.

5 tykkäystä

Melkein offtopic mutta “DMS”:n (Dementia Monitoring System?) uusia tuulia kuitenkin, kameraa ei kaiketi käytössä. Jutun mukaan tollasessa projektissa kerättiin dataa 4 vuoden ajan karvan alta 3000 hengen ajamisista.

5 tykkäystä

Volvo dominoi

12 tykkäystä

Tänä kesänä Genesis tulee myös Eurooppaan. Näissä toivottavasti Smart Eye.

9 tykkäystä

Semisti offtopic: käsitin twitteristä, että Viktor Westman taitaa lähteä Red Eyeltä… Kuka meidän Smart-analyysit jatkossa tekee :frowning: . Kuka toimii vastavoimana Colinille?

ps. Ostaakohan rahastoonsa Smarttia…?

2 tykkäystä

twitter.com/jesperhenrikson

ja ehkä vähän

twitter.com/timontti täällä palstalla?

57 tykkäystä

The effects of the pandemic decrease – new opportunities are created

  • Net sales totaled SEK 18.1 (17.7) million which corresponds to an increase of 2 %.
  • Operating loss totaled SEK -18.4 (-22.0) million. This improvement is primarily due to a decrease in costs during the quarter.
  • Profit/loss after financial items was SEK -18.4 (-22.1) million.
  • Profit/loss after tax per share is negative.
  • Cash and cash equivalents totaled SEK 201.4 million at the end of March.
  • In January, a design win was obtained from one of China’s largest OEMs. The new order is for a new car model on a new platform and has an estimated order value of SEK 50 million. This is Smart Eye’s third customer on the Chinese market.
  • As of first quarter 2021 Smart Eye classifies operating expenses by function instead of nature of expense. This transition has been made to offer a more true and fair view of the Company and its activity.

Comments from the CEO

Another quarter is now over. Unfortunately, the pandemic has not abated at the pace we had all hoped for, but it has not affected Smart Eyes’ everyday work to any greater extent. We have had a high level of activity in all of our business areas and we are starting to get used to the “new normal”, with fewer face-to-face meetings and less travel. In the current situation, the local offices we had managed to open up in Japan, China and Detroit before the pandemic broke out have proved to be of great value.

Our local offices have been important for our ongoing delivery projects and also for the procurements that are yet to be decided. Due to the fact that our offices outside Sweden have been so successful, we have now begun the process of establishing a new office, this time in Germany. Regardless of the future of the pandemic, we will be even closer to the important German automotive market from the beginning of Q3.

Automotive Solutions
At the beginning of the quarter, we were able to announce a design win with yet another new OEM, the thirteenth so far. The OEM is one of China’s largest car manufacturers, to which we will supply DMS together with a large and reputable global T1 supplier. It is with great pleasure that we can state that Smart Eye’s offer is strong on all important markets. Our technological leadership is undisputed and the main reason for our success.

At the same time as we work relentlessly with DMS and the important procurements that are underway, we are also seeing an increasing interest in what is referred to as Interior Sensing; even more advanced solutions where the entire car interior is analyzed. We are seeing a demand for both focused monitoring of the driver’s state and more zoomed out monitoring of the entire cockpit of the car.
We estimate that the total market potential will be greater than what we have previously communicated for only DMS.

It is still too early to be talking about proper procurements, but we believe procurement processes are due to be initiated in the not-too-distant future. The situation is reminiscent of what we saw on the DMS market back in 2014, at which point we were already quite confident that DMS would be installed in premium cars in the near future. We are preparing for a situation where our customers will soon be requesting both DMS and Interior Sensing from us, which will lead to an increased added value per car.

Aftermarket AIS
On March 11, we launched the aftermarket product AIS. It has been under development for two years but suffered some delays caused by the Covid-19 pandemic. Since the launch, we have had an increasing number of inquiries and we are optimistic about the market for the aftermarket product, which will be sold on a global market.

Research Instruments
Demand has continued to recover but is not yet completely back to pre-corona levels. Our customers have not fully returned to the universities and research laboratories where our equipment is used.

Final words
The pandemic is affecting most of what is happening right now. But there are not only problems, we also see opportunities. We are seeing a further development of the technology, with more and more AI and technologies extending to the entire car interior. In combination with the Covid-19 pandemic, this creates a dynamic market situation where the right strategic actions can have major consequences. We are looking at several different strategic alternatives in order to best take advantage of the opportunities we are seeing. DMS and, by extension, Interior Sensing are here to stay in the automotive industry, where we are currently the leading supplier. And it is our definite ambitions and goal to remain so in the future.

31 tykkäystä