Smart Eye - King of automotive’s Interior Sensing AI?

Tolla videolla on alkupuolella esitelty uuden S mersun Interior Assistia. Näyttää olevan paljon toiminnallisuuksia myös takapenkillä.

Qt ketjusta poimintana tämä:

3D näytön toiminnallisuuden, DMSn ja Interior Assistin kanssa käytetään siis kameroita. Artikkelin mukaan

Sisätila-avustimen toiminta perustuu kahteen laserkameraan, jotka on sijoitettu auton kattokäyttöyksikköön.

Tuossa lienee hyvä esimerkki siitä, mitä ovat ns. Premium tason DMS softan käyttötarkoitukset high end classissa.

Voi silti olla, että tämä on Seeingin 2017-2018 winneistä, mutta hyvä osoitus kyvykkyyksistä…

DMS toimittajien kannalta olisi todella hyvä juttu, jos kamerat laajenisivat kattamaan tuon takapenkin. Tulevaisuus näyttää miten käy

16 tykkäystä

Hienoisesti kerkesit ensin. Tulee vaan mieleen Alhangon puhelu smartin johdon kanssa siitä, että 5€ per auto voi olla aika vähän, kun toiminnallisuudet lisääntyy!
S-sarjalla on ollut tapana toimia suunnannäyttäjänä autoalan trendeille.

7 tykkäystä

Tuossa vielä avattuna tuota mbux järjestelmää.
Tulee mieleen, että taitaa olla alunperin Nvidian mukana tuossa MBUX järjestelmässä, mikä ei tosin takaa, että ois smartin softaa sisällä, mutta tuskin heikentääkään mahdollisuutta?
Toisaalta seeingin cualqomm yhteistyövideossa oli uusia mersun sisätiloja ilman logoja. Mahtavaa kuitenkin.

Ja kun muistelee Astonin vanhempia viestejä nvidian, smartin ja mersun yhteistyöstä, niin tässähän aivan innostuu.

13 tykkäystä

SEE was tied to an exclusive arrangement with Takata (now bought or taken over by Joyson). This exclusivity allowed SEE to enter into the win for installing its DMS into the award winning and highly commented Spercruise system. however, the outcome the litigation regarding Takata’s airbag resulted in bankruptcy for Takata and during this time other DMS providers were able to secure design wins/ programme wins e.g. Smart Eye.

3 tykkäystä

En tiedä oliko tämä maksullisen raportin teaseri täällä…

Eye Tracking Market to Witness Huge Growth by 2026 | SteelSeries, Smart Eye, Eyetech Digital Systems

The study covers emerging player’s data, including: competitive landscape, sales, revenue and global market share of top manufacturers are Sensomotoric Instruments GmbH (Germany),Smart Eye AB (Sweden),SteelSeries (Denmark),SR Research Ltd. (Canada),Eyetech Digital Systems Inc. (United States),Applied Science Laboratories (United States),Tobii AB (Sweden),LC Technologies (United States),Eyetracking Inc. (United States),Imotions (United States),Polhemus (United States).

Toki tuo kattaa paljon eri teollisuudenaloja, mutta yleisestikin hyvä markkina tämä eye tracking.

19 tykkäystä

https://www.google.fi/amp/s/www.proactiveinvestors.co.uk/companies/amp/news/180029

Seeing Machines Ltd (AIM: SEE), whose eye-tracking and facial recognition technology could be integral to the next generation of semi-autonomous cars, said its automotive business is unaffected by the bankruptcy of Takata.

It pointed out it works with the Japanese car parts supplier on a non-exclusive basis to deliver a driver monitoring system (DMS) and will maintain that relationship with the group or its successor.

At the same time Seeing Machines said it collaborating with a “broad and expanding range” of other tier-1 partners to meet manufacturer demand for its Fovio platform and processor.

7 tykkäystä

The nature of the exclusivity arrangement did affect its ability to enter RFQs for other OEMs. It required SEE to buy itself out. And therefore, a degree of catching up to be able to gain business.

1 tykkäys

Pay to extricate itself from the arrangement.

1 tykkäys

I do admit Takata bankruptcy was not the best starting point to approach critical dms phase. However, Smart has won 82/84 design wins after the bankruptcy (6/2017).

Ok, let’s say there was one year “grace period” to catch up. Smart has won 67/84 design wins after 6/2018.

So how long SM is planning to catch-up?

16 tykkäystä

Let’s see what happens.
Ask yourself why Martin or Viktor has never mentioned Ford. Did Smarteye even bid?
In the meantime it’s good that Smarteye have collaborated with OmniVision and Amberella, whereas SEE have licensed their tech to OmniVision and have partnered with Qualcomm.

1 tykkäys

I’d rather argue with facts. Otherwise this gets very unfruitful discussion (just like in January). Hence, I agree with you: let’s wait and see.

12 tykkäystä

Hi Aston,
I do remember this video from CES along with another one that was done as a single take with a walk around the booth. What I remember from that other video was you could watch the “driver” and see the variable delay in the OMS rendering. (watch at 1:14 2020 CES Live: Smart Eye AI-powered Eye Tracking Technology to identify driver distraction - YouTube ) Remember that, I will come back to it later.

Have you seen the BMW demo with the iConcept Ease (only a German company could come up with a name like that) where the driver could ask about what things were that they were looking at outside of the vehicle? How about the recent Cerence video, where the driver asks “Hey, Mercedes what is that building?” as she drives along. https://analyticsread.com/2021/01/cerence-look-adds-visual-ai-to-automotive-virtual-assistants/ Those systems need multiple systems with known levels of accuracy and timing to work together. Cerence does the listening, another company does the detailed mapping including I presume height information, so it can identify what is visible from the road above and behind other items, whilst not doing Xray vision through buildings. For this to work you need accurate positioning on the map for the vehicle at the time the question is asked, with the gaze vectors at the time the question is asked from the location of the eyes at the time the question was asked. Note there is a duration for asking the question and a delay in interpretation, so have to go back to the actual time for the locations. Remember, I mentioned the delay in the Smart Eye video, that is OK when identifying the driver when parked. If it is not too long it is OK while driving for DMS as long as it is consistent now that will explain why Colin gets so upset.

To have consistent timing, you need real time programming on a real time chip. ARM design regular chips like in your phone and special real time cores where the order of processing is guaranteed, so timing is quick and consistent.

HW agnostic means it wasn’t designed to run consistently, you can’t fix this in customisation.

So for a safety system - did you see the ball rolling onto the road needs constant timing to time the gaze at a moment and link to the exterior view. Same with looking at a building, those gaze vectors over time should track to a constant place on the map. If you need this level of safety AND convenience, you need realtor chips and programming, not HW agnostic software.

1 tykkäys

As you can see below, DMS algos dont have any delay

From the industry we know that performance of these algos is pretty much on the same level between DMS suppliers. For commercial success you also need to deliver and be a trustworthy companion for the OEMs. I believe this has been the strenght of Smart Eye.

Like you said that demo with lag was for OMS. I believe there are different algos for different purposes as stated by Martin in the video. I cannot say more about the delay without more knowledge of the context for that demo, but I would say that that is not for DMS purposes.

I believe there are different requirements to OMS and DMS algos.

If Smart is just china shit and still has 2/3 of DWs then competitors must be way off the scale :sweat_smile: i’ll get back to you after 2020 RfQ nominations have been published - please remember this :slightly_smiling_face:

11 tykkäystä

Pls elaborate. I’d love to hear more well reasoned details.

6 tykkäystä

“I am exceptionally proud of Smart Eye’s engineering team. They have developed a scalable software solution that can run on multiple hardware platforms. This ensures the combination of optimized performance, competitive system cost and is qualified for safety critical automotive applications. This is a winning formula” says Martin Krantz, founder, and CEO of Smart Eye.

5 tykkäystä

Hi Kesa, if I ask you the time, 3 times in a row, the first time you will look at your watch, the second time you will tell me the same time from memory, the third time you would sigh, then tell me the same time. That’s how modern chips work. You can’t turn that off, the delay is variable, because that is more efficient.

If you want to answer the same question with the same delay you need to use a different core in your chip and use different programming.

1 tykkäys

Sitaatti

If Smart is just china shit and still has 2/3 of DWs then competitors must be way off the scale : sweat_smile:i’ll get back to you after 2020 RfQ nominations have been published.

Sitaatti

You assume SEE actually bid for some of your China wins (or China facing).
SEE had to ensure their IP couldn’t be compromised. Hence now that Qualcomm are hard coding it into their system China has now opened up.

1 tykkäys

image

:sweat_smile:

148 tykkäystä

This doesn’t really answer anything. “HW agnostic means it wasn’t designed to run consistently, you can’t fix this in customisation.” is a nonsense statement. This is purely a matter of programming. IF consistency is necessary, one can make the software to measure the time every single process takes and then do a necessary syncing to make sure everything runs in a desired manner.

5 tykkäystä

No, it’s not. That would have a completely meaningless effect on performance. The kind of calculations required are nothing compared to what processing and analyzing gaze requires.

4 tykkäystä