Night View Assist, Function - GF54.30-P-0005LFM
Model 217, 222
as of model year 2018
with code 610 (Night view assist)
Shown: model 217
Shown on model 222
Function requirements, general
- Power supply directly via circuit 15
- Gear range "N" selected (display of area to the front only), gear range "D" selected (full functionality)
- Low beams ON (for night mode)
Detailed information on the low beam actuation is available in a separate document.
The fully integrated transmission control unit sends information on the engaged gear range to the Night View Assist control unit via drive train CAN, powertrain control unit, chassis FlexRay, electronic ignition lock control unit and user interface CAN.
Night View Assist, general
The Night View Assist provides pictures of the area in front of the vehicle in daylight and also when it is dark. Thanks to the Night View Assist it is possible when dark to spot obstacles in the driver's field of view before they are recognizable in conventional headlamp light cones.
The area in front of the vehicle is recorded using Night View Assist infrared camera 1, which is located in the upper area of the windshield, and Night View Assist infrared camera 2, which is located on the right, in the direction of travel, behind the radiator grille. In night mode, when the other lights no longer ensure optimum detection, infrared lights are also activated. Because infrared light is invisible to the human eye, oncoming traffic is not dazzled. The detection range of the two Night View Assist cameras is comparable to the visible distance when the high beams are switched on. The picture data of the Night View Assist cameras are reconditioned by Night View Assist control unit and displayed in the instrument cluster.
People or animals present in the area in front of the vehicle are detected when it is dark and highlighted with photo edges. Under good conditions, pedestrians can be detected up to a distance of s = 160 m. Depending on their size, animals are detected up to a distance of s = 100 m.
For example, if a person is detected by the Night View Assist cameras in darkness in unlit surroundings on or near to the road surface, the "spotlight function" becomes active. Whilst the "Adaptive Highbeam Assist" or "Adaptive Highbeam Assist Plus" function is enabled, the detected person is "flashed" with 4 short pulses by the high beams. Not only will the driver's attention be directed to the danger, the person in danger will also be warned.
The brightness of the display in the instrument cluster can be adjusted using the instrument illumination brightness control.
The windshield must be penetrable for infrared light in the field of view of Night View Assist infrared camera 1 (possible disturbing influences would be: fogging, blocking film, black print, adhesive label, stone chipping, icing up or dirt).
The Night View Assist comprises the following subfunctions:
- Function sequence for activating/deactivating Night View Assist
- Function sequence for passive mode
- Function sequence for active mode
- Function sequence for person and animal detection
- Function sequence for spotlight function
- Function sequence for messages in the event of malfunctions
Function sequence for activating/deactivating Night View Assist
The Night View Assist system can, depending on the operating mode, either be activated or deactivated using the Night View Assist button in the driver's side instrument panel button group or the menu item in the instrument cluster:
- Automatic picture activation ("Pop-up mode")
- Manual picture pop-up ("CLASSIC mode")
Automatic picture activation ("Pop-up mode")
Automatic picture pop-up can be activated via the "Night View Assist" submenu in the instrument cluster "Assistance" menu. The instrument cluster sends the status of the setting to the Night View Assist control unit via user interface CAN.
Picture data of the Night View Assist are only displayed in pop-up operation if a hazard potential is assumed. If relevant objects, such as people or animals are detected by Night View Assist cameras in the dark, in unlit surroundings and at a speed of v > 60 km/h, the Night View Assist control unit activates the picture pop-up.
The rain/light sensor with additional functions reads in the signals of the light sensor directly, evaluates them and transmits information about the ambient brightness (dimness level) to Night View Assist control unit via rain/light sensor LIN, front SAM control unit, interior CAN, electronic ignition lock control unit and user interface CAN.
The vehicle speed is calculated on the basis of the wheel speeds. The Electronic Stability Program control unit sends corresponding information to the Night View Assist control unit and also to the instrument cluster via chassis FlexRay, electronic ignition lock control unit and user interface CAN. The instrument cluster calculates the vehicle speed to be displayed and transmits this to the Night View Assist control unit via user interface CAN.
The Night View Assist control unit receives the picture data (object information) from the Night View Assist cameras via HSVL lines, evaluates them and sends the request for picture display to the instrument cluster via the user interface CAN. The instrument cluster activates the display of the information from the Night View Assist. The Night View Assist control unit processes the picture data of the Night View Assist cameras for displaying in the instrument cluster and transfers them to the instrument cluster via the HSVL line.
If the situation has been defused (e.g. people or animals have left the hazard area or been passed by), the picture pop-up is withdrawn. However, the people and animal detection remains active in the background through the Night View Assist cameras.
Manual picture pop-up ("CLASSIC mode")
Pressing the Night View Assist button activates the manual picture pop-up. The picture data of Night View Assist are then displayed without interruption in instrument cluster.
The front SAM control unit reads in the status of the Night View Assist button via instrument panel LIN and sends it to the Night View Assist control unit via interior CAN, electronic ignition lock control unit and user interface CAN. The Night View Assist control unit sends the request for picture pop-up via user interface CAN to the instrument cluster. The instrument cluster activates the display of the information from the Night View Assist. The Night View Assist control unit receives the picture data (object information) of the Night View Assist cameras via HSVL lines, prepares them for display on the instrument cluster and transfers them to the instrument cluster via HSVL line.
If the manual picture pop-up is activated for active automatic picture pop-up, the information of Night View Assist is displayed without interruption.
Additional function requirements for passive mode
- Light sensor in rain/light sensor with additional functions detects daylight or dusk
The rain/light sensor with additional functions reads in the signals of the light sensor directly, evaluates them and transmits information about the ambient brightness (dimness level) to Night View Assist control unit via rain/light sensor LIN, front SAM control unit, interior CAN, electronic ignition lock control unit and user interface CAN.
Function sequence for passive mode
In passive mode, the area to the front of the vehicle is recorded by Night View Assist infrared camera 1 without the infrared light being switched on.
Picture data of the Night View Assist are displayed in the instrument cluster. Recognition of people or animals is not possible.
Night View Assist infrared camera 2 (thermal image camera) supplies no usable picture data in passive mode. During daylight, although the Night View Assist infrared camera 1 provides pictures of the area in front, it is virtually impossible to detect people due to ambient brightness. At dusk, people, animals or objects, for example with no sharp contours or which do not stand out from the surroundings due to the color, may in some circumstances be noticed too late. The Night View Assist control unit counters this effect by reinforcing and processing the picture data.
Night View Assist infrared camera 1 works just like a regular camera, yet with an extended visible light spectrum. As a result, it is in a position to record the portion of light not visible to the human eye. The Night View Assist infrared camera 1 digitalizes the recorded pictures and processes them ("passive" mode). The Night View Assist infrared camera 1 then transmits the processed picture data to the Night View Assist control unit via the HSVL line. The Night View Assist control unit reconditions the brightness distribution and sends the processed picture data to the instrument cluster via the HSVL line. Extremely bright picture areas that could dazzle the driver are filtered out during the processing of picture data.
Additional function requirements for active mode
- Light sensor in rain/light sensor with additional functions detects night
The rain/light sensor with additional functions reads in the signals of the light sensor directly, evaluates them and transmits information about the ambient brightness (dimness level) to Night View Assist control unit via rain/light sensor LIN, front SAM control unit, interior CAN, electronic ignition lock control unit and user interface CAN.
Function sequence for active mode
At night, Night View Assist goes into active mode.
The area ahead of the vehicle is illuminated with infrared light.
Because infrared light is invisible to the human eye, oncoming traffic is not dazzled.
The Night View Assist control unit sends the "Infrared lights On" request to the headlamp control units via user interface CAN, electronic ignition lock control unit and periphery CAN. The headlamp control units then actuate the infrared lights directly.
The infrared lights are switched on from a vehicle speed of v ≥ 10 km/h (hysteresis: shutoff at a vehicle speed of v < 5 km/h).
The vehicle speed is calculated on the basis of the wheel speeds. The Electronic Stability Program control unit sends corresponding information to the Night View Assist control unit and also to the instrument cluster via chassis FlexRay, electronic ignition lock control unit and user interface CAN. The instrument cluster calculates the vehicle speed to be displayed and transmits this to the Night View Assist control unit via user interface CAN.
Operation of the infrared lights is monitored by the respective headlamp control unit. In the event of malfunctions, the headlamp control units send the relevant information to the front SAM control unit via periphery CAN, electronic ignition lock control unit and interior CAN. The front SAM control unit evaluates this and sends the results to the Night View Assist control unit via interior CAN, electronic ignition lock control unit and user interface CAN.
The Night View Assist infrared camera 1 evaluates the reflected infrared light and generates an image of the area in front based on this.
LEDs are used to generate infrared light.
For active infrared light request, left front lamp unit fan motor 1 (E1m4), left front lamp unit fan motor 2 (E1m5), right front lamp unit fan motor 1 (E2m4) and right front lamp unit fan motor 2 (E2m5) are switched on. The operation of fan motors prevents light-emitting diodes (LED) and plastic housing of front lamp units from overheating due to high outside temperatures or high actuation currents.
Additional function requirements for person and animal detection
- Light sensor in rain/light sensor with additional functions detects night
- Object distance for pedestrian detection s ≤ 160 m
- Object distance for animal detection s ≤ 100 m
- Ambient temperature T ≤ 32°C
The rain/light sensor with additional functions reads in the signals of the light sensor directly, evaluates them and transmits information about the ambient brightness (dimness level) to Night View Assist control unit via rain/light sensor LIN, front SAM control unit, interior CAN, electronic ignition lock control unit and user interface CAN.
Function sequence for person and animal detection
The Night View Assist is designed to differentiate between people or animals and moving objects such as vehicles or static objects such as mailboxes or street lamps. This is achieved by Night View Assist control unit through the evaluation and plausibility checks of picture data from Night View Assist cameras.
In night mode, Night View Assist infrared camera 1 delivers in addition to the picture data of the area ahead, information as to whether people are within the detection range. Animals are not detected by Night View Assist infrared camera 1.
Night View Assist infrared camera 2 works with an even greater wavelength range and is used to detect people and animals.
The detection of an animal is dependent on its body size (e.g. deer, elk, cows and horses are detected).
Both Night View Assist infrared camera 1 and Night View Assist infrared camera 2 send the picture data to the Night View Assist control unit via HSVL lines. The picture data of both Night View Assist cameras is checked for plausibility by the Night View Assist control unit.
If, in night mode, the Night View Assist system detects people or animals on or near the road surface, these are dyed and accentuated with picture frame corners in the instrument cluster.
Display in the instrument cluster during darkness (person detection)
Due to the limits of the system, the person/animal detection function may interpret incorrectly, e.g. objects may be detected as people and highlighted with photo edges. The detection rate decreases dramatically when there is insufficient contrast with the surroundings and in the event of unfavorable conditions (e.g. strong backlighting, rain, snow, light background or people wearing very dark clothing or when the outside temperature is increasing) and people are not shown with picture frame corners. On the other hand, objects may also be erroneously detected as being people or animals.
Additional function requirements for spotlight function
- Person detection active
- Vehicle is located on an unlit road
- Vehicle speed v > 60 km/h
- "Spotlight" function switched on in "Setting", "Light" menu
The "spotlight" function can be activated using "Setting", "Light" menu on the instrument cluster. The instrument cluster sends the status of the setting to the Night View Assist control unit via user interface CAN.
Function sequence for spotlight function
Person detection with Spotlight function runs in the background. If e.g. a person is detected by the Night View Assist cameras in darkness in unlit surroundings on or near to the road surface, he/she is "flashed" with 4 short pulses by the high beams. This will activate the high beams of the front lamp unit facing the inside of the road (e.g. left high beam for left-hand drive vehicles). Not only will the driver's attention be directed to the danger, the person in danger will also be warned. Animals are not flashed by the spotlight function. If there are multiple people, the two people nearest to the roadway and the vehicle are "flashed".
The spotlight function is only permitted on unlit roads and is only activated if the traffic in front or the oncoming traffic will not be blinded. If the multifunction camera detects a large number of static objects (e.g. street lamps for city/town identification) and individual dynamic light sources (vehicles), the spotlight function is suppressed.
The Night View Assist control unit sends the object information to the mono multifunction camera via user interface CAN, electronic ignition lock control unit and periphery CAN, or to the stereo multifunction camera via user interface CAN, electronic ignition lock control unit and chassis FlexRay. The corresponding multifunction camera checks the requirements for spotlight function. If all requirements are satisfied, the mono multifunction camera transmits the "Spotlight on" request to the relevant headlamp control unit in model 217 and to the relevant LED matrix lamp unit control unit in model 222 via the peripherals CAN. The stereo multifunction camera transmits the "Spotlight on" request to the relevant headlamp control unit in model 217 and to the relevant LED matrix lamp unit control unit in model 222 via the suspension FlexRay, electronic ignition lock control unit and peripherals CAN.
In model 217, the relevant headlamp control unit actuates the high beam four times via the headlamp LIN and front exterior lighting LED actuation module. In model 222, the relevant LED matrix lamp unit control unit actuates the adaptive high beam four times.
Function sequence for messages in the event of malfunctions
Malfunctions of the Night View Assist are displayed in instrument cluster. Here, a distinction is made between user-related and system-related messages. The example messages listed in the following tables are sent by the Night View Assist control unit to the instrument cluster via user interface CAN.
| User-related messages | Meaning |
|---|---|
| "Night View Assist not in gear range R" | Gear range "R" is engaged |
| "Night View Assist lights ON or AUTO" | Driving lights are not switched on |
The system-related messages listed below are only shown when the Night View Assist button has been pressed.
| System-related messages | Meaning |
|---|---|
| "Night View Assist is started" | Night View Assist is being initialized (after circuit 15 On) |
| "Night View Assist inoperative" | No communication with Night View Assist infrared camera 1, Night View Assist infrared camera 2 or instrument cluster possible (e.g. owing to open circuit or hardware fault) |
| "Night View Assist currently not available" (A fault message is only output when Night View Assist is activated. When activated, the picture in the instrument cluster only is faded out in the event of a fault) |
Shutoff of Night View Assist infrared camera 1 or Night View Assist infrared camera 2 in the event of overheating, overtemperature of the Night View Assist control unit, fault in CAN communication (Controller Area Network) |
| "Night View Assist available again" (The message is output only after a previous and unsuccessful attempt to activate Night View Assist and fault message "Night View Assist not currently available" shown) |
Temporary source of fault has been eliminated |
| Electrical function schematic, Night View Assist | Model 217 as of model year 2018 with code 610 (Night view assist) | PE54.30-P-2053-97SEA | |
| Electrical function schematic, Night View Assist | Model 222 as of model year 2018 with code 610 (Night view assist) | PE54.30-P-2053-97SEB | |
| Overview of system components for driver assistance systems | GF54.00-P-9998LFM |