Electrical function schematic for 360 degree viewing system - GF54.65-P-0007GN
MODEL 166 as of model year 2016 with CODE 501 (360° camera)
MODEL 292 with CODE 501 (360° camera)
Block diagram
Function requirements, general
- Terminal 15 ON
- Vehicle speed v < 15 km/h
The electronic ignition lock control unit sends the status of circuit 15 over the chassis CAN 2 to the 360° camera control unit. The Electronic Stability Program control unit sends the wheel speed signals via the chassis CAN 1, electronic ignition lock control unit, and chassis CAN 2 to the instrument cluster. The instrument cluster uses the wheel speeds to calculate the displayed vehicle speed and sends the vehicle speed to the 360° camera control unit via chassis CAN 2 so that the deactivation behavior can be calculated.
360° camera system, general
The 360° camera system consists of four digital cameras. There is one camera each on the radiator grille, in the outside mirror housings, and in the liftgate.
The 360° camera control unit uses the picture data from the cameras to calculate a virtual picture ("Virtual viewpoint"). On the Audio/COMAND display, the vehicle and its surroundings (s = 3 m to front and rear and s = 2.5 m to the ground on the sides) are displayed as a "Vehicle top view" (bird's eye view). A total of seven split views and two full-screen views of the vehicle surroundings can be displayed, but only two views can be displayed at the same time (the "Vehicle top view" and one detail view, e.g. the picture taken by the rear 360° camera after having engaged the "R" gear range).
Camera lenses with a horizontal angle of vision of ∠> 180° and a vertical angle of vision of ∠ > 123° record the required field of view. Dynamic and static guide lines, which represent the vehicle dimensions and driving trajectories (driving paths) based on the steering angle, are displayed on the picture to assist the driver. With the help of these representations, the driver is provided assistance especially during parking and maneuvering. Additional elements are displayed here that mark the area at risk at the vehicle corners.
The 360° camera function comprises the following subfunctions:
- Function sequence for activating, deactivating the 360° camera system
- Function sequence for actuating the camera cover
- Function sequence for picture recognition, picture output
Function sequence for activating, deactivating the 360° camera system
The 360° camera system can be activated or deactivated by pressing the "Sys" button in the COMAND controller unit for t > 2 s or automatically by engaging the "R" gear range.
Activating/deactivating manually:
The COMAND controller unit reads in the status of the "Sys" button and sends it via the interior CAN, electronic ignition lock control unit, and chassis CAN 2 to the 360° camera control unit. The 360° camera control unit then sends the "Audio/COMAND display On" request via the chassis CAN 2, electronic ignition lock control unit, and interior CAN to the COMAND controller unit and switches on the cameras.
Automatic activating/deactivating:
The automatic activation or deactivation of the 360° camera system must be enabled via the corresponding operating level of the COMAND controller unit. The COMAND controller unit sends the status of the function via the interior CAN, SAM control unit, and chassis CAN 2 to the 360° camera control unit. Once the gear range "R" is engaged, the 360° camera control unit activates the 360° camera system.
The fully integrated transmission control unit sends the information on the gear range engaged via the drive train CAN, CDI control unit (with diesel engine) or the ME-SFI [ME] control unit (with gasoline engine), chassis CAN 1, electronic ignition lock control unit, and chassis CAN 2 to the 360° camera control unit.
The 360° camera system is now activated or deactivated.
When switching the gear range from "R" or "D" to gear range "N", the previously shown picture continues to be shown in the Audio/COMAND display. When switching gear range to "P", the 360° camera system is automatically deactivated.
If an attempt is made to activate the 360° camera system above a vehicle speed of v = 15 km/h, an inactivity message appears on the Audio/COMAND display. When falling below this speed limit at a later stage, the 360° camera system is activated. An inactivity message will also be issued on the Audio/COMAND display if the 360° camera system is activated at a vehicle speed of v < 18 km/h and the vehicle speed increases to v > 18 km/h within t = 1 s.
During reverse travel, the 360° camera system operated independently from the speed.
During initial startup and after replacing the 360° camera control unit or a camera or upon removal/installation of the trunk lid, or liftgate, an outside mirror or the radiator trim, the relevant cameras must be recalibrated. After replacing a camera, the 360° camera control unit has to be coded again.
The following situations lead to a deactivation of the 360° camera function:
- Vehicle speed v > 18 km/h
- Circuit 15 OFF
- Selection of gear range "P"
Function sequence for actuating the camera cover
The camera lens of the rear 360° camera is protected against dust by a camera cover. The camera cover is opened or closed depending on the status of the 360° camera at the rear (activated or deactivated). The camera cover is opened and closed depending on the request from the 360° camera control unit. The 360° camera control unit transmits this via chassis CAN 2, the electronic ignition lock control unit and the interior CAN to the rear control unit. The rear control unit then actuates the rear camera cover motor directly. The status of the camera cover (open or closed) is registered by the switch for the rear camera cover motor. The rear control unit reads in the status of the rear camera cover motor switch directly and transmits it via the interior CAN, electronic ignition lock control unit and chassis CAN 2 to the 360° camera control unit.
To clean the camera lens, the camera cover can be opened manually using the control menu of the COMAND controller unit. The COMAND controller unit sends the request "Service mode" over the interior CAN, the electronic ignition lock control unit and chassis CAN 2 to the 360° camera control unit. Further course of signals corresponds to the opening and closing of the camera cover.
The camera cover is closed as of a speed of v > 18 km/h or after circuit 15 has been deactivated.
Function sequence for picture recognition, picture output
The pictures recorded by each camera are read in by the 360° camera control unit over low voltage differential signaling lines and processed. Depending on the use case, the 360° camera control unit calculates guide lines to be shown on the displayed pictures taking into account the recorded pictures, the steering wheel angle and stored vehicle parameters. Additionally, the 360° camera control unit uses the information of the parking system, for example, to mark the areas of the vehicle corners at risk during maneuvering. The 360° camera control unit transmits these prepared pictures via LVDS lines to the COMAND controller unit. The COMAND controller unit then sends a switch-on request to the Audio/COMAND display over the telematics CAN. The processed data is transferred by the COMAND controller unit over the LVDS line to the Audio/COMAND display, where it is displayed.
For a better representation of the camera pictures, the 360° camera control unit corrects the pictures electronically for distortion. The front wheel angle is recorded by the electrical power steering control unit. The electrical power steering control unit sends this via the chassis CAN 1 to the 360° camera control unit.
The parking system control unit sends information on the parking system to the 360° camera control unit via chassis CAN 2.
To ensure that the surrounding area can also be recorded in the dark, the ambient illumination in each of the outside mirror housings is activated, irrespective of the ambient brightness. To do this, the 360° camera control unit permanently sends the "Switch on ambient illumination" request over the chassis CAN 2, electronic ignition lock control unit and the interior CAN to the SAM control unit. The SAM control unit as the exterior lights master control unit then evaluates the ambient brightness. When it is dark, the SAM control unit sends a corresponding request to the left front door control unit and the right front door control unit over the interior CAN. They activate the ambient illumination in the outside mirror housings.
The background illumination for the Audio/COMAND display can be manually adapted to the ambient brightness. The background illumination can be adjusted through the COMAND controller unit in the "360° camera" system menu function bar by choosing the "Sun" symbol.
Representation of vehicle views in the Audio/COMAND display:
The "Vehicle top view" also shows, for example, open doors and an open trunk lid or an open liftgate. The rear control unit sends the status of the liftgate (opened or closed) via the interior CAN, electronic ignition lock control unit, and chassis CAN 2 to the 360° camera control unit. The status of the respective door (opened or closed) is sent by the left front door control unit, right front door control unit, left rear door control unit, or right rear door control unit via the interior CAN, electronic ignition lock control unit, and chassis CAN 2 to the 360° camera control unit. The 360° camera control unit processes this information and displays an open door or an open liftgate in relation to the respective status.
However, the area recorded by the camera in question is removed from the display.
The position of the outside mirror housing (folded out or in) is used by the 360° camera control unit to calculate the optimum display of the "Vehicle top view". The position of the outside mirror housing is sent by the left front door control unit or the right front door control unit over the interior CAN, electronic ignition lock control unit and chassis CAN 2 to the 360° camera control unit.
The 360° camera system is active during forward travel up to a vehicle speed of v = 15 km/h. When this speed limit is exceeded, the 360° camera system is deactivated.
Vehicles with CODE 489 (AIRMATIC):
Based on the current vehicle level, the 360° camera control unit equalizes the recorded pictures and calculates their optimum display on the Audio/COMAND display, respectively. Information on the vehicle level is sent by the AIRmatic control unit over the chassis CAN 1, electronic ignition lock control unit and chassis CAN 2 to the 360° camera control unit.
The following views are possible on the Audio/COMAND display:
- Vehicle top view and forward field of view
- Vehicle top view and rearward field of view
- Vehicle top view and field of view of front wheels on both sides
- Vehicle top view and field of view of rear wheels on both sides
- Vehicle top view and field of view for trailer hitch (with CODE 550 (Trailer hitch))
- Full screen forward field of view
- Full screen rearward field of view
- Vehicle top view with enlarged view of vehicle front
- Vehicle top view with enlarged view of rear end
Vehicle top view and forward field of view, shown on model 292
Vehicle top view and rearward field of view, shown on model 292
Vehicle top view and field of view of front wheels on both sides, shown on model 292
Vehicle top view and field of view of rear wheels on both sides, shown on model 292
Vehicle top view and field of view for trailer hitch (with CODE (550) Trailer hitch), shown on model 292
Full screen forward field of view, shown on model 292
Full screen rearward field of view, shown on model 292
If "Front field of view, full screen" or "Rear field of view, full screen" is active, object recognition is active. If a pedestrian walks past the vehicle at a maximum distance of 2.5 m, he or she is detected and marked by object detection lines. Stationary obstacles that the vehicle is approaching are also marked with orange object detection lines. No active vehicle intervention takes place; only visual warnings are displayed.
Vehicle top view with enlarged view of vehicle front, shown on model 292
Vehicle top view with enlarged view of rear end, shown on model 292
System limits:
The 360° camera function is restricted in terms of function and displays. Distortion and "blind spots" can occur.
In the "Vehicle top view", objects outside road level (e.g. vehicles) are displayed with distortion.
Objects are also shown with distortion in the "Front field of view, full screen" and "Rear field of view, full screen" views (Front 360° camera or rear 360° camera active). The assignment of objects in the picture to how they appear in real-life can therefore be unusual.
There are different types of "blind spot" depending on the system and model in question. One reason is the camera position over the respective bumper: Here, the 360° camera function loses the field of view immediately before and after the vehicle. On the other hand, they are system related, particularly in the four overlapping areas of the pictures recorded by the cameras, when calculating a "Vehicle top view". Furthermore, due to the low installation height of the cameras there are areas where only objects close to the ground can be seen. This means, for example, that people are not shown roughly above knee height in the "Vehicle top view". In both cases, however, additional protection is provided by the parking system.
Shutoff criteria:
The following situations lead to a deactivation of the 360° camera function:
- Vehicle speed v > 18 km/h
- Circuit 15 OFF
- Selection of gear range "P"
| Electrical function schematic for 360° camera | PE54.65-P-2060-97NBA | ||
| Overview of system components of parking assistance systems | MODEL 166 as of model year 2016 with CODE 218 (Rear view camera) with CODE 235 (Active Parking Assist) with CODE 501 (360° camera) MODEL 292 with CODE 218 (Rear view camera) with CODE 235 (Active Parking Assist) with CODE 501 (360° camera) |
GF54.00-P-9997GN |