Electrical Function Schematic For 360 Degree Viewing System - GF54.65-P-0007LF
Model 217, 222
up to model year 2018
with code 501 (360° camera)
Shown on model 217, 222
Function requirements, general
- Terminal 15 ON
- Vehicle speed v < 27 km/h
The electronic ignition lock control unit sends the status of circuit 15 to the 360° camera control unit over the user interface CAN. The vehicle speed is calculated on the basis of the wheel speeds. The Electronic Stability Program control unit sends corresponding information to the instrument cluster over the suspension FlexRay, electronic ignition lock control unit and user interface CAN. The instrument cluster calculates the vehicle speed to be displayed and sends this via the user interface CAN to the 360° camera control unit for calculation of switch-off behavior.
360° camera system, general
The 360° camera system consists of four digital cameras. There is one camera each behind the radiator trim, in the outside mirror housings and in the trunk lid. The 360° camera control unit uses the picture data from the cameras to calculate a virtual picture ("Virtual viewpoint"). The Audio/COMAND display shows the vehicle and its immediate surroundings (s = 3 m to the front and rear as well as s = 2.5 m to the sides, as measured on the ground) in a "vehicle from above view" (birds-eye view).
A total of seven split views and two full-screen views of the area surrounding the vehicle can be displayed, however no more than two views simultaneously (the vehicle "from above" view and an additional detailed view, e.g. the pictures taken by the rear 360° camera after having engaged the "R" gear range or the reverse gear).
Camera lenses with a horizontal angle of vision of ∠ > 180° and a vertical angle of vision of ∠ > 123° record the required field of view. Dynamic and static guide lines, which represent the vehicle dimensions and driving trajectory (driving path) based on the steering angle, are displayed to assist the driver. These displays help the driver, in particular, during parking maneuvers. Additional elements are displayed here that mark the area at risk at the vehicle corners.
The 360° camera function comprises the following subfunctions:
- Function sequence for activating, deactivating the 360° camera system
- Function sequence for actuating the camera cover
- Function sequence for picture recognition, picture output
Function sequence for activating, deactivating the 360° camera system
The 360° camera system can be activated or deactivated manually by pressing the 360° camera button in the driver side instrument panel button group, the corresponding softkeys and/or the favorite button on the Audio/COMAND control panel or automatically by engaging gear range "R".
Activating/deactivating manually:
The front SAM control unit reads in the status of the 360° camera button over the instrument panel LIN and sends it over the interior CAN, electronic ignition lock control unit and user interface CAN to the 360° camera control unit. The 360° camera control unit then activates or deactivates the 360° camera system.
Automatic activating/deactivating:
The automatic activation or deactivation of the 360° camera system must be enabled via the corresponding operating level in the COMAND controller unit. The Audio/COMAND control panel sends the corresponding control signals (softkey, favorite button) to the COMAND controller unit over the telematics CAN. The COMAND controller unit sends the status of the function to the 360° camera control unit via user interface CAN. Once the gear range "R" is engaged, the 360° camera control unit activates the 360° camera system. The fully integrated transmission control unit sends information on the engaged gear range to the 360° camera control unit via drive train CAN, powertrain control unit, suspension FlexRay, electronic ignition lock control unit and user interface CAN. The 360° camera system is now on, after the gear range "R" is engaged.
When switching gear range from "R" or "D" to gear range "N", the previously shown picture continues to be shown in the Audio/COMAND display. When switching gear range to "P", the 360° camera system is automatically deactivated.
If an attempt is made to activate the 360° camera system above a vehicle speed of v = 27 km/h, an inactivity message is shown on the Audio/COMAND display. When falling below this speed limit at a later stage, the 360° camera system is activated. If the 360° camera system is activated at a vehicle speed of v < 27 km/h and the vehicle is accelerated within t = 1 s to a vehicle speed v > 30 km/h, an inactivity message is also issued on the Audio/COMAND display.
During reverse travel, the 360° camera system operated independently from the speed.
During initial startup as well as after replacement of the 360° camera control unit or a camera or upon removal/installation of the trunk lid, or liftgate, an outside mirror or the radiator trim, the corresponding cameras must be recalibrated. After a camera is replaced, a recoding of the 360° camera control unit is required.
The following situations lead to a deactivation of the 360° camera function:
- Vehicle speed v > 27 km/h
- Circuit 15 OFF
- Selection of gear range "P"
Function sequence for actuating the camera cover
When the 360° camera control unit activates or deactivates the 360° camera system, the camera cover control unit actuates the respective camera cover motor in the opening or closing direction. The 360° camera control unit sends the corresponding request to the camera cover control unit over the user interface CAN, electronic ignition lock control unit and interior CAN. The position of the rear camera cover (open or closed) is registered by the rear camera cover motor switch. The camera cover control unit directly reads in the status of the rear camera cover motor switch. The camera cover control unit defines the position of the front camera cover via a pulse width modulated signal from the front camera cover motor. At the same time the front and rear camera covers are opened, the 360° camera control unit switches on the power supply of the cameras.
The camera covers can be opened to clean the camera lenses via the operating menu of the COMAND controller unit. During this, no image is shown in the Audio/COMAND display. The COMAND controller unit sends the "Service mode" request to the reversing camera via user interface CAN. The path of the signal is the same as that for opening or closing of the camera cover upon request of the 360° camera control unit.
The rear camera covers are automatically closed as from a speed of v > 27 km/h (irrespective of any calibration procedure) or after deactivation of circuit 15. During a calibration procedure, it is possible that the camera covers remain open for the duration of the calibration even after the 360° camera function has been deactivated. The camera covers are not closed until after the calibration is complete.
Function sequence for picture recognition, picture output
The pictures recorded by each camera are directly read in by the 360° camera control unit over low voltage differential signaling lines and processed. The 360° camera control unit calculates guide lines to be shown on the Audio/COMAND display taking into account the steering wheel angle and stored vehicle parameters. Additionally, the 360° camera control unit uses the information of the parking system, for example, to mark the areas of the vehicle corners at risk during maneuvering.
The 360° camera control unit sends the request for displaying the picture to the COMAND control unit via user interface CAN. This then activates the Audio/COMAND display via telematics CAN. The 360° camera control unit then transmits this processed picture data to the COMAND control unit via the low voltage differential signaling lines. The COMAND controller unit sends this to the Audio/COMAND display over the low voltage differential signaling (LVDS) line. There the processed camera pictures including the guide lines are then displayed.
For a better representation of the camera pictures, the 360° camera control unit corrects the pictures electronically for distortion. The steering angle is recorded by the steering wheel angle sensor. The steering column tube module control unit directly reads in the signals of the steering wheel angle sensor and sends information on the steering angle to the 360° camera control unit over the suspension FlexRay, electronic ignition lock control unit and user interface CAN. The parking system control unit sends the information of the parking system to the 360° camera control unit over the suspension FlexRay, electronic ignition lock control unit and the user interface CAN. To ensure that the surrounding area can also be recorded in the dark, the ambient illumination in each of the outside mirror housings is activated, irrespective of the ambient brightness. To do this, the 360° camera control unit permanently sends the "Switch on ambient illumination" request to the SAM control unit over the user interface CAN, electronic ignition lock control unit and the interior CAN. The front SAM control unit as the exterior lights master control unit then evaluates the ambient brightness. When it is dark, the front SAM control unit sends a corresponding request to the left front door control unit and the right front door control unit over the interior CAN. They activate the ambient illumination in the outside mirror housings.
Detailed information on the ambient illumination is available in a separate document.
The background illumination for the Audio/COMAND display can be manually adapted to the ambient brightness. The background illumination can be adjusted through the COMAND controller unit in the "360° camera" system menu function bar by choosing the "Sun" symbol.
Representation of vehicle views in the Audio/COMAND display:
The vehicle view "from above" also displays open front doors and/or an open trunk lid. The rear SAM control unit sends the status of the trunk lid (opened or closed) to the 360° camera control unit via interior CAN, electronic ignition lock control unit and user interface CAN. The status of the respective door (opened or closed) is sent by the left front door control unit, right front door control unit, left rear door control unit, or right rear door control unit to the 360° camera control unit via the interior CAN, electronic ignition lock control unit and user interface CAN. The 360° camera control unit processes this information and correspondingly displays an open door or an open trunk lid in the vehicle view "from above". The picture data from the camera of the open door or the open trunk lid are not displayed.
When the outside mirror housings are folded up, the areas on the side of the vehicle can no longer be recorded. The corresponding areas are also hidden in the Audio/COMAND display in this case. The status of the corresponding outside mirror housing is sent by the corresponding front door control unit to the 360° camera via interior CAN, electronic ignition lock control unit and user interface CAN.
The 360° camera system is active during forward travel up to a vehicle speed of v = 30 km/h. When this speed limit is exceeded, the 360° camera system is deactivated.
The current vehicle level is used by the 360° camera control unit to calculate and equalize the recorded pictures for optimum display in the Audio/COMAND display. Information on the vehicle level is sent by the Active Body Control control unit (with code 487 (MAGIC BODY CONTROL)) or the AIRmatic control unit (without code 487 (MAGIC BODY CONTROL)) to the 360° camera control unit via the suspension FlexRay, the electronic ignition lock control unit and the user interface CAN.
The views shown on the Audio/COMAND display can be switched over both automatically and manually. According to the engaged gear range, an automatic switch is made between frontward view and rearward view. In addition to the automatic selection, the driver can also switch manually between the various detailed views via the COMAND controller unit.
The following views are possible on the Audio/COMAND display:
- Vehicle top view and forward field of view
- Vehicle top view and rearward field of view
- Vehicle top view and field of view of front wheels on both sides
- Vehicle top view and field of view of rear wheels on both sides
- Vehicle top view and field of view for trailer hitch (with CODE 550 (Trailer hitch))
- Full screen forward field of view
- Full screen rearward field of view
- Vehicle top view with enlarged view of vehicle front
- Vehicle top view with enlarged view of rear end of the vehicle
Vehicle from above and forward field of view, shown on model 222.0, system language: German
Vehicle from above and rearward field of view, shown on model 222.0, system language: German
Vehicle from above and field of view showing front wheels on both sides, shown on model 222.0, system language: German
Vehicle from above and field of view showing rear wheels on both sides, shown on model 222.0, system language: English
Vehicle from above and field of view for trailer coupling (with code 550 (Trailer hitch)), shown on model 222.0, system language: German
Detailed information on the "Reversing camera" and "Trailer mode" functions (with code 550 (Trailer hitch)) is available in the separate document.
Full screen forward field of view, shown on model 222.0, system language: German
Full screen rearward field of view, shown on model 222.0, system language: German
Vehicle top view with enlarged view of vehicle front, shown on model 222.0, system language: English
Vehicle top view with enlarged view of vehicle rear, shown on model 222.0, system language: German
System limits:
The functions and representations of the 360° camera system are limited. Distortion and "blind spots" can occur.
In vehicle "top view", objects outside the road level (e.g. vehicles) are displayed with distortion.
Objects in the "Full screen forward/rearward field of view" (the 360° camera at front and the 360° camera rear camera are active) are also shown in distorted form. The assignment of objects in the picture to how they appear in real-life can therefore be unusual.
There are different types of "blind spots" depending on the system and model in question. One reason is the camera position over the respective bumper: Here, the camera loses the field of view immediately before and after the vehicle. On the other hand, they are system-related, particularly in the four overlapping areas of the fields of view of the cameras, when calculating a "Vehicle top view".
Due to the low installation height of the cameras there are areas where only objects close to the ground can be seen. This means, e.g. that people are not shown roughly above knee height in the "Vehicle top view". In both cases, however, support is provided by the parking system.
| Electrical function schematic for 360° camera | PE54.65-P-2060-97SEA | ||
| Overview of system components of parking assistance systems | GF54.00-P-9997LF |