Ti Design Reference
Ti Design Reference
Ti Design Reference
Description Features
This reference design demonstrates the use of the • Demonstration of mmWave sensor technology for
AWR1642, single-chip mmWave sensor with robust detection of life forms (adults, children, pets)
integrated DSP, as a Vehicle Occupant Detection in a vehicle.
Sensor enabling the detection of life forms in a vehicle. • Generate presence heat map with an FOV of ±60
This design provides a reference processing chain degrees.
which runs on the C674x DSP, enabling the • Source code for processing and detection based
generation of a heat map to detect life forms in a Field on the mmWave software development kit (SDK)
of View (FOV) of ±60 degrees.
• Based on proven EVM hardware designs, enabling
Resources quick time to market and out-of-the-box
demonstration.
TIDEP-01001 Design Folder • Radar front-end and detection configuration fully
AWR1642 Product Folder explained
AWR1642BOOST Tool Folder
mmWaveSDK Software Development Kit Applications
• Child left behind in car detection
• Vehicle occupant detection
ASK Our E2E™ Experts • Intruder detection
An IMPORTANT NOTICE at the end of this TI reference design addresses authorized use, intellectual property matters and other
important disclaimers and information.
1 System Description
Today’s vehicles require robust and reliable information about the in-cabin occupancy. Smart airbag
deployment systems, air condition controls, detecting children and disabled people left behind in vehicles
relies upon this information.
The TIDEP-01001 provides a reference for creating a vehicle occupant detection application, using TI’s
AWR1642 based on 77-GHz mmWave radio-frequency complementary metal-oxide semiconductor (RF-
CMOS) technology.
TI’s mmWave sensing devices integrate a 76-GHz to 81-GHz mmWave radar front end with ARM®
microcontroller (MCU) and TI DSP cores for single-chip systems.
This reference design demonstrates the suitability of the AWR1642 for vehicle occupant detection
applications. This design targets the implementation of a wide, azimuth field of view (±60°), close range (3
m) sensor configuration, which can detect life forms across two regions of interest. This can be extended
to multiple regions detection.
This TI Design implements algorithms for generating an azimuth-range heat map, detection, and decision
for an AWR1642 device on a TI EVM module.
The design provides a list of required hardware, schematics, and foundational software to quickly begin
traffic monitoring product development. It describes the example usage case as well as the design
principle, implementation details, and engineering tradeoffs made in the development of this application.
High-level instructions for replicating the design are provided.
2 System Overview
The VOD TI design is built around the AWR1642EVM evaluation board and the millimeter wave
(mmWave) SDK demo application. The system is optimized and built for VOD applications to detect
objects within a 3-m range
After the DSP finishes frame processing, the results are formatted and written in shared memory
(HSRAM) for the R4F MCU to send to the host through a UART for visualization.
AWR1642 device, and UART2 to send the object data back to the PC.
For more details on the hardware, see the AWR1642 Evaluation Module (AWR1642EVM) Single-Chip
mmWave Sensing Solution. The schematics and design database can be found in the following
documents: the AWR1642 Evaluation Board Design Database and the AWR1642EVM Schematic,
Assembly, and BOM .
2.3.2 mmWaveSDK
The mmWave SDK is split in two broad components: the mmWave Suite and mmWave demos. The
mmWave Suite is the foundational software part of the mmWave SDK and includes smaller components:
• Drivers
• OSAL
• mmWaveLink (BSS interface API)
• mmWaveLib (C674 optimized library)
• mmWave API (High level control API)
• BSS firmware
• Board setup and flash utilities
The mmWave SDK demos provide a suite of demonstrations that depict the various control and data
processing aspects of an mmWave application. Data visualization of the demonstration's output on a PC is
provided as part of these demonstrations:
• mmWave processing demonstration
• ADC data streaming demonstration
Figure 4 shows the zone geometry for the example configurations. In these examples, the primary field of
zone coverage begins at about 61 mm and continues to 136 mm. The zone widths are roughly 38 degrees
each. Tuning of the zones is completely configurable, as described in the user guide. There is a small
amount of spectral leakage from cell to cell, so an object entering a heatmap cell adjacent to a defined
zone cell could cause enough averaged energy in the zone to cause a transient positive detection.
The above configurations are just illustrative, and can be tailored according to user requirements
The profile configuration (profileCfg), defines the profile of a single chirp (as seen in Figure 5).
Subsequently, four chirp configurations are defined; each one inheriting the same profile but associated
with TX1 and TX2 alternately. Finally, a frame config message constructs a frame with transmissions
alternating between TX1 and TX2.
operations.
• C674 DSP – This is the digital signal processing core that implements the configuration of the front end
and executes the main signal processing operations on the data. This core has access to several
memory resources, as noted further in the design description.
• ARM R4F – This ARM MCU can execute application code, including further signal processing
operations and other higher level functions. In this application, the ARM R4F primarily relays
visualization data to the UART interface. There is a shared memory visible to both the DSP and the
R4F.
The processing chain is implemented on the DSP. There are several physical memory resources used in
the processing chain, which are described in Table 2.
As shown in Figure 6, the implementation of the vehicle occupancy detection example in the signal-
processing chain consists of the following blocks, implemented as DSP code executing on the C674x core
in the AWR1642:
• Range processing — For each antenna, EDMA is used to move samples from the ADC output buffer to
DSP’s local memory. A 16-bit, fixed-point 1D windowing and 16-bit, fixed-point 1D FFT are performed.
EDMA is used to move output from DSP local memory to radar cube storage in layer three (L3)
memory. Range processing is interleaved with active chirp time of the frame. All other processing
happens each frame, except where noted, during the idle time between the active chirp time and the
end of the frame.
• Clutter removal — In clutter-rich environments, especially indoor, detecting objects with small RCS
(radar cross section), such as pedestrian and life-form objects, is a challenge. Some clutters with large
RCS, such as building structure and furniture, can dominate the received signal. As a result, objects
with small RCS can be buried under the strong interference from the clutters and become difficult to
detect. When the radar sensor is stationary, clutters and all stationary objects have zero Doppler,
which is exploited to improve the signal condition for the remaining radar signal processing chain.
• Range-Azimuth heatmap generation — The Range-Azimuth heatmap is generated using high
resolution direction of arrival (DoA) spectral estimation, based on spatial covariance. This is done each
frame using the clutter removed, 1D FFT outputs. To avoid numeric instability issues, a small value is
added along the diagonal of the covariance estimate matrix.
• Feature extraction — Using the frame’s Range-Azimuth heatmap (and several previous frame’s
heatmaps), several features are calculated using zone definitions pre-computed and loaded during
configuration. The features are computed using only the heatmap cells within the defined zones. These
features are average power, average power for the past N frames, power ratios, and the correlation
coefficient.
• Zone detection — For Nz zones, there 2Nz are possible occupancy states for the area of interest. Matrix
multiplications are performed with the feature vectors and offline-generated training coefficients. The
result of these multiplications is an array of decisions, 1 (occupied) or 0 (empty) for each zone,
representing the possible occupancy states.
After DSP finishes frame processing, the results are formatted and written in shared memory for the
MSS R4F to send to host using UART for visualization. The PC GUI executable then decodes each
frame’s data and updates the heatmap and zone detections accordingly.
where
• xn,k is called a dimensional spatial vector for n-th range bin and the k-th chirp, which is formed from the data
cube by stacking samples across the virtual antennas (1)
For example:
(2)
To reduce the amount of computation, a smaller number of chirps less than Nc may be used in estimating
the spatial covariance.
DoA spectral estimation is performed as follows: An MVDR (also known as Capons’ beamforming) based
approach is shown here. First, denote α(θ) a steering vector for an azimuth angle θ as follows: for a linear
one-dimensional virtual receiver antenna array,
where
• d is the inter-antenna spacing normalized by the wavelength. (3)
The steering vector represents phase difference on each of virtual receive antennas when the incident
radar radio-frequency (RF) signal comes from azimuth angle θ. The angular spectrum for the n-th range
bin is given by:
(4)
And the corresponding beamforming vector is given as:
(5)
The DoA spectrum for each range bin is stacked into a matrix form, where the n-th row is populated with
the DoA spectrum of the n-th range bin. This matrix is called range-azimuth spectrum matrix S (see
Figure 1), whose (n, m) element is given by:
where
• the azimuth angle θ m for an azimuth angle index m (6)
(7)
The diagonally loading factor α n may be determined using the noise variance estimate as follows:
(8)
for a constant β , where P n = 1/Nα trace{Rn}) is the average of the diagonal terms of the covariance
estimate matrix.
(9)
Z i is the set of all the range-azimuth angle grids within the i-th zone (a rectangular-shaped boundary in
range-azimuth domain) which is defined by four parameters, ri L, ri U, θi L, and θi U.
2.4.9 Features
For each zone, several features used in determining the occupancy state are extracted. The features may
be derived from the average power for each zone (referred to as ‘zone power’). For zone i at a radar
frame index t, the average zone-power is defined as follows:
(10)
Features are defined as follows:
Moving-averaged zone power: for zone i at frame t,
where
• L is the window length for the moving-average. (11)
•
• Moving-averaged power ratio: for zone i at frame t,
(12)
• Correlation coefficient of zone power: between zone i and zone j,
where
• σi[t] is the standard deviation of Qi[t]for zone i, which is defined as follows:
(14) (14)
The feature set for a radar frame is formed by stacking all the features. For example, when N Z = 3, the
feature set vector is 9-dimensional vector x[t] as follows:
(15)
In the following sections, the element of the feature vector is sometimes also denoted as x[t] = [x1[t],
x2[t], ... , xN[t]]T , where is the number of features.
where
• N is the number of element in feature vector x[t], w 0is for bias term. (17)
The probability (or likelihood) of having a particular occupancy state is defined as follows:
where
• x~[t] = [1; x[t]] = [x0[t], x1[t], ... , xN[t]]T (obtained by pre-appending ‘1’ to the feature vector x[t]. Note that x0[t] =
1 always), and g(.) is a non-linear function, e.g., logistic function,
(19) (19)
Zone occupancy state is estimated as follows:
(20)
Because g(.) is an increasing function, the occupancy decision making is equivalent to:
(21)
Furthermore, the zone detection can be implemented with a matrix-vector multiplication as shown in
Figure 3, by stacking w(o1, o2, ... , oNz) into a 2Nz x (1 + N)matrix W as follows:
(22)
Then the zone-based decision may be made as follows:
where
• the non-linear function g(.) is element-wise, and arg max(.) gives the index of element that gives the
maximum in a vector, and de2bi[.] is a converter from a decimal value to a binary vector. (23)
For example, when Nz = 3, de2bi[.] functions as shown in the following table:
As illustrated in Figure 7, the example processing chain uses one UART port to receive input configuration
to the front end and signal processing chain, and uses the second UART port to send out processing
results for display. See the information included in the user guide for detailed information on the format of
the input configuration and output results.
3.1.1 Hardware
The AWR1642 core design includes:
• AWR1642 device: A single-chip, 77-GHz radar device with an integrated DSP
• Power management network using a low-dropout linear regulator (LDO) and power management
integrated circuit (PMIC) DC/DC supply (TPS7A88, TPS7A8101-Q1, and LP87524B-Q1)
The EVM also hosts a device to assist with onboard emulation and UART emulation over a USB link with
the PC.
Other tests were also performed with the AWR1642 sensor mounted in the vehicle. The first test was a
child seated in a carseat in one of the zones. Figure 13 shows the child in the carseat, and a capture from
the VOD demo GUI during testing.
Another test illustrates an intruder approaching the vehicle. Figure 14 shows the intruder and the
corresponding heatmap image. A positive (occupied) detection was not gathered, because the intruder
was still outside the defined zones.
4 Design Files
To download the software files, see the design files at TIDEP-1001.
4.1 Schematics
To download the schematics, see the design files at TIDEP-01001 .
5 Software Files
To download the software files, see the design files at TIDEP-01001 .
6 Related Documentation
• Texas Instruments, AWR1642 Evaluation Module (AWR1642EVM) Single-Chip mmWave Sensing
Solution
• Texas Instruments, Programming Chirp Parameters in TI Radar Devices
• Texas Instruments, AWR1642 Single-Chip 77- and 79-GHz FMCW Radar Sensor
• Texas Instruments, AWR14xx/16xx Technical Reference Manual
• Texas Instruments, AWR1642 Evaluation Board Design Database
• Texas Instruments, AWR1642BOOST Schematic, Assembly, and BOM
• Texas Instruments, mmWave SDK User's Guide
• Texas Instruments, AWR1642 mmWave sensor: 76–81-GHz radar-on-chip for short-range radar
applications
6.1 Trademarks
E2E is a trademark of Texas Instruments.
ARM is a registered trademark of ARM Ltd..
Altium Designer is a registered trademark of Altium LLC or its affiliated companies.
All other trademarks are the property of their respective owners.
Texas Instruments Incorporated (‘TI”) technical, application or other design advice, services or information, including, but not limited to,
reference designs and materials relating to evaluation modules, (collectively, “TI Resources”) are intended to assist designers who are
developing applications that incorporate TI products; by downloading, accessing or using any particular TI Resource in any way, you
(individually or, if you are acting on behalf of a company, your company) agree to use it solely for this purpose and subject to the terms of
this Notice.
TI’s provision of TI Resources does not expand or otherwise alter TI’s applicable published warranties or warranty disclaimers for TI
products, and no additional obligations or liabilities arise from TI providing such TI Resources. TI reserves the right to make corrections,
enhancements, improvements and other changes to its TI Resources.
You understand and agree that you remain responsible for using your independent analysis, evaluation and judgment in designing your
applications and that you have full and exclusive responsibility to assure the safety of your applications and compliance of your applications
(and of all TI products used in or for your applications) with all applicable regulations, laws and other applicable requirements. You
represent that, with respect to your applications, you have all the necessary expertise to create and implement safeguards that (1)
anticipate dangerous consequences of failures, (2) monitor failures and their consequences, and (3) lessen the likelihood of failures that
might cause harm and take appropriate actions. You agree that prior to using or distributing any applications that include TI products, you
will thoroughly test such applications and the functionality of such TI products as used in such applications. TI has not conducted any
testing other than that specifically described in the published documentation for a particular TI Resource.
You are authorized to use, copy and modify any individual TI Resource only in connection with the development of applications that include
the TI product(s) identified in such TI Resource. NO OTHER LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE TO
ANY OTHER TI INTELLECTUAL PROPERTY RIGHT, AND NO LICENSE TO ANY TECHNOLOGY OR INTELLECTUAL PROPERTY
RIGHT OF TI OR ANY THIRD PARTY IS GRANTED HEREIN, including but not limited to any patent right, copyright, mask work right, or
other intellectual property right relating to any combination, machine, or process in which TI products or services are used. Information
regarding or referencing third-party products or services does not constitute a license to use such products or services, or a warranty or
endorsement thereof. Use of TI Resources may require a license from a third party under the patents or other intellectual property of the
third party, or a license from TI under the patents or other intellectual property of TI.
TI RESOURCES ARE PROVIDED “AS IS” AND WITH ALL FAULTS. TI DISCLAIMS ALL OTHER WARRANTIES OR
REPRESENTATIONS, EXPRESS OR IMPLIED, REGARDING TI RESOURCES OR USE THEREOF, INCLUDING BUT NOT LIMITED TO
ACCURACY OR COMPLETENESS, TITLE, ANY EPIDEMIC FAILURE WARRANTY AND ANY IMPLIED WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, AND NON-INFRINGEMENT OF ANY THIRD PARTY INTELLECTUAL
PROPERTY RIGHTS.
TI SHALL NOT BE LIABLE FOR AND SHALL NOT DEFEND OR INDEMNIFY YOU AGAINST ANY CLAIM, INCLUDING BUT NOT
LIMITED TO ANY INFRINGEMENT CLAIM THAT RELATES TO OR IS BASED ON ANY COMBINATION OF PRODUCTS EVEN IF
DESCRIBED IN TI RESOURCES OR OTHERWISE. IN NO EVENT SHALL TI BE LIABLE FOR ANY ACTUAL, DIRECT, SPECIAL,
COLLATERAL, INDIRECT, PUNITIVE, INCIDENTAL, CONSEQUENTIAL OR EXEMPLARY DAMAGES IN CONNECTION WITH OR
ARISING OUT OF TI RESOURCES OR USE THEREOF, AND REGARDLESS OF WHETHER TI HAS BEEN ADVISED OF THE
POSSIBILITY OF SUCH DAMAGES.
You agree to fully indemnify TI and its representatives against any damages, costs, losses, and/or liabilities arising out of your non-
compliance with the terms and provisions of this Notice.
This Notice applies to TI Resources. Additional terms apply to the use and purchase of certain types of materials, TI products and services.
These include; without limitation, TI’s standard terms for semiconductor products http://www.ti.com/sc/docs/stdterms.htm), evaluation
modules, and samples (http://www.ti.com/sc/docs/sampterms.htm).
Mailing Address: Texas Instruments, Post Office Box 655303, Dallas, Texas 75265
Copyright © 2018, Texas Instruments Incorporated