37126d3451 | ||
---|---|---|
.. | ||
main | ||
CMakeLists.txt | ||
Makefile | ||
README.md | ||
sdkconfig.defaults |
README.md
Blink Example with Coverage Info
See the README.md file in the upper level 'examples' directory for more information about examples.
GCC has useful feature which allows to generate code coverage information. Generated data show how many times every program execution paths has been taken. Basing on coverage data developers can detect untested pieces of code and also it gives valuable information about critical (frequently used) execution paths. In general case when coverage option is enabled GCC generates additional code to accumulate necessary data and save them into files. File system is not always available in ESP32 based projects or size of the file storage can be very limited to keep all the coverage data. To overcome those limitations IDF provides functionality to transfer the data to host and save them on its file system. Data transfer is done via JTAG. This example shows how to generate coverage information for the program.
How To Gather Coverage Info
There are two ways to collect gcov data:
- Hard-coded call to
esp_gcov_dump
. - Instant run-time dumping w/o changes in your code via IDF's gcov debug stub.
Generic Steps
Below are generic steps which should be performed to obtain coverage info. The steps are already done for this example project.
- Enable application tracing module in menuconfig. Choose
Trace memory
inComponent config -> Application Level Tracing -> Data Destination
. - Enable GCOV to host interface in menuconfig
Component config -> Application Level Tracing -> GCOV to Host Enable
. - Enable coverage info generation for necessary source files. To do this add the following line to the 'component.mk' files of your project:
CFLAGS += --coverage
It will enable coverage info for all source files of your component. If you need to enable the option only for certain files the following line should be added for every file of interest:gcov_example.o: CFLAGS += --coverage
Replacegcov_example.o
with path to your file.
For CMake-based build system, use component_compile_options(--coverage)
or: set_source_files_properties(gcov_example.c PROPERTIES COMPILE_FLAGS --coverage
Hard-coded Dump Call
This method requires esp_gcov_dump
to be called from your application's code. Below are additional steps which should be performed after the generic ones to obtain coverage info via hard-coded call. Step 1 is already done for this example project.
- Add call to
esp_gcov_dump
function in your program. This function will wait for command from host and dump coverage data. The exact place where to put the call depends on the program. Usually it should be placed at the end of the program execution (at exit). But if you need to generate GCOV data incrementallyesp_gcov_dump
can be called multiple times. Seegcov_example.c
for example. - Build, flash and run program.
- Wait until
esp_gcov_dump
is called. To detect this a call toprintf
can be used (seegcov_example.c
) or, for example, you can use a LED to indicate the readiness to dump data. Another way to detect call toesp_gcov_dump
is to set breakpoint on that function, start target execution and wait for the target to be stopped. See the next section for respective GDB example. - Connect OpenOCD to the target and start telnet session with it.
- Run the following OpenOCD command:
esp32 gcov dump
Example of the command output:
> esp32 gcov dump
Total trace memory: 16384 bytes
Connect targets...
Target halted. PRO_CPU: PC=0x40088BC3 (active) APP_CPU: PC=0x400D14E6
Targets connected.
Open file 0x1 '/home/alexey/projects/esp/esp-idf/examples/system/gcov/build/main/gcov_example.gcda'
Open file 0x1 '/home/alexey/projects/esp/esp-idf/examples/system/gcov/build/main/gcov_example.gcda'
Open file 0x2 '/home/alexey/projects/esp/esp-idf/examples/system/gcov/build/main/gcov_example_func.gcda'
Open file 0x2 '/home/alexey/projects/esp/esp-idf/examples/system/gcov/build/main/gcov_example_func.gcda'
Disconnect targets...
Target halted. PRO_CPU: PC=0x400D14E6 (active) APP_CPU: PC=0x400D14E6
Targets disconnected.
Dump Using GDB
As it was said above breakpoint can be used to detect when esp_gcov_dump
is called.
The following GDB commands can be used to dump data upon call to esp_gcov_dump
automatically (you can put them into gdbinit
file):
b esp_gcov_dump
commands
mon esp32 gcov dump
end
Note that all OpenOCD commands should be invoked in gdb as: mon <oocd_command>
.
Instant Run-Time Dump
Instant dump does not require to call esp_gcov_dump
, so your application's code does not need to be modified. This method stops target at its current state and executes builtin IDF gcov debug stub function.
Having data dumped target resumes its execution. Below are the steps which should be performed to do instant dump. Step 1 is already done for this example project.
- Enable OpenOCD debug stubs in menuconfig
Component config -> ESP32-specific -> OpenOCD debug stubs
. - Build, flash and run program.
- Connect OpenOCD to the target and start telnet session with it.
- Run the following OpenOCD command:
esp32 gcov
Example of the command output:
> esp32 gcov
Total trace memory: 16384 bytes
Connect targets...
Target halted. PRO_CPU: PC=0x400D14DA (active) APP_CPU: PC=0x400D14DA
Targets connected.
Open file 0x1 '/home/alexey/projects/esp/esp-idf/examples/system/gcov/build/main/gcov_example.gcda'
Open file 0x1 '/home/alexey/projects/esp/esp-idf/examples/system/gcov/build/main/gcov_example.gcda'
Open file 0x2 '/home/alexey/projects/esp/esp-idf/examples/system/gcov/build/main/gcov_example_func.gcda'
Open file 0x2 '/home/alexey/projects/esp/esp-idf/examples/system/gcov/build/main/gcov_example_func.gcda'
Target halted. PRO_CPU: PC=0x400844CE (active) APP_CPU: PC=0x400855E3
Disconnect targets...
Targets disconnected.
>
Coverage Data Accumulation
Coverage data from several dumps are automatically accumulated. So the resulting gcov data files contain statistics since the board reset. Every data dump updates files accordingly. New data collection is started if target has been reset.
How To Process Coverage Info
There are several ways to process collected data. Two of the most common are:
- Using
gcov
tool supplied along with xtensa toolchain. See GCOV documentation for details. - Using
lcov
andgenhtml
tools. This way allows to generate pretty looking coverage reports in html. This example shows how to add build target to generate such kind of reports. Add the following lines to you project'sMakefile
after the line includingproject.mk
:
GCOV := $(call dequote,$(CONFIG_TOOLPREFIX))gcov
REPORT_DIR := $(BUILD_DIR_BASE)/coverage_report
lcov-report:
echo "Generating coverage report in: $(REPORT_DIR)"
echo "Using gcov: $(GCOV)"
mkdir -p $(REPORT_DIR)/html
lcov --gcov-tool $(GCOV) -c -d $(BUILD_DIR_BASE) -o $(REPORT_DIR)/$(PROJECT_NAME).info
genhtml -o $(REPORT_DIR)/html $(REPORT_DIR)/$(PROJECT_NAME).info
cov-data-clean:
echo "Remove coverage data files..."
find $(BUILD_DIR_BASE) -name "*.gcda" -exec rm {} +
rm -rf $(REPORT_DIR)
.PHONY: lcov-report cov-data-clean
Those lines add two build targets:
lcov-report
- generates html coverage report in$(BUILD_DIR_BASE)/coverage_report/html
directory.cov-data-clean
- removes all coverage data files and reports.
To generate report type the following command:
make lcov-report
The sample output of the command is below:
Generating coverage report in: /home/alexey/projects/esp/esp-idf/examples/system/gcov/build/coverage_report
Using gcov: ~/projects/esp/crosstool-NG/builds/xtensa-esp32-elf/bin/xtensa-esp32-elf-gcov
Capturing coverage data from /home/alexey/projects/esp/esp-idf/examples/system/gcov/build
Found gcov version: 5.2.0
Scanning /home/alexey/projects/esp/esp-idf/examples/system/gcov/build for .gcda files ...
Found 2 data files in /home/alexey/projects/esp/esp-idf/examples/system/gcov/build
Processing main/gcov_example_func.gcda
Processing main/gcov_example.gcda
Finished .info-file creation
Reading data file /home/alexey/projects/esp/esp-idf/examples/system/gcov/build/coverage_report/gcov_example.info
Found 2 entries.
Found common filename prefix "/home/alexey/projects/esp/esp-idf/examples/system/gcov"
Writing .css and .png files.
Generating output.
Processing file main/gcov_example.c
Processing file main/gcov_example_func.c
Writing directory view page.
Overall coverage rate:
lines......: 90.0% (18 of 20 lines)
functions..: 100.0% (3 of 3 functions)
NOTE: Since lcov
tool is not part of GCC bundle it can happen that format of GCOV binary data has been changed and your local version of lcov
fails to understand it.
So it always better to use the latest lcov
version from LCOV repo.