Wykres commitów

76 Commity (fba96d58c26520df8af41073d7253468d03677ac)

Autor SHA1 Wiadomość Data
Fu Hanxi fba96d58c2
ci: dynamic pipeline
build:
- upgrade idf-build-apps to 2.x
- unify get_pytest_apps and get_cmake_apps to get_all_apps
	- returns (test_apps, non_test_apps) tuple
- add tests for the new get_all_apps

assign:
- generate build report
- generate target test pipeline based on the build report

target test:
- download artifacts from minio server
- users can use `pytest --pipeline-id xxxxx` to download and flash
the binaries from the artifacts

.post:
- generate target test reports
2024-01-10 15:37:34 +01:00
Fu Hanxi 06af021c9f
ci(pytest): stop ambiguous markers for multi-dut test case
also add `tools/ci/idf_pytest/tests` for testing
2024-01-10 15:29:42 +01:00
igor.udot e0a40feb5c refactor: changed logic of unity_tester, replaced threads by generators 2023-12-06 15:58:05 +08:00
Aleksei Apaseev a3362727cc ci: assign the test_case_name attribute to the case item while setting up a pytest session 2023-10-23 20:45:05 +08:00
Fu Hanxi 24b2e0a56d ci: different test case name with different params 2023-10-04 16:05:29 +00:00
Fu Hanxi 5e4427ab13
ci(pytest): add plugin pytest-ignore-test-results
pass with warning if test job got ignored.
2023-08-18 10:50:18 +08:00
Fu Hanxi 39f3a5f3ac
ci(pytest): skip test case if no app found while collecting, not setup 2023-08-18 08:36:06 +08:00
Fu Hanxi 1d69302eae
ci(pytest): move pytest utils into tools/ci/idf_pytest
For future usage
2023-08-18 08:36:06 +08:00
Xu Si Yu 36511a3005 Merge branch 'feature/add_sleep_test_for_ot_ci' into 'master'
OpenThread CI: add a test case of sleepy device

See merge request espressif/esp-idf!24715
2023-08-01 20:38:29 +08:00
Abhik Roy ef50beb4d0 ci: Added napt pytest with vlan example
CI: add vlan example to ethernet patterns
Included a Pytest for the vlan_support example, which focuses on testing
the NAPT module in lwip by forwarding packets between different VLAN interfaces.
2023-07-31 13:42:26 +00:00
Xu Si Yu 5f51dcc686 ci(openthread): Add a test case for openthread sleepy device 2023-07-31 15:38:11 +08:00
Fu Hanxi 7c3143dba8
ci: name the test case id with _qemu postfix for qemu test cases 2023-07-26 17:09:38 +08:00
Aleksei Apaseev 9f5f8fa939 ci(pytest): Add functionality to merge JUnit files of the multidut testcases into one file with the unique testcases 2023-07-25 10:11:55 +08:00
Harshit Malpani 7645723127
fix(ci): update HTTP client example tests runner assignment
HTTP client example tests now connect with locally hosted httpbin service
for more stable results across multiple runs
2023-07-21 10:55:25 +05:30
Ondrej Kosta 3e97f81727 Merge branch 'bugdix/lwip_bridge_ci_err' into 'master'
Fix lwip bridge CI error

See merge request espressif/esp-idf!24718
2023-07-14 16:51:19 +08:00
Shu Chen 5ffeff55b4 Merge branch 'zigbee/Add_pytest_in_CI' into 'master'
ci(zigbee): Add pytest for esp32h2 in CI

See merge request espressif/esp-idf!23779
2023-07-13 23:24:55 +08:00
Abudl Rehman a4ddf7d5f7 ci(zigbee): Add pytest for esp32h2 in CI 2023-07-13 15:15:33 +08:00
Planck (Lu Zeyu) c190beb4d9 bugfix(esp_lcd): propagate the errors in the IO link layer
Closes https://github.com/espressif/esp-idf/issues/11741
Check the result of each esp_lcd_panel_io_tx_param/esp_lcd_panel_io_tx_color call
Add runner and modify test rules
Update .build-test-rules.yml
2023-07-13 10:23:05 +08:00
Ondrej Kosta c7d56d213c ci(examples/bridge): Fixed issue when broadcast message was not recevived time to time 2023-07-12 12:30:23 +02:00
Fu Hanxi 22e2738f78 ci: build and test only modified components related test cases 2023-05-26 22:59:57 +08:00
Laukik Hase 72f703ccd4
nvs_flash: Extended test-app and host tests for the HMAC-based NVS encr-keys protection scheme 2023-05-23 13:55:59 +05:30
laokaiyao 1f84f6c6ed esp32h4: remove esp32h4 target from ci 2023-04-20 15:19:47 +08:00
Armando ad46b43c2c sdmmc: add an example communicating with eMMC chip on S3 2023-04-14 18:18:54 +08:00
Ondrej Kosta eb17a9d6e0 network_examples: added LwIP bridge test 2023-04-12 09:14:12 +02:00
Fu Hanxi 1be18d4bc5 ci: migrate peripherals ttfw test scripts 2023-04-10 08:46:42 +08:00
Sachin Parekh 109afcb311 ci: Add patterns and target-tests for `ecdsa_efuse` runner 2023-04-07 14:56:37 +05:30
Fu Hanxi 9295aef934 ci: remove linux build dir workaround 2023-03-31 15:07:07 +08:00
Fu Hanxi a25176d963 ci: make unity test case known failure work!
Besides, it would also improve the test report summary
2023-02-27 14:37:07 +08:00
Erhan Kurubas 1ee5c8d877 example/system: add generic apptrace example with pytest support 2023-02-15 10:30:08 +01:00
KonstantinKondrashov c191e95300 ci: Run test_examples_efuse_with_virt_secure_boot_v2 only on ESP32 ECO3 2023-02-14 18:16:51 +08:00
Xu Si Yu f6c13515b3 Merge branch 'feature/add_openthread_ci_for_esp32c6' into 'master'
openthread: add ci for esp32c6

See merge request espressif/esp-idf!22026
2023-02-03 10:29:30 +08:00
Xu Si Yu 389d07b9c1 openthread: add ci for esp32c6 2023-02-02 16:29:19 +08:00
jiangguangming b0fa18d290 ci: fix typos tag naming of all flash_multi 2023-02-01 08:46:48 +08:00
Ondrej Kosta 5da702bab3 Merge branch 'feature/iperf_pytest_migration' into 'master'
iperf pytest migration

Closes IDFCI-1143

See merge request espressif/esp-idf!21726
2023-01-31 18:04:59 +08:00
Cao Sen Miao 94120b82c2 esp32h2: add build test 2023-01-17 10:29:04 +08:00
Ondrej Kosta 7aa4462d0b Ethernet & WiFi iperf test migration to pytest 2023-01-16 15:45:56 +01:00
Fu Hanxi 51adb9ab27 test: temp workaround for linux test apps 2023-01-16 10:25:55 +08:00
Fu Hanxi 6ee874ccad ci: add `log_performance` and `check_performance` as fixtures in pytest 2022-12-21 10:25:33 +08:00
Fu Hanxi dc3c630919 ci: move more openocd scripts into pytest-embedded 2022-12-08 14:25:02 +08:00
Fu Hanxi 08e68c192a ci(pytest): differentiate `temp_skip` and `temp_skip_ci` markers 2022-12-08 09:49:12 +08:00
Fu Hanxi 52e6fefb3d ci(pytest): stop adding xtal_40mhz when running test case for other targets 2022-12-08 09:49:12 +08:00
Fu Hanxi d9bcb99f58 ci(pytest): declare markers in conftest.py instead of pytest.ini 2022-12-08 09:49:12 +08:00
Song Ruo Jing f201226439 ci: Move esp32c6 from preview_targets to supported_targets for ci 2022-11-28 11:58:30 +08:00
Fu Hanxi 056601127b ci: add `temp_skip_ci` marker to simplify markers
example: `@pytest.mark.temp_skip_ci(targets=['esp32'])`
2022-11-22 17:54:55 +08:00
Chen Yudong a78d492091 pytest: use case_tester for multi-device tests 2022-11-10 22:29:05 +08:00
laokaiyao 8677216576 esp32h2: renaming esp32h2 to esp32h4 2022-11-08 17:05:33 +08:00
Song Ruo Jing 2557e24a28 ci: Enable esp32c6 example, test_apps, and unit tests CI build stage 2022-11-01 11:23:21 +08:00
Fu Hanxi a8f68044a2 ci: fix setup error ignore issue 2022-10-21 11:46:24 +08:00
laokaiyao cf528deeb1 test: add a script for supporting multi-dev and multi-stage case 2022-10-20 18:35:51 +08:00
Chen Yudong aa822339aa pytest: set default timeout for each case 2022-10-08 04:47:35 +00:00