Skip to content

TC Software Update 2.7 Cerify events during update #40656

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 6 commits into
base: master
Choose a base branch
from
Draft

TC Software Update 2.7 Cerify events during update #40656

wants to merge 6 commits into from
+475 −256

Conversation

jtrejoespinoza-grid
Copy link
Contributor

Summary

This is currently a Draft.

This PR contains the test case TC_SU_2.7 which verify the events during the software update.

Related issues

#Fixes project-chip/matter-test-scripts#657

Testing

Terminal 1:
 ./out/debug/chip-ota-requestor-app --discriminator 123 --passcode 2123 --secured-device-port 5541 --autoApplyImage --KVS /tmp/chip_kvs_requestor
       
Terminal 2:  
./out/debug/chip-ota-provider-app --filepath firmware_requestor_v2.min.ota  --discriminator 321 --passcode 2321

Terminal 3:
 python3 src/python_testing/TC_SU_2_7.py --commissioning-method on-network --passcode 2123 --discriminator 123 --endpoint 0 --nodeId 123

@github-actions github-actions bot added the tests label Aug 19, 2025
@jtrejoespinoza-grid jtrejoespinoza-grid changed the title TC Software update verity events during update TC Software update verify events during update Aug 22, 2025
@jtrejoespinoza-grid jtrejoespinoza-grid changed the title TC Software update verify events during update TC Software Update 2.7 Cerify events during update Aug 22, 2025
@jtrejoespinoza-grid
Copy link
Contributor Author

Progress update:

Completed:

  • Commissioning
  • ACLs
  • Announcement
  • Event Discovery

Worked in several apps configuration that allows how to trigger events for idle, applying and consent.

Example for user consent

./out/debug/chip-ota-requestor-app --discriminator 123 --passcode 2123 --secured-device-port 5540  --KVS /tmp/chip_kvs_requestor --userConsentNeeded
./out/debug/chip-ota-provider-app --filepath firmware_requestor_v2.min.ota --discriminator 321  --secured-device-port 5541  --passcode 2321  -u deferred -c

Example for Delayed

/out/debug/chip-ota-provider-app --filepath firmware_requestor_v2.min.ota --discriminator 321   --passcode 2321  --delayedQueryActionTimeSec 60 --queryImageStatus busy

./out/debug/chip-ota-requestor-app --discriminator 123 --passcode 2123 --secured-device-port 5540  --KVS /tmp/chip_kvs_requestor

Events still missing to trigger

  • DownLoadEvent error
  • StateTransitionEvent -> kDelayedOnApply

Overal actions missing:

  • How to trigger a download error.

  • Verify how to trigger delayed on apply using the Linux app flags.

  • I need to add a method to clean up commissioning and re-commission devices on runtime (both apps) this is needed because is needed to run the apps with different parameters that allow me to catch the expected events.

@github-actions github-actions bot added the app label Aug 22, 2025
@github-actions GitHub Actions
Copy link

github-actions bot commented Aug 22, 2025 •
edited
Loading

PR #40656: Size comparison from f1631b6 to 2c9d8f7

Full report (37 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, efr32, esp32, nrfconnect, nxp, psoc6, qpg, realtek, stm32, telink)
platform target config section f1631b6 2c9d8f7 change % change
bl602 lighting-app bl602+mfd+littlefs+rpc FLASH 1105874 1105874 0 0.0
RAM 179018 179018 0 0.0
bl702 lighting-app bl702+eth FLASH 659208 659208 0 0.0
RAM 135025 135025 0 0.0
bl702+wifi FLASH 836380 836380 0 0.0
RAM 124509 124509 0 0.0
bl706+mfd+rpc+littlefs FLASH 1068388 1068388 0 0.0
RAM 117349 117349 0 0.0
bl702l contact-sensor-app bl702l+mfd+littlefs FLASH 897826 897826 0 0.0
RAM 105660 105660 0 0.0
lighting-app bl702l+mfd+littlefs FLASH 981540 981540 0 0.0
RAM 109844 109844 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 768324 768324 0 0.0
RAM 103392 103392 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 779944 779944 0 0.0
RAM 108560 108560 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 725548 725548 0 0.0
RAM 96932 96932 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 710024 710024 0 0.0
RAM 97140 97140 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 552246 552246 0 0.0
RAM 205120 205120 0 0.0
lock CC3235SF_LAUNCHXL FLASH 584562 584562 0 0.0
RAM 205352 205352 0 0.0
efr32 lock-app BRD4187C FLASH 959824 959824 0 0.0
RAM 126408 126408 0 0.0
BRD4338a FLASH 755272 755264 -8 -0.0
RAM 255732 255732 0 0.0
window-app BRD4187C FLASH 1053940 1053940 0 0.0
RAM 122604 122604 0 0.0
esp32 all-clusters-app c3devkit DRAM 102536 102536 0 0.0
FLASH 1769494 1769494 0 0.0
IRAM 83862 83862 0 0.0
m5stack DRAM 121388 121388 0 0.0
FLASH 1716750 1716750 0 0.0
IRAM 117051 117051 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 912220 912220 0 0.0
RAM 152898 152898 0 0.0
nxp contact mcxw71+release FLASH 632472 632472 0 0.0
RAM 64124 64124 0 0.0
lock mcxw71+release FLASH 742264 742264 0 0.0
RAM 65200 65200 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1661588 1661588 0 0.0
RAM 211216 211216 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1582916 1582916 0 0.0
RAM 208480 208480 0 0.0
light cy8ckit_062s2_43012 FLASH 1453876 1453876 0 0.0
RAM 197200 197200 0 0.0
lock cy8ckit_062s2_43012 FLASH 1486204 1486204 0 0.0
RAM 224920 224920 0 0.0
qpg lighting-app qpg6200+debug FLASH 820984 820984 0 0.0
RAM 127644 127644 0 0.0
lock-app qpg6200+debug FLASH 758316 758316 0 0.0
RAM 118604 118604 0 0.0
realtek light-switch-app rtl8777g FLASH 704040 704040 0 0.0
RAM 106676 106676 0 0.0
lighting-app rtl8777g FLASH 755624 755624 0 0.0
RAM 127056 127056 0 0.0
stm32 light STM32WB5MM-DK FLASH 468060 468060 0 0.0
RAM 141400 141400 0 0.0
telink bridge-app tl7218x FLASH 709988 709988 0 0.0
RAM 93472 93472 0 0.0
light-app-ota-compress-lzma-shell-factory-data tl3218x FLASH 798900 798900 0 0.0
RAM 44032 44032 0 0.0
light-app-ota-shell-factory-data tl7218x FLASH 790114 790114 0 0.0
RAM 100776 100776 0 0.0
light-switch-app-ota-compress-lzma-factory-data tl7218x_retention FLASH 716272 716272 0 0.0
RAM 54260 54260 0 0.0
light-switch-app-ota-compress-lzma-shell-factory-data tlsr9528a FLASH 749628 749628 0 0.0
RAM 77408 77408 0 0.0
light-switch-app-ota-factory-data tl3218x_retention FLASH 726418 726418 0 0.0
RAM 37008 37008 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 606406 606406 0 0.0
RAM 112584 112584 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 822834 822838 4 0.0
RAM 99172 99172 0 0.0

@codecov Codecov
Copy link

codecov bot commented Aug 22, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 50.72%. Comparing base (f1631b6) to head (2c9d8f7).

Additional details and impacted files 
@@            Coverage Diff             @@
##           master   #40656      +/-   ##
==========================================
- Coverage   50.72%   50.72%   -0.01%     
==========================================
  Files        1356     1356              
  Lines       99345    99345              
  Branches    12876    12876              
==========================================
- Hits        50397    50396       -1     
- Misses      48948    48949       +1

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
app tests
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

TC-SU-2.7: Consider testing in other tests
1 participant
@jtrejoespinoza-grid