Some test cases are executed with secondary graphic card only
| Affects | Status | Importance | Assigned to | Milestone | |
|---|---|---|---|---|---|
| Checkbox Provider - Base |
Fix Released
|
High
|
Po-Hsu Lin | ||
| Provider for Plainbox - Canonical Certification (Legacy) |
Fix Released
|
High
|
Po-Hsu Lin | ||
Bug Description
When running test with a hybrid graphics platform, plainbox request to switch graphic cards to test both iGPU and dGPU. The draft process is as following
1. graphics test for primary graphic card
2. switch to secondary graphic card (need to reboot system)
3. graphics test for secondary graphics card
4. other tests (including hibernate test)
5. monitor tests
6. suspend tests (including suspend_advanced, hybrid sleep)
7. after suspend tests (including display, resolution tests)
8. switch back primary graphics card (need to reboot system)
2013.com.
9. suspend for primary graphic card
2013.com.
10. display check for primary graphic card after susend
2013.com.
With this process, tests in steps 4, 5, 6, 7 are executed with secondary graphic card. Some of them are strong related to graphics e.g. suspend, hibernate, hybrid sleep, monitor, display, resolution tests. It does not make sense to test those critical test cases with secondary but not primary graphic card.
There are 2 possible solutions.
I. add 1 more switch graphics between step 3&4 and the other one after step 10
then the process will become
1. graphics test for primary graphic card
2. switch to secondary graphic card (need to reboot system)
3. graphics test for secondary graphics card
4. switch back to primary graphic card
5. other tests (including hibernate test)
6. monitor tests
7. suspend tests (including suspend_advanced, hybrid sleep)
8. after suspend tests (including display, resolution tests)
9. switch to secondary graphic card again (need to reboot system)
10. suspend for secondary graphic card
2013.com.
11. display check for primary graphic card after susend
2013.com.
12. switch back to primary graphic card again
II. finish all test cases with primary graphic card and then perform a test set for secondary graphic card
1. full test with primary graphic card
2. switch to secondary graphic card
3. test graphics, display, monitor, suspend, hibernate, hybrid sleep, after suspend test cases for secondary graphic card.
* may can be test with a specific graphics whitelist. (solution III.)
Related branches
- Po-Hsu Lin: Needs Resubmitting
- Sylvain Pineau: Pending requested
-
Diff: 1228 lines (+566/-316)9 files modifiedproviders/plainbox-provider-certification-client/units/client-cert-14-04.pxu (+51/-26)
providers/plainbox-provider-certification-client/whitelists/client-cert.whitelist (+62/-35)
providers/plainbox-provider-checkbox/jobs/audio.txt.in (+82/-59)
providers/plainbox-provider-checkbox/jobs/graphics.txt.in (+22/-14)
providers/plainbox-provider-checkbox/jobs/hibernate.txt.in (+42/-27)
providers/plainbox-provider-checkbox/jobs/led.txt.in (+1/-0)
providers/plainbox-provider-checkbox/jobs/monitor.txt.in (+176/-113)
providers/plainbox-provider-checkbox/jobs/stress.txt.in (+1/-1)
providers/plainbox-provider-checkbox/jobs/suspend.txt.in (+129/-41)
- Sylvain Pineau: Approve
-
Diff: 1222 lines (+586/-282)8 files modifiedproviders/plainbox-provider-certification-client/units/client-cert-14-04.pxu (+59/-35)
providers/plainbox-provider-certification-client/whitelists/client-cert.whitelist (+62/-36)
providers/plainbox-provider-checkbox/jobs/audio.txt.in (+82/-59)
providers/plainbox-provider-checkbox/jobs/graphics.txt.in (+22/-14)
providers/plainbox-provider-checkbox/jobs/hibernate.txt.in (+49/-0)
providers/plainbox-provider-checkbox/jobs/led.txt.in (+1/-0)
providers/plainbox-provider-checkbox/jobs/monitor.txt.in (+176/-113)
providers/plainbox-provider-checkbox/jobs/suspend.txt.in (+135/-25)
| description: | updated |
| tags: | added: ce-qa-concern |
| Changed in checkbox: | |
| importance: | Undecided → High |
| Jerry Kao (jerry.kao) wrote | #1 |
| Jerry Kao (jerry.kao) wrote | #2 |
| summary: |
- Some test cases are executed with secondary graphic card + Some test cases are executed with secondary graphic card only |
| Changed in checkbox: | |
| assignee: | nobody → Sylvain Pineau (sylvain-pineau) |
| status: | New → In Progress |
| Pierre Equoy (pieq) wrote | #3 |
| Po-Hsu Lin (cypressyew) wrote | #4 |
| Po-Hsu Lin (cypressyew) wrote | #5 |
| Zygmunt Krynicki (zyga) wrote | #6 |
| Changed in checkbox: | |
| assignee: | Sylvain Pineau (sylvain-pineau) → Po-Hsu Lin (cypressyew) |
| affects: | checkbox → plainbox-provider-checkbox |
| Changed in plainbox-provider-canonical-certification: | |
| status: | New → In Progress |
| importance: | Undecided → High |
| assignee: | nobody → Po-Hsu Lin (cypressyew) |
| milestone: | none → 0.16 |
| Changed in plainbox-provider-checkbox: | |
| milestone: | none → future |
| milestone: | future → 0.20 |
| Changed in plainbox-provider-canonical-certification: | |
| status: | In Progress → Fix Released |
| Changed in plainbox-provider-checkbox: | |
| status: | In Progress → Fix Released |
| Changed in plainbox-provider-canonical-certification: | |
| milestone: | 0.16 → none |
| Changed in plainbox-provider-checkbox: | |
| milestone: | 0.20 → none |
| Changed in plainbox-provider-canonical-certification: | |
| status: | Fix Released → Fix Committed |
| Changed in plainbox-provider-checkbox: | |
| status: | Fix Released → Fix Committed |
| Changed in plainbox-provider-canonical-certification: | |
| milestone: | none → 0.16.1 |
| Changed in plainbox-provider-checkbox: | |
| milestone: | none → 0.20.1 |
| Changed in plainbox-provider-canonical-certification: | |
| status: | Fix Committed → Fix Released |
| Changed in plainbox-provider-checkbox: | |
| status: | Fix Committed → Fix Released |
I introduced the generator discussed in lp:1425386 in the Stella Full Test Plan and run a test on a device with 2 graphic cards (Intel+AMD). It works pretty well but, as Jerry mentioned, the monitor/* tests are only run on the second graphic card and never on the first one.
@Sylvain, could it be possible to add a generator for the monitor/* tests to ensure all these tests are run on both graphic cards (if the device has more than 1 graphic card)?
We would then add this generator to the Desktop/Laptop full test plans.