Testing Checklist
This is a testing checklist which must be complete prior to marking a final release is ready. It should be deprecated with T56: Transfer testcases to the actual testcase branch.
Installer tests - 23.10 (Mantic Minotaur)
Release date: - 12 October 2023
Final Freeze: - 5 October 2023
Beta release: - 21 September 2023
RC reached at: - 9 October 2023
- calamares: 3.3.0-alpha2-0ubuntu6 at 20231009
- calamares-settings-lubuntu 1:23.10.4 at 20231009
- calamares-settings-ubuntu-common 1:23.10.4 at 20231009
- lubuntu-default-settings: 23.10.4 at 20231009
- casper 1.486 (casper changed from 1.482 to 1.484 on 20231001, 1.486 appeared 20231003)
Ubuntu Release tracking document - https://discourse.ubuntu.com/t/mantic-minotaur-23-10-release-status-tracking/37887
Ubuntu Release Schedule - https://discourse.ubuntu.com/t/mantic-minotaur-release-schedule/34989
Full disk install tests
Type | Encryption | Firmware | Internet | Swap (Y/N) | Completed Date | Tester | ISO | pc.detail | paste.for.tracker |
---|---|---|---|---|---|---|---|---|---|
Full disk install | no | BIOS | yes | y | 20231009 | @Leok | 20231009 | len_yg_sl7 | testcase: full disk, no-encryption, BIOS, internet, swap |
Full disk install | yes | BIOS | yes | n | 20231009 | @guiverc | 20231009 | hp_dc7700 | testcase: full disk, encryption, BIOS, internet, no-swap |
Full disk install | no | BIOS | no | y | 20231010 | @guiverc | 20231010 | hp_dc7700 | testcase: full disk, no-encryption, BIOS, no-internet, swap |
Full disk install | yes | BIOS | no | n | 20231010 | @guiverc | 20231010 | hp_dc7700 | testcase: full disk, encryption, BIOS, no-internet, no-swap |
Full disk install | no | EFI | yes | y | 20231010 | @guiverc | 20231010 | svp11216cgb | testcase: full disk, no-encryption, EFI, internet, swap |
Full disk install | yes | EFI | yes | y | 20231009 | @guiverc | 20231005 | svp11216cgb | testcase: full disk, encryption, EFI, internet, swap |
Full disk install | no | EFI | no | n | 20230921 | @Leok | 20230919 | dell_lat_7280 | testcase: full disk, no-encryption, EFI, no-internet, no-swap |
Full disk install | yes | EFI | no | n | 20231003 | @guiverc | 20231002 | svp11216cgb | testcase: full disk, encryption, EFI, no-internet, no-swap |
Full disk install | no | EFI + secure boot | yes | y | 20231011 | @Leok | 20231010 | awow_ny41 | testcase: full disk, no-encryption, secure-EFI, internet, swap |
Full disk install | yes | EFI + secure boot | yes | n | 20231011 | @Leok | 20231010 | dell_lat_7280 | testcase: full disk, encryption, secure-EFI, internet,swap |
Full disk install | no | EFI + secure boot | no | y | 20231011 | @Leok | 20231010 | dell_opt_7060 | testcase: full disk, no-encryption, secure-EFI, no-internet, swap |
Full disk install | yes | EFI + secure boot | no | n | 20231011 | @Leok | 20231010 | awow_ny41 | testcase: full disk, encryption, secure-EFI, no-internet, no-swap |
Please try and ensure one of SWAP (Y) & NO-SWAP (N) exist for each test type (ie. BIOS, uEFI or Secure-uEFI) for releases of hirsute or later.
Other install types
Type | Completed Date | Tester | ISO | pc.detail | paste.for.tracker |
---|---|---|---|---|---|
Install alongside | 20231005 | @guiverc | 20231004 | hp_dc7700 | testcase: install alongside |
Replace partition | 20231003 | @guiverc | 20231002 | hp_dc7700 | testcase: replace partition |
Install using existing partition | 20231009 | @guiverc | 20231009 | dell_opt_780 | testcase: install using existing partition |
Custom partitioning with separate /home | 20231003 | @guiverc | 20231002 | hp_dc7700 | testcase: custom partitioning with separate /home |
Custom partitioning on btrfs | 20231005 | @guiverc | 20231004 | vb_dell_opt_7050 | testcase: btrfs install |
Custom partitioning on xfs | 20231005 | @guiverc | 20231004 | vb_dell_opt_7050 | testcase: xfs install |
Install using another language | 20231009 | @Leok | 20231009 | len_YG_Sl7 | |
Auto-login after install | 20231010 | @guiverc | 20231010 | hp_dc7700 | |
The install using another language, and/or auto-login can be combined with another install, ie. a single QA-test can be used to refresh the details of up to two lines on this checklist (eg. auto-install or install with another language)
Additional testcases
Test Information | Completed Date | Tester | pc.detail |
---|---|---|---|
GUI upgrade¹ from prior release | 20231006 | @guiverc | vm_dell_opt_7050 |
TUI upgrade² from prior release | 20230921 | @Leok | dell_opt_7060 |
GUI upgrade¹ from LTS to next LTS release | na | na | na |
TUI upgrade² from LTS to next LTS release | na | na | na |
minimal install³ | not applicable | ||
¹do-release-upgrade -d -m desktop -f DistUpgradeViewKDE
²do-release-upgrade -d
³ Currently not implemented
- The purpose of the "Optional box" field is to allow re-tests to be done on a different box to prior time (if possible)
- na is short for not-applicable
To help understanding some of these testcases, the following link maybe helpful - https://discourse.lubuntu.me/t/testing-checklist-understanding-the-testcases/2743
- Last Author
- Leok
- Last Edited
- Oct 11 2023, 8:24 AM