Page MenuHomeLubuntu Development

Testing Checklist
Updated 61 Days AgoPublic

This is a testing checklist which must be complete prior to marking a final release is ready. It should be deprecated with T56: Transfer testcases to the actual testcase branch.


Installer tests - 23.10 (Mantic Minotaur)

Release date: - 12 October 2023
Final Freeze: - 5 October 2023
Beta release: - 21 September 2023
RC reached at: - 9 October 2023

IMPORTANT: All of these tests must be re-done if an upload of Calamares or settings is done after a pre-release freeze.
  • calamares: 3.3.0-alpha2-0ubuntu6 at 20231009
  • calamares-settings-lubuntu 1:23.10.4 at 20231009
  • calamares-settings-ubuntu-common 1:23.10.4 at 20231009
  • lubuntu-default-settings: 23.10.4 at 20231009
  • casper 1.486 (casper changed from 1.482 to 1.484 on 20231001, 1.486 appeared 20231003)
NOTE: Currently updated for the jammy media [20231009] with proposed packages included http://iso.qa.ubuntu.com/qatracker/milestones/448/builds

Ubuntu Release tracking document - https://discourse.ubuntu.com/t/mantic-minotaur-23-10-release-status-tracking/37887
Ubuntu Release Schedule - https://discourse.ubuntu.com/t/mantic-minotaur-release-schedule/34989

Full disk install tests

TypeEncryptionFirmwareInternetSwap (Y/N)Completed DateTesterISOpc.detailpaste.for.tracker
Full disk installnoBIOSyesy20231009@Leok20231009len_yg_sl7testcase: full disk, no-encryption, BIOS, internet, swap
Full disk installyesBIOSyesn20231009@guiverc20231009hp_dc7700testcase: full disk, encryption, BIOS, internet, no-swap
Full disk installnoBIOSnoy20231010@guiverc20231010hp_dc7700testcase: full disk, no-encryption, BIOS, no-internet, swap
Full disk installyesBIOSnon20231010@guiverc20231010hp_dc7700testcase: full disk, encryption, BIOS, no-internet, no-swap
Full disk installnoEFIyesy20231010@guiverc20231010svp11216cgbtestcase: full disk, no-encryption, EFI, internet, swap
Full disk installyesEFIyesy20231009@guiverc20231005svp11216cgbtestcase: full disk, encryption, EFI, internet, swap
Full disk installnoEFInon20230921@Leok20230919dell_lat_7280testcase: full disk, no-encryption, EFI, no-internet, no-swap
Full disk installyesEFInon20231003@guiverc20231002svp11216cgbtestcase: full disk, encryption, EFI, no-internet, no-swap
Full disk installnoEFI + secure bootyesy20231011@Leok20231010awow_ny41testcase: full disk, no-encryption, secure-EFI, internet, swap
Full disk installyesEFI + secure bootyesn20231011@Leok20231010dell_lat_7280testcase: full disk, encryption, secure-EFI, internet,swap
Full disk installnoEFI + secure bootnoy20231011@Leok20231010dell_opt_7060testcase: full disk, no-encryption, secure-EFI, no-internet, swap
Full disk installyesEFI + secure bootnon20231011@Leok20231010awow_ny41testcase: full disk, encryption, secure-EFI, no-internet, no-swap

Please try and ensure one of SWAP (Y) & NO-SWAP (N) exist for each test type (ie. BIOS, uEFI or Secure-uEFI) for releases of hirsute or later.

Other install types

TypeCompleted DateTesterISOpc.detailpaste.for.tracker
Install alongside20231005@guiverc20231004hp_dc7700testcase: install alongside
Replace partition20231003@guiverc20231002hp_dc7700testcase: replace partition
Install using existing partition20231009@guiverc20231009dell_opt_780testcase: install using existing partition
Custom partitioning with separate /home20231003@guiverc20231002hp_dc7700testcase: custom partitioning with separate /home
Custom partitioning on btrfs20231005@guiverc20231004vb_dell_opt_7050testcase: btrfs install
Custom partitioning on xfs20231005@guiverc20231004vb_dell_opt_7050testcase: xfs install
Install using another language20231009@Leok20231009len_YG_Sl7
Auto-login after install20231010@guiverc20231010hp_dc7700

The install using another language, and/or auto-login can be combined with another install, ie. a single QA-test can be used to refresh the details of up to two lines on this checklist (eg. auto-install or install with another language)

Additional testcases

Test InformationCompleted DateTesterpc.detail
GUI upgrade¹ from prior release20231006@guivercvm_dell_opt_7050
TUI upgrade² from prior release20230921@Leokdell_opt_7060
GUI upgrade¹ from LTS to next LTS releasenanana
TUI upgrade² from LTS to next LTS releasenanana
minimal install³not applicable

¹do-release-upgrade -d -m desktop -f DistUpgradeViewKDE
²do-release-upgrade -d
³ Currently not implemented

  • The purpose of the "Optional box" field is to allow re-tests to be done on a different box to prior time (if possible)
  • na is short for not-applicable

To help understanding some of these testcases, the following link maybe helpful - https://discourse.lubuntu.me/t/testing-checklist-understanding-the-testcases/2743

Last Author
Leok
Last Edited
Oct 11 2023, 8:24 AM

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
kc2bez edited the content of this document. (Show Details)
guiverc edited the content of this document. (Show Details)
guiverc edited the content of this document. (Show Details)
guiverc published a new version of this document.
Leok published a new version of this document.
Leok published a new version of this document.
guiverc edited the content of this document. (Show Details)
guiverc published a new version of this document.
Leok published a new version of this document.
Leok published a new version of this document.
Leok published a new version of this document.
Leok published a new version of this document.
Leok published a new version of this document.
guiverc edited the content of this document. (Show Details)
guiverc published a new version of this document.
Leok published a new version of this document.
Leok published a new version of this document.
guiverc edited the content of this document. (Show Details)
Leok published a new version of this document.
guiverc edited the content of this document. (Show Details)
Leok published a new version of this document.
guiverc published a new version of this document.Oct 11 2023, 5:08 AM
Leok published a new version of this document.