QA/Fennec/Fennec Bookmark Management
From MozillaWiki
Overview
Purpose
The purpose of this wiki is to serve as a general test plan for verifying that Bookmark management is supported by Fennec and works correctly
Ownership
Developer contact: [1]
Overall Status
[LANDED] Nightly 58
[LANDED] Beta 58
Testing Summary
Scope of testing
The testing will be focus on
- Verifying that folders can be moved/removed/renamed
- Verifying that can add a new folder
- Verifying that a bookmark can be added
- Verifying that a bookmark can be edited/moved/renamed
Environments
Testing will be performed on following devices:
- Phones
- 4.x
- 5.x
- 6.0
- 7.1
- Tablet
- 4.x
- 5.x
- 6.0
- 7.0
Specifications
User stories
- As a user, I want to create, remove and move folders
- As a user, I want to create folders within folders to help me manage my bookmarks
- As a user, I want to to be able to move both bookmarks and folders into folders
- As a user, I want to delete multiple folders and bookmarks at once
- As a user, I want to move multiple bookmarks and folders from within 1 folder to 1 other folder
- As a user, I want to move the order of a bookmark within a folder (one at a time)
- As a user, I want that bookmark changes that I made on my Firefox for android to be reflected on my other Firefox Sync enabled devices
- As a user, I want that bookmark menu to be easy to use
Acceptance Criteria
Testing details
Test Cases
- Testrail Test Case - in progress
- https://docs.google.com/spreadsheets/d/1eC87FAjPrJCZeVtbdiVXLa1HovSxoTy45KopfFQXcD0/edit#gid=0
Testing days
Date:2017-03-24
- Created Test Plan
Date:2017-04-18
- Draft 1 for Test Cases
Date:2017-06-19
- Feature under Switchboard Experiment: install add-on, and in about:experiments enable full-bookmark-management
- Exploratory testing on latest Nightly (55.0a1-2017/06/19) with Huawei MediaPad M2 (Android 5.1.1)
- New bugs found during testing:
- bug 1374273 - Fennec Bookmark Management: Folders added before sync are not displayed
- bug 1374264 - Fennec Bookmark Management: Folder order incorrect if no sync is performed
- bug 1374251 - Fennec Bookmark Management: Name of folder not saved when parent folder is changed as well
Date:2017-07-05
- Exploratory testing on latest Nightly (56.0a1-2017/07/04) with Huawei MediaPad M2 (Android 5.1.1), LG G4 (Android 6.0)
- Finished Test Cases
- New bugs found during testing:
- bug 1378335 - Fennec Bookmark Management: Keyboard not displayed when adding a new folder
- bug 1378336 - Fennec Bookmark Management: Reading List folder displayed between bookmark folders
- Verified bugs:
- bug 1329128 - Fennec Bookmark Management: Allow users to create, remove and move folders
Date:2017-07-14
- Exploratory testing and Test Cases on latest Nightly (56.0a1-2017/07/13) with Asus ZenPad 8 (Android 6.0.1), Motorola Nexus 6 (Android 7.0), Huawei Honor (Android 5.1.1)
- New bugs found during testing:
- bug 1381001 - Fennec Bookmark Management: folders removed are still displayed after sync
- bug 1380983 - Fennec Bookmark Management: wrong name displayed when editing folders
- bug 1380987 - Fennec Bookmark Management: "save" button enabled when no string is displayed in field
- bug 1380998 - Fennec Bookmark Management: sync after editing folders doesn't display the new name
- Testrail: https://testrail.stage.mozaws.net/index.php?/runs/view/5081&group_by=cases:section_id&group_order=asc&group_id=4463
Date:2017-07-28
- Pre-Beta SignOff: YELLOW
Date:2017-10-23
- Ran full suite of test cases with Motorola Nexus 6 (Android 7.1.1), Google Pixel (Android 8.0), Sony Xperia Z5 Premium (Android 6.0.1) on build 58.0a1
- https://testrail.stage.mozaws.net/index.php?/runs/view/6763&group_by=cases:section_id&group_order=asc&group_id=8532
- https://testrail.stage.mozaws.net/index.php?/runs/view/6752&group_by=cases:section_id&group_order=asc&group_id=8483
- https://testrail.stage.mozaws.net/index.php?/runs/view/6753&group_by=cases:section_id&group_order=asc&group_id=8578
- No new issues found during testing, only the existing ones
- Verified bug 1329131 - Fennec Bookmark Management: Allow users to move bookmarks and folders into folders
Date:2017-10-30
- Pre Beta SignOff Green: https://testrail.stage.mozaws.net/index.php?/reports/view/674
Date:2017-11-16
- Ported test to BFTs suite
- Ran full suite of test with Nexus 5 (Android 6.0.1) and Google Pixel (Android 8.0) on 58 Beta 3
- New bug 1417918 - Folder Bookmark Management: Keyword not saved when parent folder is changed as well
Date:2017-11-27
- Ran full suite of test and exploratory with Nexus 5 (Android 6.0.1), Honor 8 (Android 7.0) and Huawei MediaPad M2 (Android 5.1.1) on 58 Beta 5
- Verified bug 1417918 - Folder Bookmark Management: Keyword not saved when parent folder is changed as well
- Still important issues:
- bug 1270535 - Add "undo" action in snackbar when bookmark is edited or removed
- bug 1378336 - Fennec Bookmark Management: Reading List folder displayed between bookmark folders
- bug 1374264 - Fennec Bookmark Management: Folder order incorrect if no sync/sync is performed
Date:2017-12-29
- Ran full suite of test and exploratory on latest Beta build
- Pre-Release SignOff Green: https://testrail.stage.mozaws.net/index.php?/reports/view/746
Date:2018-02-01
- Ran full suite of test and exploratory on 59 Beta build, Nightly 60.0a1 with Google pixel (Android 8.0), Samsung S8(Android 7.0), Nexus 6 (Android 6.0.1)
Bug Work
- Meta bug
- bug 1329127 - [META] Fennec Bookmark Management
35 Total; 0 Open (0%); 26 Resolved (74.29%); 9 Verified (25.71%);
Bug fixed
Signoff
Criteria
- All test cases should be executed
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
- feature is being tested
- there are still issues opened but the user is able to make/move/delete folders and change locations for bookmarks
Beta testing
- feature is being tested
- there are still issues opened but the user is able to make/move/delete folders and change locations for bookmarks
