QA/Fenix/TopSites
Contents
Firefox Preview Top Sites Test Plan
- QA Contact: Mirabela Lobontiu-Roman; Oana Horvath; SV QA team
- Slack: Mira; Oana;
- TestRail test plan: Testrail
- Testrail Testrail - on 10/4 Nightly build with Xiaomi Mi 8 Lite (Android 9)
- Test Plan TestPlan - on 01/20, and 01/21 Nightly builds, with Google Pixel (Android 10), and Sony Xperia Z2 (Android 6.0.1)
Mobile Testing
The Softvision Mobile QA team will be testing the top mobile sites on Firefox Preview, a list of prioritized locales and reporting bugs as they find them. We made a plan to approach this request:
- QA will research a list with the most common sites from the US, Europe (UK, Germany, France), India, China, Hong Kong, Russia.
- QA will write the tests after the research.
- QA will classify the sites in some criteria: social media sites, e-commerce sites, news sites, media playback sites.
- QA will check some sites daily, as much as time permits, until all sites are covered.
- QA will do a regression check after each GV update on each website.
- QA will check Alexa's 50 top sites monthly and see if there are rank modifications or new pages introduced (the tests will be updated).
- QA will file bugs, then verify fixed bugs, when necessary.
Test Plan
In general, we want to test a site in the most useful ways it can be tested, beyond looking at the home page, i.e., play and pause video, create an account and log in, add and remove an item to/from a cart, open a menu and select items, upvote a post, etc. The plan is to start exploratory testing with the US locale and make notes of what is and isn't useful (or possible) to test. From that, we'll create a test plan of the remaining locales based on the types of sites and their related common interactions.
NSFW Content
Some sites tested may be adult or pornographic in nature. If bugs are encountered in these types of sites, screenshots should either not be included in the bug reports, or have the Not-Safe-For-Work portions blurred out before uploading.
Locales
We will start with the following locales, the top 50 pages (global) from Alexa. Each locale should link to a query to bring up reported bugs, a link to the tested URLs, and have a summary once it has been tested.
Global top 50 sites
- Google.com
- Youtube.com
- Facebook.com
- Baidu.com
- Wikipedia.org
- Qq.com
- Yahoo.com
- Amazon.com
- Taobao.com
- Tmall.com
- Reddit.com
- Sohu.com
- Live.com
- Vk.com
- Twitter.com
- Instagram.com
- Jd.com
- Sina.com.cn
- Yandex.ru
- Weibo.com
- Login.tmall.com - error 404
- 360.cn
- Blogspot.com
- Netflix.com
- Csdn.net
- Bilibili.com
- Pornhub.com
- Linkedin.com
- Twitch.tv
- Bing.com
- Yahoo.co.jp
- Livejasmin.com
- Alipay.com
- Mail.ru
- Microsoft.com
- Aliexpress.com
- Naver.com
- Pages.tmall.com (error)
- Ebay.com
- Whatsapp.com
- Microsoftonline.com (error)
- Tribunnews.com
- Okezone.com
- Google.co.in
- Office.com
- Amazon.co.jp
- Google.com.hk
- Xvideos.com
- Hao123.com
- Stackoverflow.com
Besides the top global 50 sites, will test the next 10 Top Sites from Alexa's country categories.
US
- Chase.com
- Craigslist.org
- Imgur.com
- Paypal.com
- Force.com
- Espn.com
- Cnn.com
- Fandom.com
- Imdb.com
- Walmart.com
UK
- Amazon.co.uk
- Google.co.uk
- Bbc.co.uk
- Ebay.co.uk
- Ladbible.com
- Theguardian.com
- Www.gov.uk
- Daily.co.uk
- Xhamster.com
- Itv.com
Germany
- Google.de
- Amazon.de
- Ebay.de
- Ebay-kleinanzeigen.de
- Web.de
- Gmx.net
- Ok.ru
- T-online.de
- Spiegel.de
- Bild.de
France
- Google.fr
- Amazon.fr
- Leboncoin.fr
- Orange.fr
- Free.fr
- Cdiscount.com
- Labanquepostale.fr
- Ebay.fr
- Lefigaro.fr
- Pole-emploi.fr
India
- Google.co.in
- Amazon.in
- Hotstar.com
- Onlinesbi.com
- Flipkart.com
- Cricbuzz.com
- Indiatimes.com
- Sarkariresult.com
- Hdfcbank.com
- Irctc.co.in
China
- Google.com.hk
- 163.com (error)
- Soso.com
- Zhihu.com
- Detail.tmall.com (error 404)
- Cnblogs.com
- So.com
- Xinhuanet.com
- Google.cn
- Douban.com
Hong Kong
- Discuss.com.hk
- Pixnet.net
- Bastillepost.com
- Aastocks.com
- Hkgolden.com
- Etnet.com.hk
- Appledaily.com
- Lihkg.com
- Price.com.hk
- Dcfever.com
Russia
- Avito.ru
- Google.ru
- Gismeteo.ru
- Kinopoisk.ru
- Sberbank.ru
- Rambler.ru
- Gosuslugi.ru
- Drom.ru
- Userapi.com
- Wildberries.ru
Results
Top Sites testing results:
- New issues found
- 4920 - [Bug] Leaving https://m.jd.com/ in background freezes the page - ✅ Not reproducible, closed
- 4921 - [Bug] Selecting an item on m.aliexpres.com is not working - ✅ Verified
- 4922 - [Bug] Cannot sign in on ebay.com via Google account or Facebook - ✅ Not reproducible, closed
- 4939 - [Bug] Sign-in with social media buttons don't work on avito.ru - ✅ Not reproducible, closed
- 4941 - [Bug] Some buttons from yahoo.com don't work - ✅ Not reproducible, closed
- 4943 - [Bug] Cannot share articles from some news sites via social media icons - ✅ Verified
- 4945 - [Bug] Tapping on an article on espn.com reloads the page ignoring the selected article - ✅ Verified
- 4984 - [Bug] Cannot share link from reddit.com - Moved to TP list. Closed
- New issues 07.10.2019
- 5812 - [Bug] The thumbnails from twitch.tv change when scrolling - Not reproducible, closed
- New issue found 21.01.2020
- 7809 - [Bug] Unknown protocol page displayed when accessing an article from zhihu.com - Not reproducible, closed