Firefox/Projects/browser ballot mechanical turk

From MozillaWiki
Jump to: navigation, search

Background

To compliment the testing and research done by Critical in Europe, a series of Mechanical Turk tests will be conducted to test various aspects of the EC's Ballot design. The goal is to determine both how to design the ballot in the most neutral way possible, and for Mozilla to determine the most successful summary and image for the Firefox section of the ballot.

Series One: Comparing Slogans and Designs

Test 1: Comparing Firefox Banners

This simple 6-question test asked about people's reactions to the top Firefox logos. 40 people participated.

Questions asked

  1. Which of the following five versions drew your attention first?
    Five options ec ballot proposal.png
  2. Why did that version draw your attention first? (freeform)
  3. Which of the following five versions do you prefer?
    Five options ec ballot proposal.png
  4. Why do you prefer this version? (freeform)
  5. Which browser do you use most often?
    • Internet Explorer
    • Firefox
    • Safari
    • Opera
    • Other
  6. Why do you use this browser? (freeform)

Results

Raw results in Google Doc Spreadsheet

Test 1 Question 1: Which drew your attention first?

Frequency Percentage
Design1 ecballot thumb.png 19 47.5%
Design2 ecballot thumb.png 6 15%
Design3 ecballot thumb.png 0 0%
Design4 ecballot thumb.png 8 20%
Design5 ecballot thumb.png 7 17.50%

T1q1 ecmechturk.png

Test 1 Question 3: Which do you prefer?

Frequency Percentage
Design1 ecballot thumb.png 14 35.90%
Design2 ecballot thumb.png 5 12.82%
Design3 ecballot thumb.png 1 2.56%
Design4 ecballot thumb.png 13 33.33%
Design5 ecballot thumb.png 6 15.38%

T1q3 mechturk.png

Series Two: Comparing Slogans Individually

In five separate tests, a complete ballot was presented similar to the one that Microsoft proposed. On each, a different Firefox slogan was displayed. Each test contained the following four items, presented to each of 40 users:

Questions Asked

Imagine you just bought a new computer running Microsoft Windows 7. You turn it on, and you see the following screen. Please read the description of each browser carefully, and then answer the following questions.

Phrase1 for ec ballotscreen sample.png
Test 1: Ballot reading "Your online security is Firefox's top priority. It's built by the Mozilla Foundation to make browsing better."
Test 2: Ballot reading "Firefox adapts to how you use the Web. Find out why more people have downloaded it than any other browser."
Test 3: Firefox is free and made to help you get the most out of the Web. Find out why more people have downloaded it than any other browser."
Test 4: More people have downloaded Firefox than any other browser. Find out why!"
Test 5: Ballot reading "Built by the Mozilla Foundation to make the Web better, Firefox won't take over your computer or compromise your privacy."
  1. Which item on this screen would you choose?
    • Install Safari
    • Install Google Chrome
    • Install Microsoft Internet Explorer
    • Install Firefox
    • Install Opera
    • Select Later
  2. Why would you choose this item? (freeform)
  3. Which browser do you currently use most often?
    • Safari
    • Google Chrome
    • Microsoft Internet Explorer
    • Firefox
    • Opera
    • Other
  4. Why do you use this browser? (freeform)

Results

Raw results in Google Doc Spreadsheet


Test 2 Question 1: Which is most convincing?

Frequency Percentage
Your online security is Firefox's top priority. It's built by the Mozilla Foundation to make browsing better. 8 20%
Firefox adapts to how you use the Web. Find out why more people have downloaded it than any other browser. 13 32.5%
Firefox is free and made to help you get the most out of the Web. Find out why more people have downloaded it than any other browser. 7 17.5%
More people have downloaded Firefox than any other browser. Find out why! 7 17.5%
Built by the Mozilla Foundation to make the Web better, Firefox won't take over your computer or compromise your privacy. 5 12.50%

Test2q1mechtest1.png

Series Three: Comparing Logo Designs Individually

In five separate tests, a complete ballot was presented similar to the one that Microsoft proposed. On each, a different Firefox logo design was displayed. Each test contained the following four items, presented to each of 40 users.

Questions Asked

Imagine you just bought a new computer running Microsoft Windows 7. You turn it on, and you see the following screen. Please study each item on the ballot carefully, and then answer the following questions.

Fivetests logos for ec balloy series3.png

  1. Which item on this screen would you choose?
    • Install Safari
    • Install Google Chrome
    • Install Microsoft Internet Explorer
    • Install Firefox
    • Install Opera
    • Select Later
  2. Why would you choose this item? (freeform)
  3. Which browser do you currently use most often?
    • Safari
    • Google Chrome
    • Microsoft Internet Explorer
    • Firefox
    • Opera
    • Other
  4. Why do you use this browser? (freeform)

Results

Design 1

Design1 ecballot thumb.png

Design 1, Question 1: Which item on this screen would you choose?

Frequency Percentage
Safari 1 2.5%
Chrome 13 32.5%
Internet Explorer 8 20%
Firefox 14 35%
Opera 4 10%
Choose Later 0 0%


Design 1, Question 3: Which browser do you currently use most often?

Frequency Percentage
Safari 1 2.56%
Chrome 8 20.51%
Internet Explorer 10 25.64%
Firefox 18 46.15%
Opera 2 5.13%
Other 0 0%
Design 2

Design2 ecballot thumb.png

Design 2, Question 1: Which item on this screen would you choose?

Frequency Percentage
Safari 1 2.5%
Chrome 10 25%
Internet Explorer 8 20%
Firefox 18 45%
Opera 3 7.5%
Choose Later 0 0%


Design 2, Question 3: Which browser do you currently use most often?

Frequency Percentage
Safari 0 0%
Chrome 9 22.5%
Internet Explorer 10 25%
Firefox 19 47.5%
Opera 2 5%
Other 0 0%


Design 3

Design3 ecballot thumb.png

Design 3, Question 1: Which item on this screen would you choose?

Frequency Percentage
Safari 3 7.5%
Chrome 11 27.5%
Internet Explorer 5 12.5%
Firefox 16 40%
Opera 5 12.5%
Choose Later 0 0%


Design 1, Question 3: Which browser do you currently use most often?

Frequency Percentage
Safari 1 2.5%
Chrome 10 25%
Internet Explorer 5 12.5%
Firefox 21 52.5%
Opera 3 7.5%
Other 0 0%
Design 4

Design4 ecballot thumb.png

Design 4, Question 1: Which item on this screen would you choose?

Frequency Percentage
Safari 2 5%
Chrome 6 15%
Internet Explorer 7 17.5%
Firefox 22 55%
Opera 3 7.5%
Choose Later 0 0%


Design 1, Question 3: Which browser do you currently use most often?

Frequency Percentage
Safari 1 2.63%
Chrome 7 18.42%
Internet Explorer 5 13.16%
Firefox 22 57.89%
Opera 3 7.89%
Other 7 0%
Design 5

Design5 ecballot thumb.png

Design 5 Question 1: Which item on this screen would you choose?

Frequency Percentage
Safari 3 7.5%
Chrome 11 27.5%
Internet Explorer 5 12.5%
Firefox 18 45%
Opera 3 7.5%
Choose Later 0 0%
Design 1, Question 3: Which browser do you currently use most often?

Frequency Percentage
Safari 1 2.5%
Chrome 11 27.5%
Internet Explorer 6 15%
Firefox 20 50%
Opera 2 5%
Other 7 0%

Series Four: Comparing Slogans Individually

In five separate tests, a complete ballot was presented similar to the one that Microsoft proposed. On each, a different Firefox slogan was displayed. Each test contained the following four items, presented to each of 40 users.

Slogans:

  1. Your online security is Firefox's top priority. It's built by the Mozilla Foundation to make browsing better.
  2. Firefox adapts to how you use the Web. Find out why more people have downloaded it than any other browser.
  3. Firefox is free and made to help you get the most out of the Web. Find out why more people have downloaded it than any other browser.
  4. More people have downloaded Firefox than any other browser. Find out why!
  5. Built by the Mozilla Foundation to make the Web better, Firefox won't take over your computer or compromise your privacy.

Questions Asked

Imagine you just bought a new computer running Microsoft Windows 7. You turn it on, and you see the following screen. Please study each item on the ballot carefully, and then answer the following questions.

  1. Which item on this screen would you choose?
    • Install Safari
    • Install Google Chrome
    • Install Microsoft Internet Explorer
    • Install Firefox
    • Install Opera
    • Select Later
  2. Why would you choose this item? (freeform)
  3. Which browser do you currently use most often?
    • Safari
    • Google Chrome
    • Microsoft Internet Explorer
    • Firefox
    • Opera
    • Other
  4. Why do you use this browser? (freeform)

Results

Slogan 1

"Your online security is Firefox's top priority. It's built by the Mozilla Foundation to make browsing better."

Slogan 1, Question 1: Which item on this screen would you choose?

Frequency Percentage
Safari 0 0%
Chrome 13 32.5%
Internet Explorer 7
 17.5%
Firefox 16 40%
Opera 3 7.5%
Choose Later 1*
 2.5%
  •  "Selecting a browser is not my first priority while using my computer for the first time."
Slogan 1, Question 3: Which browser do you currently use most often?

Frequency Percentage
Safari 0 0%
Chrome 9 23.68%
Internet Explorer 6
 15.79
Firefox 22
 57.89%
Opera 1 2.63%
Other 0 0%
Slogan 2

"Firefox adapts to how you use the Web. Find out why more people have downloaded it than any other browser."

Design 2, Question 1: Which item on this screen would you choose?

Frequency Percentage
Safari 1 2.5%
Chrome 10 25%
Internet Explorer 7 17.5%
Firefox 18 45%
Opera 3 7.5%
Choose Later 1*
 2.5%
  •  "I want moretime to chose one within these items" (IE user, says uses IE because it's "microsoft's product. microsoft is the most popular company among the it companies")
S 2, Question 3: Which browser do you currently use most often?

Frequency Percentage
Safari 0 0%
Chrome 9 24.32%
Internet Explorer 4 10.81%
Firefox 21 56.76%
Opera 3 8.11%
Other 0 0%


Slogan 3

"Firefox is free and made to help you get the most out of the Web. Find out why more people have downloaded it than any other browser."

Slogan 3, Question 1: Which item on this screen would you choose?

Frequency Percentage
Safari 0 0%
Chrome 18 45%
Internet Explorer 4 10%
Firefox 14 35%
Opera 4 10%
Choose Later 0 0%


Slogan 3, Question 3: Which browser do you currently use most often?

Frequency Percentage
Safari 0 0%
Chrome 14 35%
Internet Explorer 5 12.5%
Firefox 19 47.5%
Opera 2 5%
Other 0 0%
Slogan 4

"More people have downloaded Firefox than any other browser. Find out why!"

Slogan 4, Question 1: Which item on this screen would you choose?

Frequency Percentage
Safari 1 2.5%
Chrome 16 40%
Internet Explorer 5 12.5%
Firefox 14 35%
Opera 4 10%
Choose Later 0 0%


Slogan 1, Question 3: Which browser do you currently use most often?

Frequency Percentage
Safari 0 0%
Chrome 10 26.32%
Internet Explorer 9 23.68%
Firefox 16 42.11%
Opera 3 7.89%
Other 0 0%
Slogan 5

"Built by the Mozilla Foundation to make the Web better, Firefox won't take over your computer or compromise your privacy"

Slogan 5 Question 1: Which item on this screen would you choose?

Frequency Percentage
Safari 3 7.5%
Chrome 9 22.5%
Internet Explorer 12 30%
Firefox 9 22.5%
Opera 6 15%
Choose Later 1 2.50%
Slogan 1, Question 3: Which browser do you currently use most often?

Frequency Percentage
Safari 0 0%
Chrome 9 23.08%
Internet Explorer 12 30.77%
Firefox 14 35.9%
Opera 4 10.26%
Other 0 0%

Ballot Designs

(moved to page under LDAP

Current Report

Can be downloaded here (pdf).

Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox/Projects/browser_ballot_mechanical_turk&oldid=193905"