Quality Assurance Plan and Report OurWedding.com Website   July 11, 2006         Prepared for: Our Wedding.com 1234 Main Street Anywhere, MI 48104   Prepared by: INP Associates Karen Dec, Karen Ford, Robert Scully, and Chris Visel 1234 Main Street Ann Arbor, MI 48104

 

Table of Contents

            Project Objective                                                                                             3

Objectives of QA Testing                                                                                3

 

Testing Objectives Against Requirements                                                      3

            What Is Included In This Testing                                                        3

            What Is Not Included In This Testing                                      3

 

Resources                                                                                                      4

            People/Testers                                                                                   4

            Equipment                                                                                           4

            Test Browser Compatibility                                                                 4

            System Requirements To Note                                                          4

 

QA Testing Methods                                                                                      5

 

QA Testing Results                                                                                         5

            User Testing                                                                                       5

            Problem Tracking and Response                                                      7

 

Appendix                                                                                                         11

            Problem Tracking Response/Resolution Forms                               11

            User Test Card Sort Results                                                              14

 

Project Objective

The objective of this project is to build a website that can assist brides and grooms in planning their wedding day. The site will offer a variety of user tools, such as a Budget Tracker, interactive Planning Checklist, and Guest List manager, to name a few. The site will also offer the ability to search for local vendors and venues and read/write reviews about their services Finally, the site will offer a “wedding shop” (ecommerce) section as well.

 

 

Objectives of QA Testing

In this phase of testing, we are focusing on 19 pages of the OurWedding.com site. These will include two variations of the home page (depending on whether the user is logged in or not), the login page, 6 pages related to the interactive planning checklist, 8 pages related to the vendor/venue search and review functions, and 2 pages related to the submit a vendor function. The Quality Assurance testing process, plan and reporting will meet the following objectives:

 

·       To report, document, and verify code and design defects

·       To assure the quality of our deliverables (valid code, working links, etc.)

·       To confirm that our deliverables display properly in all target browsers.

·       To show that potential users of the site are able to navigate and performs tasks adequately.

 

Testing Objectives Against Requirements

What is included in this testing?

We will test:

·       Links for accuracy

·       Browser compatibility

·       Forms

·       Content

·       Accessibility

·       Validation

What is not included in this testing?

This phase will not fully test all aspects of functionality, as back-end programming has not been completed. We will only be testing links and basic appearance/accessibility of form inputs.

 

This phase will also not include any performance or load testing. Performance testing will be completed in the next phase after all of the optimized images have been added. Load testing will occur after the site has been move to a permanent server for hosting.

 

Resources

People/Testers

The QA group at INP Associates will administer the testing. The efforts will be overseen by our Project Manager. Names and contact information follow.

 

Name	Phone	Email
Karen Dec, Project Manager	734-123-4567	kdec@inpassociates.com
Karen Ford, Content Editor/Coder	734-890-1234	kford@inpassociates.com
Robert Scully, Coder	734-567-8901	rscully@inpassociates.com
Chris Visel, Information Architect	734-234-5678	cvisel@inpassociates.com

 

Equipment

We will use the following hardware and software for our testing:

 

·       Web Developer Toolbar

o       Links

o       CSS Validation (W3C)

o       Code Validation to DTD for XHTML v 1.0 Transitional (W3C)

Test browser compatibility *

·       Internet Explorer 6.x (Windows)

·       Internet Explorer 5.2 (Mac)

·       Netscape 7.x (Windows and Mac)

·       Firefox 1.x (Windows and Mac)

·       Mozilla 1.x (Windows and Mac)

·       Safari 2.x (Mac)

·       Opera 7.x (Windows and Mac)

·       * NOTE: javascript must be enabled in your browser.

System Requirements to Note

Operating System:

·       Windows 95/98/Millenium/XP/NT

·       Mac 9.x or Mac OS X

·       Linux

Other System Attributes

·       Screen resolution of 800 x 600 or higher

·       Video card with at least 32 bit color support (also known at Millions of Colors)

Additional Software:

 

·       Adobe Acrobat Reader required to view .pdf documents

·       Free download of Adobe Acrobat Reader can be found at http://www.adobe.com

·       Macromedia Flash recommended for certain content areas

 

QA Testing Methods

Software testing verifies that the software meets its requirements and that it is complete and ready for delivery. Following are the types of test methods included, along with an explanation:

·       Unit Testing – completed “as you go”; coders review and fix problems as they are coding.

·       Validation Testing – uses an online validator (such as W3C) to test code against DTD standards

·       Compatibility Testing – testing the site on different browsers using different platforms (see above for complete list)

·       Regression Testing – going back and re-testing requested and applied fixes from problem reporting

·       Usability Testing – performing card sorts, cognitive walk-throughs, and other types of testing with site users

 

Content Issues to Test and Known Issues

·       Test Links

·       Check alignment and margins of content areas, and spacing of content text.

·       Check for consistency of language used throughout site (i.e. “feedback” vs. “review”)

 

QA Testing Results

                  User Testing

 

Six (6) users each performed a card sort using Our Wedding.com’s global navigation and sub-navigation. Users were given the global navigation categories and then they were asked to sort the sub-navigation labels into whichever global areas they felt made sense. Specific results of each card sort are included in the Appendix. As a result of the card sorting, several labeling changes were made to the site, including:

                  -Spelling out “Do It Yourself” rather than using the term “DIY”; some users did not know what “DIY” meant

                  -Changing “Flower Picker” to “Flower Finder” to clarify the purpose of this site resource

-Changing “Wedding Cake” to “Wedding Cake Advice” and “Invitations” to “Invitation Tips” so that these areas are more closely affiliated with the “Tips and Advice” section of the site, rather than the Vendor/Venue area or Wedding Shop Area.

 

Four (4) users also completed a cognitive walk-through in which they were asked to attempt a certain task on the site. Specifically, users were told that they had recently been married and were not happy with the services of the florist they had used. Starting from the Home page, users were asked to leave feedback about the florist.

 

Three of the four users chose the Forums link first, as that seemed like a logical place to “leave feedback.” When they did not find what they were looking for in Forums, most users then went to the Vendor/Venue area. However, then some users did not understand that they first needed to search for the vendor/venue about which they wanted to leave feedback. As a result of this, two users assumed they were in the wrong section and then tried “Tips and Advice” (thinking that they could give someone else advice by leaving feedback). All eventually ended up back at the vendor/venue area and figured out that they first had to search to bring up the individual vendor information, which would then give them the option to leave feedback. Overall, users were not able to handle the task as smoothly as we would have liked.

 

We decided that we were not overly concerned that “Forums” was the first place many users went to when given this task. In some ways, the task was a bit unreal because it would be unusual for a person who had not used Our Wedding.com at all in their wedding planning process to be arriving at the site cold with the goal of leaving feedback. We decided that since most users would have used Our Wedding.com for planning purposes, they would have already caught on to the fact that “Forums” was the message board area and that vendor feedback is in the Vendor/Venue area. Within the Vendor/Venue area, though, we decided to make some changes that might make it easier for users to perform the task given. These changes included:

                  -Adding some content on the main Vendor/Venue page explaining what this section of the site is/does

-Removed “Home” from the Vendor/Venue sub-navigation as some users found it confusing. Added Home to the top and bottom nav on all pages instead.

-Changed the language from “leave feedback” to “write a review” which sounds more appropriate to the task

-Most importantly, we added a “write a review” link in the Vendor/Venue sub-navigation and created a new search page specifically for the purpose of finding the vendor/venue a user wants to review.

 

 

 

 

                 

Problem Tracking and Response

 

 

Our Wedding. Com QA Tracking Checklist
Page	Tester	Issue	Details of Problem/Issue
Home (index1.html)
	KD	Link	Link to Login page is not functional
	KD	Link	Invitation Advice link goes to DIY but it
			says it goes to Tips & Advice; can we fix?
	KD	Link	Bottom nav links missing "ourwedding"
			in URL, so they bring up WCC "Page Not
			Found" page
	KD	Link	Logout link in bottom nav should say
			Login to match top
	KD	Link	I think "Our Wishlist" should just be
			"Wish List" to stay consistent with the
			Registry page
	KD	Link	"Flower Picker" needs to change to
			"Flower Finder"
	KD	Link	DIY needs to be spelled out
Home (index.html)
	KD	Link	I think "Our Wishlist" should just be
			"Wish List" (see above)
	KD	Link	"Flower Picker" needs to change to
			"Flower Finder"
	KD	Link	Invitation Advice link goes to DIY but it
			says it goes to Tips & Advice; can we fix?
	KD	Link	DIY needs to be spelled out
	KD	Link	Bottom logout link doesn't work
Our Tools
	KD	Link	Logout link in Bottom Nav not functioning
Planning Checklist
	KD	Link	Edit/Email Link for Task 8 brings up a
			full size window
	KD	Title	Page title inconsistent with rest of site
Add Task (popup)
	KD	Title	Page title has wccnet address at start?
	KD	Content	Add a box for typing a message that
			gets sent in the email?
Add Task Confirm (popup)
	KD	Title	Page title has wccnet address at start?
Edit Task (popup)
	KD	Link	Submit button does not bring up
			confirmation popup
	KD	Title	Page title has wccnet address at start?
	KD	Content	Add a box for typing a message that
			gets sent in the email?
Edit Task Confirm
	KD	No page	Page does not exist
	KD	Title	Page title has wccnet address at start?
Vendors/Venues (simple)
	KD	Form	Bakers & Florists appear 2x in drop down
	KD	Content	"phonebook" should be 2 words
	KD	Form	"Florist" should be "Florists" in drop down
Vendors/Venues (detailed)
	KD	Content	"phonebook" should be 2 words
	KD	Form	"Florist" should be "Florists" in drop down
Submit Vendor
	KD	Form	Bakers & Florists appear 2x in drop down
	KD	Form	Price drop down goes in reverse order
			from the one on Vendor Search
	KD	Title	Page has wrong title
	KD	Links	All bottom links (except Home) are
			not functioning properly
	KD	Form	"Florist" should be "Florists" in drop down
Submit Vendor Confirm
	KD	Content	Typo ("recieved" --> "received")
	KD	Content	Typo ("submision" --> "submission")
	KD	Content	Typo ("receive" --> "receive")
	KD	Title	Page has wrong title
	KD	Links	Needs Home link added Top & Bottom
	KD	Links	No bottom links are working properly
Vendor/Venue Results
	KD	Title	Page has wrong title
Ind Vendor Pages
	KD	Title	Page has wrong title
	KD	Content	2nd review, "their" --> "their"
Search Vendor to Review
	KD	Title	Page has wrong title
Submit Review
	KD	Title	Page has wrong title
Submit Review Confirm
	KD	Content	Typo ("received" --> "received")
	KD	Content	Typo ("submision" --> "submission")
	KD	Content	Need a period at the end
	KD	Title	Page has wrong title
	KD	Content	Heading "Feedback" --> "Review"
Add To Notebook
	KD	Title	Page has wrong title
Login	KD	No page	Page does not exist
	KD	Display	Make outline on the Welcome Back
			box be a darker purple so it would look
			more like the New box
Miscellaneous/General
	KD	Content	Tips & Advice "Tis" --> "Tips"
	KD	Links	Indent "For the…" links
	KD	Links	Add the top and bottom "Home" links to
			every page.
	KD	Content	flowers.html "Flower Picker" --> "Flower
			Finder"
	KD	Content	templates.html "DIY" in sub-nav needs
			to be expanded to "Do It Yourself"
	KD	Content	Title for the Help Page is wrong
	KD	Content	Title for the Logout page is wrong
	KD	Links	For the bride page: Indent the "For
			The…" links
	KD	General	When I click on a link and then go Back
			to the previous page, I am getting
			strange dotted line boxes around link
	KD	General	Odd "page jumping" btw some pages.
			Fine when you go btw Our Tools and
			Vendor/Venue but when you go to any
			other page, it jumps L-R
	KD	General	On all pages with ad space,
			"Advertisment" --> "Advertisement"

 

 

From Usability for the Web: Designing Web Sites that Work by Tom Brinck, Darren Gergle, and Scott Wood. Morgan Kaufmann Publishers, San Francisco

 

Problem Summary Report (only includes some examples from the above) Outstanding Errors (check all that apply):
	Severity of problem			Type of problem					Description
Problem Report #	Mission critical	Moderate	Minor	Cosmetic	Structural	Platform	Coding	Unknown
001	X				X				Link to Login not functioning.
050		X		X					Make heading & border on new user box darker purple.
059		X					X		Dotted border boxes popping up around links when user returns to the page.
031	X				X				All bottom links except Home are not working properly.
014	X						X		Edit/Email link for Task 8 brings up Full Size page

 

APPENDIX

Problem Report and Resolution Forms

 

 

From Usability for the Web: Designing Web Sites that Work by Tom Brinck, Darren Gergle, and Scott Wood. Morgan Kaufmann Publishers, San Francisco

 

 

 

 

 

 

 

From Usability for the Web: Designing Web Sites that Work by Tom Brinck, Darren Gergle, and Scott Wood. Morgan Kaufmann Publishers, San Francisco

 

 

 

 

 

 

 

 

 

From Usability for the Web: Designing Web Sites that Work by Tom Brinck, Darren Gergle, and Scott Wood. Morgan Kaufmann Publishers, San Francisco

 

 

 

 

User Testing Card Sort Results