How would you test this? – Take II
This is my solution to Mat Heusser’s How would you test this? – Take II
Strategy:
For the first pass of testing, I would use a form of session based test management to create a set of charters or themes that the testing can be grouped into. Each theme is allocated some amount of time for exploration. This time allocation is important for risk management. If nothing interesting is happening in the allocated time box, it may be best that the tester either reevaluate his/her strategy or move on to the next charter. The themes include a set of test ideas that may be important to look at. The test ideas are a guide though, not a strict test plan. If something interesting and important is happening the tester should pursue that path.
Things that can be easily validated by a computer (the state of a button at some point in time for example) could be automated given the time. This would benefit future regression testing efforts as well as facilitate testing on other supported browsers to some extent.
Charter:
Explore functionality of the filters on the Activity widget.
Some important things to note are:
performance on filtering large sets of data
correct behavior when filtering with multiple filter criteria
Duration:
1 hour (assuming there is already data existing to facilitate testing)
Notes:
- Current known filters and assumptions are:
- Post Signals To
- Defaults if only one is available
- Showing
- From
- People I follow not present if I am not following anyone
- Within
- Defaults if I am only in one network
- Caching of selections?
- If user leaves widget do previous configured filters remain?
- A few things to test
- Single selection of filters
- Multi selection of filters on single filter (‘showing’ filter for example) and then on multiple filters at time. Basically test one, some and all.
Charter:
Explore around the theme of posting to the Activities widget from the post box as well as auto posting from page updates.
Some questions:
Is this application I18N compliant? Do characters display the same in the post widget and in the posted activities area?
Are dates and numbers correctly formatted?
Duration:
2 hours
Notes:
- Manual posting from activities widget
- Auto-post from page edit
- Post date / time stamp
- Date time stamp based on user locale or server time?
- Date / time stamp formatting?
- When does date / time stamp switch from minutes to hours / day / date stamp?
- Char count decrements when char is entered (whitespace counts)
- Special and multi-byte characters display consistently in post field and
- Post to appropriate audience based on ‘Post Signals to’ selection
- Can post to one or more network? (multi-select in Post Signals to?)
- Expand / collapse signal post pane
Charter:
Explore the theme of functionality around posts that exist within the Activities widget.
Duration:
2 hours
Notes:
- Online notification
- Reply
- Direct message
- Delete
- Auto-post from page edit
- What happens when I delete a message (or auto-update) I posted?
- Other users screen refresh to remove post?
- How frequently does polling occur for the online notification icon to go on / off
- Reply shows at top of list when posted?
- Private message does not appear in thread
- Insert account link: link can be clicked to nav to account when in thread or in post field
- Auto-posts have pencil icon (to indicate they are associated with a page edit)
- Auto-post do not have:
- Auto-post has link to edited page
- Auto-post is posted by user ‘auto builder’
Charter:
How does pagination work on the activities widget when there is 0, 1 and more than one page of posts? How does the appearance of new posts effect pagination?
Duration:
1 hour
Notes:
- Newer
- Newest
- Older
- If only one page of posts is available, nav is disabled
- If I am on page 1, Newest and Newer are disabled
- If I am on last page, Older is disabled
- older moves to previous page
- newer moves to next page
- how does auto refresh work with pagination?
- Example: I am on page 2, new messages are posted such that messages on page 1 now belong on page 2. does the page I am on refresh?
Charter:
RSS feed
Duration:
1 hour
Notes:
- Update frequency
- reader compatibility (Google reader is most important)
- filter config in activity widget apply to feed
- RSS 1.0, 2.0, ATOM compliant
Charter:
Activity Widget tool menu (monkey wrench icon)
Duration:
30 min
Notes:
- Activities viewed / page (5,10,15,20,25)