Evaluation of Learning Material in MERLOT

Evaluation Criteria for: Software QA and Testing Resource Center
URL: Software QA and Testing Resource Center

Quality of Content:
1. Does the software present valid (correct) concepts, models, and skills?
Yes. The material covers background information and advice related to the testing of computer software. Embedded links provide additional sources of information on the sub topics covered. Although the site was started in 1996, it continually is verified and updated (2011 was year for last check/updates).

2. Does the software present educationally significant concepts, models, and skills for the discipline?
It does. Whether the student is new to software testing or has prior experience, this site provides information based on the complete software development process and methodology, from the initial design through the test approval. Complex ideas are further explored through the use of links to other locations in this website, and a few other Internet websites.

Potential Effectiveness as a Teaching-Learning Tool:
1. What stage(s) in the learning process/cycle could the materials be used? Can be used by people familiar at some level with the concept of software testing. Best used by those that have testing experience or background, especially those looking to expand on their testing strategy and perform other types of testing to improve the quality of their software.

a. Explanation or description of the topic/stating the problem
There is not a high level explanation of the topic; the website provides a series of pages that are mostly FAQs that can be searched and reviewed.

b. Demonstration of the curriculum/exploration of the problem
This site is composed mainly of text and hyperlinks. Explanations of cause and effect are included, but they aren’t supported with images or in-depth demonstrations.

c. Practice using the curriculum/analysis of the outcomes from solving the problem
Suggestions for ways to proceed are provided, but not any focused practice activities.

d. Applying the curriculum to "new" problems/application of the outcomes to other problems
Material does an adequate job of linking potential problems/issues to possible solutions, involving expanding on the current testing process, or adding new features to it.

2. What is(are) the learning objective(s)? What should students be able to do after successfully learning with the materials? Objective is to expand on the knowledge of testing, common approaches, issues that might occur and ways to mitigate the issues (including where to concentrate efforts before the software is ready to be tested).

3. What are the characteristics of the target learner(s)
Focuses on a couple of learning groups: those that have minimal (or no) testing experience, or are looking to implement an initial test plan/strategy, and (2) areas looking to develop permanent test teams or expand on the scope and type(s) of software testing.

4. Does the interactive/media-rich presentation of material improve faculty and students' abilities to teach and learn the materials?
This site does not offer interactive presentation of its material, which is a main negative aspect.

5. Can the use of the software be readily integrated into current curriculum and pedagogy within the discipline?
The information provides insight on how to improve software development and quality along the entire development path from design, coding, testing and then release/implementation.

6. Can the software be used in a variety of ways to achieve teaching and learning goals?
Not directly from the website as it exists today; there are plenty of questions and issues listed along with suggestions on ways to proceed. But to improve as a teaching/learning site it needs to be revised to be interactive and feature Web 2.0 features.

7. Are the teaching-learning goals easy to identify?
Yes, although they are very basic. A series of different web pages devoted to FAQs around central processes and possible issues.

8. Can good learning assignments for using the software application be written easily?
Would need to make the site more interactive from a learner’s perspective, and include graphics, interactive content and quizzing on main topics. The information is thee, but the delivery of it would need some major updates.

Ease of Use:
1. Are the labels, buttons, menus, text, and general layout of the computer interface consistent and visually distinct?
Interface is consistent but does not generally feature any visual navigation tools other than hyperlinks and tabs that can be clicked on.

2. Does the user get trapped in the material?
I did not find myself getting trapped within the material; some pages feature similar explanations but they generally reference each other so the learner can obtain more information if they desire to.

3. Can the user get lost easily in the material?
This depends on the background and technical experiences of the user. A beginner would need to skim through the content/questions looking for what they want more information on. Experienced testers or those with a good technical background will find very good information presented in a way that mimics the general flow of software design. There are a lot links to supporting information, which could cause some users to be overwhelmed in the amount of information provided.

4. Does the module provide feedback about the system status and the user's responses?
No; lacks interactivity with learner, which is a drawback.

5. Does the module provide appropriate flexibility in its use?
Yes, the pages and questions are divided into logical sections, and as new testing technology and ideals are introduced they have been added to this site.

6. Does the learning material require a lot of documentation, technical support, and/or instruction for most students to successfully use the software?
This depends in some extent to the learner’s background and experiences. Newer learners to software testing would likely want to read portions they are most interested in, then explore them more in person before returning back to the site to learn about additional topics.

7. Does the material present information in ways that are familiar for students?
Yes; I think most students have seen and worked with FAQs and web page links.

8. Does the material present information in ways that would be attractive to students?
The information is solid and while it appears it is based on the author’s opinions, they are back by his personal experiences and skills related to software and testing. Also includes links to other publications regarding specific areas/approaches to testing.