CivieBlog

I’ve recently been working with Sameer Bhatia the CEO of ProProfs as I was going through an evaluation of various online tools that support easy, fast, low-cost testing and quiz tools (disclosure). He helped me pull together the following evaluation of a few different solutions:

• ClassMarker
• Quia
• ProProfs
• Google Docs Forms Creator, and
• Quibblo.

Evaluation Criteria

For the specific need I was looking at, I was looking for the following out of a solution:

• Cost: Is the tool free or very-low cost to use? Trial periods wouldn’t count.
• Question Types/Methods: Does the tool offer the ability to create a rich testing experience by offering various question types?
• Multimedia: Does the tool offer the ability to include audio and/or visuals for questions?
• Data Collection: Does the tool provide detailed statistics on individual and/or group performance?
• Grading: Does the tool allow for several methods of grading responses? (i.e. immediate feedback, final results with or without which questions were missed, etc.)
• Download Test Results? : Can the test data be retrieved for analysis or backup?
• Layout/Accessibility: Can the layout of the quiz output be changed and does it handle accessibility issues?
• Security: Are there security methods in place to catch/prevent cheating, hacking, or other similar problems?
• Ease of Use: Is the tool well supported and easy to learn?

ProProfs

ProProfs Quiz Maker is an easy to use quiz program with a good variety of question types and options. It’s pretty amazing that it has 1 million users, over 100,000 quizzes in its public library, and over a million quiz takers. A nice feature is the end of quiz certificates for completed quizzes that can be customized. Also, test results can be downloaded in several formats. It is good at supporting accessibility with its one question per page to make the use of a screen reader more effective. It has a free and a low-cost version. To access unlimited grade reports, a paid subscription is required.

Best Features

• Very easy to use – I created a quiz in minutes.
• Good variety of question types.
• Good option for users with accessibility issues.
• Customizable quiz completion certificates.
• Relatively new to corporate quizzes and tests, but has some nice features for this kind of need.

Weaknesses

• Free version comes with Ten free grading reports - paid versions can have unlimited reports.

To see a side-by-side comparison, please see the table below.

ClassMarker

ClassMarker allows you to create simple tests/quizzes for free and seems well suited to classroom use. Instructors are able to modify score reports to provide feedback. For some of the more useful features, such as viewing score reports, an active paid account is required.

Best Features

• The program allows users to set up a ‘class’ so there is a unique login and password to track users.
• Final score reports can be modified to be shown as the instructor wishes.
• Tests can be paused, saved, and continued at the learner’s convenience.
• Variety of question types can make for a dynamic quiz.

Weaknesses

• All of the more useful features require a paid account, and even score reports cannot be viewed without one.
• No image/video support for questions.
• Not as easy to use as ProProfs.

To see a side-by-side comparison, please see the table below.

Quia

Quia allows all users to create many types of quizzes with a large variety of question types that can also include audio and video features. The instructor can set up various security settings for each class to provide more secure grading and decrease the risk of cheating. However, I found it a bit harder to use that the other tools.

Best Features

• Large variety of question types available.
• All quiz results are available in the free version.
• Security features designed to prevent cheating.

Weaknesses

• If students are not registered for a ‘class’, then the instructor cannot view the data from the quizzes.
• There is no way to choose how score reports are shown to students.
• Not as easy to use as some of the other tools.

To see a side-by-side comparison, please see the table below.

Google Docs Forms

Google Docs has a built-in Form document type that allows the creation of a set of questions. This can be an interesting quiz / test tool especially if you already use Google docs. There are a fair number of question types available and it’s very easy to use. However, users are anonymous while they are taking the test/quiz and thus need to self-report who they are (through a form field). This means that cheating would be quite easy. The reality is that this is more for creating surveys than creating quizzes and tests, but definitely worth considering in some situations.

Best Features

• Free and easy to use
• Data can be sent right to a Google docs spreadsheet or basic summary page
• Good variety of question types

Weaknesses

• No ‘grading’ can be done on quizzes
• No cheating deterrents
• Not designed for quizzes

Google docs is not included in table below since it is not designed for quizzes

Quibblo

Quibblo is a quiz and survey system that is a bit limited in terms of question types which makes it a bit harder to create a typical quiz or test. Instead users can create the type of question they require by manipulating the instructions and fields within Quibblo.

Best Features

• Free quiz designer

Weaknesses

• Site geared more for social settings than academic or corporate
• Lots of advertisements along the sides of quizzes- distracting

Quibblo is not included in comparison table as its not an academic or corporate quiz site.

	Classmarker	Quia	ProProfs
Cost	Free (some features require purchase) $24.95 - $49.95 per year	Basic is Free. $49 per year for Educators, $199 per year for Corporations	Personal use version is free. Educator version is $2.97 per month, Business version is $16.67 per month
Question Types/Methods	Multiple choice Punctuation Essay Multiple response True/ False Free text	Multiple choice True/False Pop-up Multiple correct Fill-in Initial answer Short answer Essay Matching Ordering	Multiple Choice Multiple response True/False Fill-in Essay Short answer
Multimedia	No image/video support for questions. Does allow for specialized characters.	Yes. Can add an image or audio URL to a question.	Yes. Supports image/video for questions.
Data Collection	Can only see score results with a paid account.	You can see the results of students in your class.	10 free reports are displayed. Premium version comes with unlimited reports.
Grading	Yes. Final score reports can be modified to be shown as the instructor wishes. Students can also save and finish the test later.	No, students will know their scores at the end of the quiz, but the instructor cannot choose how the reports are shown to students.	Yes. Several scoring options exist along with end of quiz certificate customization.
Download Test Results?	No, however, everything is backed up on the server. It cannot be downloaded.	Yes. If students are registered to the ‘class’, then the instructor can view the grades. If there is not a ‘class’ created, then there is no way to retrieve the data.	Yes, data is downloadable in several formats.
Layout Accessibility	This cannot be changed. Overall the layout can get a little hard to follow and can take some time to get used to.	This cannot be changed. The layout is easy to understand, and someone with visual difficulties should not have problems.	This cannot be changed (though it supports one question per page or all on one page option). Someone with visual difficulties should not have problems.
Security	Each user has a unique login and password, so the information is kept secure.	Access can be restricted to the ‘class’ only, and reduces the risk of cheating.	Users all receive a unique login and password to ensure security. Quizzes can also be protected by common password.
Ease of Use	Not as easy to use as some programs.	Not as easy to use as some programs. More time was spent viewing the tutorials than creating a quiz, and even then it was still somewhat confusing.	Very easy to use. Clear and concise instructions.
Overall	Lack of reporting in the free version is not great, but it’s low-cost for the version with score reports.	The variety of questions is great, as is the ability to add multimedia to a question. However, the ‘create a class’ function is potentially daunting, and it is not as easy to use as a whole as some programs.	Nice program with good features, and very easy to use. Low cost.