Matching and Sorting Questions
In the Matching & Ranking Question , the user is asked to match a set of Items with a set of Choices. If the options represent ranks , this counts as a Ranking Question.
We start creating our question (as in all questions) by typing our question in the Title of the Question section.
Matching Items with Choices in the Common Choice Pool
In this case, items and a pool of common choices are created. The user matches each item with the choices in the common choice pool. It is possible to set up to how many times each item added to the common choice pool can be matched with one item.
Example: Matching Countries with Capitals
- For example, our items are 3 countries: France , Germany and Italy.
- Let’s add 3 capitals to the common choice pool : Paris, Berlin and Rome . Since we want each choice to be matched 1 time, let’s set the Maximum Usage Number of the choices to 1.
- In this way, three countries (items) are listed to user and the user is asked to pair each with one of the three capitals (choice pool). By opening the preview we can view the question we created.
- Since we set the Max. No. of Use of each option as 1 in the options pool , if the user matches Italy with Rome, he/she will no longer see Rome again in the next matching.
- If you want a choice to be re-selected, you can increase the Maximum Usage of the choice in the common choice pool.
Matching Each Item with Its Unique Choices
In this case, while the items are created, unique choices are added to each item. In this case, we do not use the Common Choice Pool.
Matching Countries with Another Neighboring Country
- As in the previous example, let’s create 3 countries as items: France , Germany and Italy.
- This time, however, we will add unique choices to each item. For example, we add the following unique choices for France: Belgium , Austria and Bulgaria
- Similarly, for Germany, let’s add the following unique choices: Austria , Austria and Turkey
- Similarly, let’s add the following unique choices for Italy : Switzerland , Romania and Bulgaria
- Let’s open the Preview of the questions. As you can see, the user will now be able to match each item to one of the unique choices:
Restricting the Number of Matches to be Made
You can offer many items to the user, but you may require selection for only some of these items
- Maximum Matching: Determines the maximum number of matches the user can make.
- Minimum Matching: Determines the minimum number of matches the user can make.
For example, you might want to create five items, each one to be a Country, and only match two with one of the two options: My first choice, My second choice
- Let’s create 5 items: Germany , France , Turkey , Belgium and Italy
- Let’s add 2 options to the options pool: My first option and My second option
- Let’s open our preview and check our question. The user will only be able to match for 2 items (countries).
Determining the Contribution Rates of Choices and Calculating the Success Rate
How much each match made by the user will contribute to the success rate of the user is determined by the Automatic Scoring Rules. The user gets as much success as the Sum of Contribution Rates defined for the matches he / she has made.
After preparing your question, you can determine how much the success rate will be increased for each item, when the user makes the match . For this, we will add the Automatic Scoring Rule to each item. If the user performs the relevant matching, the Contribution Rate that we will express in this rule is added to the Success Rate that the user will obtain from the question.
In the screen below; If the User matches the German item with my First choice, we ensure that the system achieves the user full success (100%) from this question
You can add New Scoring Rule to many elements. In this case, the user will earn the Total of the Contribution Rates you set based on the matching made for each item. So ensure that the Total Contribution Rates are 100%.
We have already explained how Contribution Rates work in the Multiple Choice Question section.
You can add a Side Effect for each Auto Scoring Rule. We also saw how the Side Effects works in the Multiple Choice Question.
THE MOST COMMON MISTAKE
Note that the matching question is perceived by the system as 1 question! Keep this in mind when determining Contribution Rates and Question Points!
For example, in the question below, we added 4 countries as items and then we entered 3 choices for all. The user chose the right choice for all items. Now how do we ensure that the user achieves Full Success (100%) from this question and what should be the point of this question?
In this question, we will add one Automatic Scoring Rule for each item and the Contribution Rate of all will be 25%. This way the user will get 100% if he/she chooses the right choice for all 4 items.
- For France item, 25% to Belgium choice
- For Germany matter, 25% to Austria choice
- For Italy matter, 25% to Swiss choice
- For Portugal item, 25% to Spain choice
Finally, we make the point value of this question 4 because this question actually has 4 matches. Of course, you can also set the point of the question as 1 , but in this case, as a result of the matches in this question, you can earn at most 1 point. To learn more about scoring, check the Point and Categories page.
The Matching & Ranking Question is perceived by the system as a single question regardless of how many matches are made . Therefore, if you are asking a question that the user will make many matches, remember to determine the point of the question according to the number of matches made.