Task markup

Task markup lets you add correct answers and hints to the tasks, as well as change task types. You can turn a general task into a control task by adding the correct answer, or into a training task by adding the correct answer and a hint.

Task markup is available only for training pools and pools uploaded with “smart mixing”.

  1. Add responses or hints
  2. Improve the reliability of control tasks
  3. What's next

Add responses or hints

To mark up the tasks:

  1. Make sure the pool isn't running.
  2. Click Edit in the Pool tasks block.
  3. Open the Main, Control tasks or Training tasks tab. Create a control or a training task from another type of task.
  4. Select the answers that should be checked. (The list of the output data fields is on the right.)
  5. Click Save and go to next.
Example of task markup

In this example, the correct answer is added for the control task. Only the choice in the result field (Good/Bad/Loading error) is checked.

Improve the reliability of control tasks

After you have created the control tasks, make sure that different variations of correct answers occur with the same frequency. This will help avoid random guessing in responses.

  1. Go to the task markup page.
  2. Open the Training tasks → Distribution of correct responses for control tasks tab.

    The distribution of responses is shown as a percentage.

Tip. When creating control tasks, enter only correct responses that answer the question. So for an image classification task, Image loading error is not a correct response that answers the task question.
Example of response distribution