Pool statistics

You can track task completion on the pool page or by clicking Statistics. You can also get notifications by email, in the browser or on the Messages page. In the Profile, open the Notifications tab and choose which notifications you want to receive and how you want to receive them.

FieldOverview
Approximate completion time

The anticipated time for finishing tasks, in days and hours. Calculated using the average time per task suite.

Formula: Tleft=Assignleft×TassignT_{left}={Assign_{left}}\times{T_{assign}},

where:

  • AssignleftAssign_{left} is the number of task suite remaining uncompleted or those completed with insufficient overlap.

  • TassignT_{assign} is the average time per task suite. Calculated based on the amount of time since the pool opened and the number of task suites completed.

The time is updated as task suites are completed by Tolokers.

Recommendations
Average assignment submit time

The average time for completing a task suite in the pool. Specified in seconds.

Calculated based on 1000 recently completed task suites.

Recommendations
Expired task suites

The number of expired task suites.

Includes the pages that Tolokers failed to complete on time. You specify the time allotted for a task suite when setting up a pool.

The task can also get the expired status when the Toloker clicks Exit. In this case, the Toloker can return to the task again, unless it was completed by someone else or the requester deleted it from the pool.

Recommendations
Skipped task suites

The number of task suites skipped by Tolokers. Includes the pages that the Tolokers decided to skip and moved on to the next tasks.

When the Toloker clicks Skip, the task gets the skipped status. In this case, the Toloker can no longer return to the task.

Recommendations
Submit timeThe time between the start and completion of the pool. Displayed if all pool tasks are completed.
Start datePool start date
Completion dateThe date when all pool tasks were completed.
Assignments

The graph shows the number of tasks by type:

  • Submitted — The number of task suites submitted for review.

  • Accepted — The number of accepted task suites.

  • Skipped — The number of task suites skipped by Tolokers.

  • Expired — The number of expired task suites. Includes the pages that Tolokers failed to complete on time or decided to skip.

Recommendations
Average overlap

The average number of Tolokers who completed the same task in the pool.

Recommendations
Assignment submit timeThe average time spent by Tolokers to complete a task suite in the pool. Specified in seconds.
Budget spent (+ fee)

The amount of money spent in the pool. The fee amount is shown in parentheses.

If you spent more than you planned, check the price settings in the pool and the quality control rules. For example, Dynamic pricing and Recompletion of assignments from banned users increase the cost of the pool.

Recommendations
Approximate budget (+ fee)

The amount of money spent and expected costs (if all the tasks are completed and all responses are approved). The fee amount is shown in parentheses.

Recommendations
Spending (excluding fee)

The graph shows the amount of money spent without the fee:

  • Spending on bonuses — The amount of money spent on extra bonuses.

  • Spending on assignments — The amount of money spent on tasks.

Average cost per task

The average price in USD per general task in the pool, including overlap.

Note that this is the price per task, not per suite with overlap.

Recommendations
Earnings per hourAverage Toloker earnings per hour of data labeling in the pool, in US dollars. Earnings include bonuses.
Quality on control tasks and training tasks in the pool

Quality on control tasks and training tasks

This graph shows the percentage of correct responses in the control and training tasks.

Recommendations
Blocked by rules

The number of Tolokers banned by the quality control rules.

Note that the number of Tolokers is counted separately for each rule.

Recommendations
Banned Tolokers

The total number of Tolokers banned in this pool.

The graph shows two indicators:

  • In the pool — Number of Tolokers banned in the pool.
  • By the requester — Number of Tolokers banned by the requester.

Note that the graph only shows banned Tolokers. It doesn't include Tolokers whose access is suspended.

Recommendations
Active Tolokers with access to the pool

The number of Tolokers selected for the pool with filters. The number includes only Tolokers who viewed and completed tasks in Toloka in the last hour.

Recommendations
Interested in pool

The number of Tolokers who started or completed at least one task suite.

It includes both interested and engaged Tolokers.

Recommendations
Submitted in pool

The number of Tolokers who completed at least one task suite.

Recommendations
Submitted assignments per Toloker

The average number of task suites per Toloker.

If your pool is large and it is taking a long time to finish it, but there are very few task suites per Toloker, you may have incorrectly configured quality control rules or filters.

Recommendations
Tolokers completing tasks in the pool

This graph shows the total number of Tolokers who completed at least one task suite in the pool.

Recommendations

Troubleshooting

Why has the speed of pool completion dropped?
What does the labeling speed depends on?
How can I speed up the pool completion?
Why is the maximum number of submitted assignments in the progress bar less than the total number of uploaded tasks?
Contact support

Last updated: August 3, 2023

Introduction
Getting started
Important tips
Useful recommendations
Working with Toloka
Projects
Pools
Tasks
Results
Project analysis
Toloka settings
Task interface
Template Builder
HTML/CSS/JS editor
Help and support
FAQTroubleshootingSupportGlossary