An annotation job gives a group of recordings (segmentation) or episodes (labeling) to project members. Labelers work through the items in the job, and reviewers approve or send them back.
Who can do this (project roles): Owner and Editor create and cancel jobs. Owner, Editor, Reviewer and Labeler label the items assigned to them.
Before you start
- Choose the label fields in the Annotation schema tab of Project settings.
- Select recordings on Recordings or episodes on Episodes.
Open Annotation
In the sidebar, under the project, choose Annotation. The page lists the jobs in the project. Each row shows the job name, its kind and how many items are approved.
Select items for the job
A segmentation job starts from recordings: select them on Recordings and start the job from the selection bar. A labeling job starts from episodes: select them on Episodes and choose Create job in the selection bar.
Fill in the job and choose Create
In the dialog, enter a name, choose how the items are distributed, and tick the labelers who will work on them. Then choose Create at the bottom of the dialog. Create stays off until you enter a name and tick at least one labeler. The job is created and its items are assigned to the labelers you chose.
| Field | What to enter | Example |
|---|---|---|
| ① Name (required) | A name your team will recognize. | Label cup tasks, batch 1 |
| ② Distribution | Even splits the items across the labelers. Queue lets each labeler claim the next item. | Even |
| ③ Assignees (at least one) | The project members who label the items. | Lin Chen |
Open the job and work through its items
Choose the job in the list. For a queue job, choose Claim next item to take the next item. Each item opens in the studio. Use Previous item and Next item to move between items, and choose Complete when an item is done. Only queue jobs show Claim next item; you need label permission for it.
The job page lists its items with their status. The panel on the right counts the items done and the rejection rate.
The job appears in the list. Its row shows the kind and how many items are approved.
What happens next
Reviewers approve labels with Approve or send them back with Send back. When you send an item back, you can add a Comment. Approved labels show as Approved in the Label state filter on Episodes. The job progress counts approved items.
Labelers see the work assigned to them in My work.
Troubleshooting
There is no Claim next item button
Only queue jobs show this button, and you need label permission. In an even job, each item is already assigned to one labeler.
Create job is grey
Select at least one recording or episode first.
Create is disabled in the dialog
Enter a name and tick at least one labeler.