awesome-annotation-tools
A curated list of awesome annotation tools. Please feel free to pull requests to add links.
Text
Caution: This is based on my survey about a year ago. I will update it asap.
Supporting Tasks
| Classification | Sequence Labeling | Seq2seq | Relation | Dictionary | Choice | |
|---|---|---|---|---|---|---|
| doccano | ✔️ | |||||
| Prodigy | ✔️ | |||||
| Prodigy Teams | ✔️ | ? | ||||
| tagtog | ||||||
| LightTag | ||||||
| Dataturks | ✔️ | ✔️ | ||||
| Smart | ||||||
| Universal Data Tool | ✔️ | ? | ||||
| Label Studio(OSS) | ✔️ | ? | ||||
| Label Studio(Enterprise) | ✔️ | ? | ||||
| Humanloop | ? | ✔️ | ? | ✔️ | ||
| Snorkel Flow | ? | ? | ? | ? | ✔️ | |
| Taggle | ? | ? | ||||
| UBIAI | ✔️ | ✔️ | ? | |||
| Annotation Lab | ✔️ | ✔️ |
Supporting Active Learning or Auto Labeling
| Active Learning | Auto Labeling | Model Training | API Access | |
|---|---|---|---|---|
| doccano | ||||
| prodigy | ✔️ | |||
| Prodigy Teams | ||||
| tagtog | ||||
| LightTag | ||||
| Dataturks | ||||
| Smart | ||||
| Universal Data Tool | ||||
| Label Studio(OSS) | ? | |||
| Label Studio(Enterprise) | ✔️ | ? | ? | |
| Humanloop | ? | |||
| Snorkel Flow | ✔️ | ? | ||
| Taggle | ? | ? | ||
| UBIAI | ? | ? | ||
| Annotation Lab | ✔️ |
Price and other
| Price range(12 month) | Customizable | On-premise support | Collaboration | OSS | Quality Control (e.g. benchmarking, IRR/IAA) | |
|---|---|---|---|---|---|---|
| doccano | $0 | ✔️ | ||||
| Prodigy | $390-$10,000 | |||||
| Prodigy Team | ? | ✔️ | ||||
| tagtog | $0-$12,000 | |||||
| LightTag | $1,200 | ✔️ | ||||
| Dataturks | $0-3,600 | ✔️ | ✔️ | |||
| Smart | $0 | IRR | ||||
| Universal Data Tool | $0 | ✔️ | Course/Benchmarking | |||
| Label Studio(OSS) | $0 | ✔️ | ||||
| Label Studio(Enterprise) | ? | ✔️ | ||||
| Humanloop | $0 - $999 | ? | ||||
| Snorkel Flow | ? | ? | ? | |||
| Taggle | ? | ? | ? | |||
| UBIAI | $0 - $1000 | ? | IAA | |||
| Annotation Lab | Free | Analytics & IAA |
Contribution
Welcome to the Pull Requests!