awesome-annotation-tools

A curated list of awesome annotation tools. Please feel free to pull requests to add links.

Text

Caution: This is based on my survey about a year ago. I will update it asap.

Supporting Tasks

	Classification	Sequence Labeling	Seq2seq	Relation	Dictionary	Choice
doccano	✔️	✔️	✔️
Prodigy	✔️	✔️	✔️	✔️		✔️
Prodigy Teams	✔️	✔️	✔️	✔️	?	✔️
tagtog	✔️	✔️		✔️	✔️
LightTag	✔️	✔️
Dataturks	✔️	✔️	✔️
Smart	✔️					✔️
Universal Data Tool	✔️	✔️	✔️	✔️	?	✔️
Label Studio(OSS)	✔️	✔️	✔️	✔️	?	✔️
Label Studio(Enterprise)	✔️	✔️	✔️	✔️	?	✔️
Humanloop	✔️	✔️	?	✔️	?	✔️
Snorkel Flow	✔️	?	?	?	?	✔️
Taggle	✔️	✔️	?	✔️	?	✔️
UBIAI	✔️	✔️	✔️	✔️	✔️	?
Annotation Lab	✔️	✔️	✔️	✔️	✔️	✔️

Supporting Active Learning or Auto Labeling

	Active Learning	Auto Labeling	Model Training	API Access
doccano				✔️
prodigy	✔️		✔️	✔️
Prodigy Teams	✔️		✔️	✔️
tagtog		✔️	✔️	✔️
LightTag		✔️	✔️	✔️
Dataturks				✔️
Smart	✔️	✔️
Universal Data Tool
Label Studio(OSS)	✔️	✔️		?
Label Studio(Enterprise)	✔️	✔️	?	?
Humanloop	✔️	✔️	✔️	?
Snorkel Flow	✔️	✔️	✔️	?
Taggle	✔️	✔️	?	?
UBIAI	?	✔️	✔️	?
Annotation Lab	✔️	✔️	✔️	✔️

Price and other

	Price range(12 month)	Customizable	On-premise support	Collaboration	OSS	Quality Control (e.g. benchmarking, IRR/IAA)
doccano	$0	✔️	✔️	✔️	✔️
Prodigy	$390-$10,000		✔️
Prodigy Team	?		✔️	✔️
tagtog	$0-$12,000		✔️	✔️
LightTag	$1,200	✔️	✔️	✔️
Dataturks	$0-3,600	✔️	✔️	✔️
Smart	$0	✔️	✔️	✔️	✔️	IRR
Universal Data Tool	$0	✔️	✔️	✔️	✔️	Course/Benchmarking
Label Studio(OSS)	$0	✔️	✔️		✔️
Label Studio(Enterprise)	?	✔️	✔️	✔️
Humanloop	$0 - $999	?	✔️	✔️
Snorkel Flow	?	?	?	✔️
Taggle	?	?	?	✔️
UBIAI	$0 - $1000	✔️	?	✔️		IAA
Annotation Lab	Free	✔️	✔️	✔️		Analytics & IAA

Contribution

Welcome to the Pull Requests!