Performance vs Cost

Micro F1, precision, and recall: higher is better. Cost: lower is better.

0% 10% 20% 30% 40% 50% 60% 70% $0.1 $1 $10 Micro F1 USD / 1,000 annotations · log scale Jev Micro F1 31.6% · Precision 63.6% · Recall 21.0% · $0.08 / 1,000 annotations 126 correct flags · 72 extra flags · 474 missed labels

Hover for precision and recall. Circle = default. Square = low. Diamond = medium.

Models
Performance vs Cost