Informedness and Markedness

Alternatives to Recall and Precision as Evaluation Measures

Preliminaries

Image for post
Image for post
Pictorial depiction of relation between various quantities.

Recall and Precision

Both recall and precision ignored the ability of techniques to handle negatives.

All other things being unchanged, precision is affected by the prevalence of (real) positives in the example set.

Precision did not detect the change in the trustworthiness of negative predictions.

Informedness and Markedness

Informedness is a measure of how informed system M is about positives and negatives, i.e., Informedness = TP/RP - FP/RN.

Markedness is a measure of trustworthiness of positive and negative predictions by system M, i.e., Markedness = TP/PP - FN/PN.

What about the Previous Cases?

Summary

References

Programming, experimenting, writing | Past: SWE, Researcher, Professor | Present: SWE

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store