Heads up: the boxes are drawn in the wrong places using Firefox 66 on Ubuntu 18.04. https://imgur.com/a/4d51spv

A bit confusing as the drawn boxes don't match the text. Works with Chromium though.

Thx, I'll check that

Interesting idea!

Though I have a question: in order to calculate C you need a way to attribute proposal and ground truth. It's trivial in case when there's only one instance of each class in the image.

But how does it work, when you're working with a set of same-class object? For example detecting each car in traffic.

Good question, we use the same method as coco, described in https://arxiv.org/pdf/1405.0312.pdf and implemented in the coco evaluation scripts here: https://github.com/cocodataset/cocoapi/blob/master/PythonAPI... -- basically the best matching proposal, ground truth pair