I haven't really promoted the extension yet, but people have already started using it - enough for a small but helpful dataset to form. This alone gave a boost to improving the dataset labeling quality.
3×3
I’ve learned how to quickly spot model errors. Usually, seeing the same image 3–5 times is enough to automatically correct a wrong prediction. In rare cases, a single encounter is enough.
Funny thing: sometimes reCAPTCHA insists an object exists even when it clearly doesn’t. For example, it often mistakes cyclists wearing red for a fire hydrant.
4×4
This one was tougher. I finally found a reliable way to determine whether the model marked the correct squares - which is tricky because reCAPTCHA allows a small error margin. That means it may accept a certain answer in one case and reject the exact same answer in another if the error is slightly larger.
To analyze these cases properly, I need to see each image 10–20 times and gather a set of different answers. Because of that, I added a feature to the plugin where it gives slightly varied responses when encountering identical 4×4 tasks - this helps diversify the dataset and makes analysis easier.
Install the extension from the Chrome Web Store:
Free AI reCAPTCHA Solver