In some cases, the CNNs had overcome the adversarial images and correctly applied labels, but in other instances they had whiffed.
What the researchers found is that humans are quite good at intuiting a machine’s logic, even when that logic returns a seemingly ridiculous error.
But they make mistakes that we usually don’t make.” He said that when he encountered some of those apparently silly errors himself, he noticed there actually seemed to be a logic behind it.
'” After looking at an image a CNN had misclassified as an armadillo, let’s say, he could understand why an AI may perceive it as “armadillo-ish.”
With this in mind, Zhou and Firestone designed a series of experiments to probe further.
Each of the eight experiments in the study contained 200 individuals, save for one that had 400.