Agreement with human raters
The English models were trained and tested on speechocean762: 5,000 recordings of non-native speakers, each rated by five experts. The bars give the Pearson correlation between the overall score and the raters' average on the 2,500 test recordings, whose speakers were kept out of training.
At word level it flags about one word in twenty, and the raters had marked a little more than half of those.
It judges pronunciation only. French, Spanish, German, Italian, Portuguese and Dutch run on the same models, but English is the only language measured against raters, and children speaking freely are scored poorly. Every known limit, with its figure.