If you think there's more diversity than there is, you're in danger.

There are often hidden correlations, so it looks superficially diverse but is actually a monoculture.

For example, we have "model diversity" but most Chinese models are distilled from the frontier models.

Also all models are trained on the Common Crawl.