OpenAI is huge in India. Its models are steeped in caste bias.

OpenAI's AI models, widely used in India, have demonstrated significant caste bias. Users have reported instances where the AI alters their identity, such as changing a surname to one associated with a higher caste. This bias is concerning given the deep-rooted and sensitive nature of caste in Indian society. The models appear to perpetuate existing social hierarchies, raising questions about the fairness and neutrality of the AI tools being adopted.

This matters because AI tools used by millions can reinforce harmful social biases, impacting perceptions and potentially perpetuating discrimination.