Government Invites Private Firms To Share Anonymous Data For AI Kosh

The Indian government announced on Wednesday that it will invite private firms and startups to share non-personal datasets with the AI Kosh platform.

According to a Senior Government Official, "The move aims to accelerate the development of AI applications in India along with enabling access to enough data for training large language models (LLMs)."

According to the plan, companies like Google, Phonepe, and Uber can contribute anonymized datasets of usage patterns on their websites without disclosing their users' identities or personal information.

Furthermore, other public institutions that are contributing datasets include Open Data Telangana, Indian Council of Medical Research, Digital India Bhashini Division and Ministry of Jal Shakti. Research organizations include Development Data Lab along with non-profits I-Hub for Robotics and Autonomous Systems Innovation Foundation.

According to officials, "Several companies had reached out to the government with interest in contributing to AI Kosh, so the department decided to release a standard expression of interest (EoI) so that instead of these one-on-one dealings, we can give the opportunity to everyone to contribute, who did not wish to be identified."

“Datasets that may add a lot of value can be from companies like Google, healthcare datasets, doctor prescriptions, call centre datasets, etc.; ultimately all conversational datasets will help in training the LLM,” the official added.