際際滷

際際滷Share a Scribd company logo

Mindtree cs government-big data & analytics

Mindtree Ltd.
Mindtree Ltd.

The Aadhaar initiative by the Indian government aims to provide a unique identity to each of India's 1.2 billion citizens by collecting and storing their biometric and demographic data. Mindtree was chosen to help design a system to effectively store and manage the vast amount of data being collected, while ensuring privacy and security of citizens' personal information. Key aspects of the solution included a data warehouse to hold enrollment information without personal details, technologies like Hadoop to handle billions of transactions, and dashboards to disseminate information to various users in a flexible way.

1 of 2
Giving 1.2 billion citizens a unique identity. Aadhaar, an Indian government initiative aims to provide a unique identity for every citizen. This involves managing, authenticating and reporting staggering amounts of data that requires a robust and scalable information Business impact management platform. Scalable architecture to handle ten billion enrolments Heres how we helped the Indian government manage this complex and Easy monitoring of the enrolment critical initiative successfully. process through dashboards and customized reports The challenge Informed decision making through a The Unique Identi鍖cation Authority of India (UIDAI), envisioned a dedicated self-service portal with relevant 12-digit number as a unique identity for every citizen of the country. metrics and custom reports The number would be stored in a centralized database and linked to the Prevented potential fraud cases basic demographics and biometric information (photograph, ten through formidable checks at the 鍖ngerprints and iris), of every individual. UIDAI needed a partner to design enrolment stage a credible mechanism for identity establishment, authentication, storage and retrieval. The system needed to meet the following objectives: Scalability to withstand enormous data volumes and throughput needs Availability of information through Business Intelligence (BI) systems and portals to be used by diverse users such as the public, UIDAI and academicians Building a data warehouse that has zero knowledge of the resident, thereby ensuring security of data Flexibility to store data at the most atomic level, ensuring data aggregation at any level for reporting Usage of open source technologies and tools to avoid vendor lock-in
Our solution Mindtree was chosen by UIDAI as the primary application development partner. We collaborated with UIDAI and devised a solution strategy that comprised the following: A data warehouse to capture all enrolment related information except PII (Personal Identi鍖able Information) data of over 1.2 billion residents of India Solution design to e鍖ectively manage 8 peta bytes of raw data An e鍖cient data management system to handle over 100 million database transactions per day Asynchronous data acquisition from transactional systems Dataset generation and distribution platform enabling consumption by portals and dashboards, data marts and analysis tools Use of technologies that leverage data locality, which support distributed processing for dataset generation Our approach Designed a layered architecture for 鍖exibility and scalability of data collection and information dissemination Used big data open-source technologies such as Hadoop, Hive, Pig to handle the scale Developed MySQL-based Operational Data Store (ODS) to cater to operational reporting Asynchronous data acquisition from transactional systems using an event publish / subscribe framework The framework uses message queues to publish data to the data warehouse without impacting the enrolment process The framework is also used to publish data on authentications About Mindtree Mindtree is a global information technology solutions company with revenues of over USD 400 million. Our team of 11,000 experts engineer meaningful technology solutions to help businesses and societies 鍖ourish. We enable our customers achieve competitive advantage through 鍖exible and global delivery models, agile methodologies and expert frameworks. www.mindtree.com 息Mindtree Ltd 2012

More Related Content

Mindtree cs government-big data & analytics

  • 1. Giving 1.2 billion citizens a unique identity. Aadhaar, an Indian government initiative aims to provide a unique identity for every citizen. This involves managing, authenticating and reporting staggering amounts of data that requires a robust and scalable information Business impact management platform. Scalable architecture to handle ten billion enrolments Heres how we helped the Indian government manage this complex and Easy monitoring of the enrolment critical initiative successfully. process through dashboards and customized reports The challenge Informed decision making through a The Unique Identi鍖cation Authority of India (UIDAI), envisioned a dedicated self-service portal with relevant 12-digit number as a unique identity for every citizen of the country. metrics and custom reports The number would be stored in a centralized database and linked to the Prevented potential fraud cases basic demographics and biometric information (photograph, ten through formidable checks at the 鍖ngerprints and iris), of every individual. UIDAI needed a partner to design enrolment stage a credible mechanism for identity establishment, authentication, storage and retrieval. The system needed to meet the following objectives: Scalability to withstand enormous data volumes and throughput needs Availability of information through Business Intelligence (BI) systems and portals to be used by diverse users such as the public, UIDAI and academicians Building a data warehouse that has zero knowledge of the resident, thereby ensuring security of data Flexibility to store data at the most atomic level, ensuring data aggregation at any level for reporting Usage of open source technologies and tools to avoid vendor lock-in
  • 2. Our solution Mindtree was chosen by UIDAI as the primary application development partner. We collaborated with UIDAI and devised a solution strategy that comprised the following: A data warehouse to capture all enrolment related information except PII (Personal Identi鍖able Information) data of over 1.2 billion residents of India Solution design to e鍖ectively manage 8 peta bytes of raw data An e鍖cient data management system to handle over 100 million database transactions per day Asynchronous data acquisition from transactional systems Dataset generation and distribution platform enabling consumption by portals and dashboards, data marts and analysis tools Use of technologies that leverage data locality, which support distributed processing for dataset generation Our approach Designed a layered architecture for 鍖exibility and scalability of data collection and information dissemination Used big data open-source technologies such as Hadoop, Hive, Pig to handle the scale Developed MySQL-based Operational Data Store (ODS) to cater to operational reporting Asynchronous data acquisition from transactional systems using an event publish / subscribe framework The framework uses message queues to publish data to the data warehouse without impacting the enrolment process The framework is also used to publish data on authentications About Mindtree Mindtree is a global information technology solutions company with revenues of over USD 400 million. Our team of 11,000 experts engineer meaningful technology solutions to help businesses and societies 鍖ourish. We enable our customers achieve competitive advantage through 鍖exible and global delivery models, agile methodologies and expert frameworks. www.mindtree.com 息Mindtree Ltd 2012