Enterprise Data Modernization on AWS for a Large Telecom Conglomerate
Challenges
The client is one of the largest mobile telecommunications companies in Asia Pacific. The company offers an array of innovative telecommunications products and services ranging from voice, SMS, and Value-Added Services (VAS) through mobile data.
The client encountered significant challenges with their existing Cloudera platform, primarily due to escalating infrastructure costs and inadequate support services. To address these issues and transform into a data-driven, future-ready organization, the client initiated the Enterprise Data Platform Modernization project, aiming to migrate their enterprise data platform to AWS Cloud.
Searce Solution
- Onboarded client to AWS, migrating 2 PB of historical data from Cloudera.
- Integrated Oracle, MySQL, and streaming services as data sources.
- Automated ETL pipelines using AWS DMS, AWS Glue, and Amazon EMR.
- Established Data Lake with Bronze, Silver, and Gold layers for data staging.
- Deployed Data Warehouse on AWS Redshift for 36 subject areas of business reporting.
- Implemented Kafka mirror maker for migration to Amazon MSK.
- Established Data Governance for security, cataloging, lineage, and metadata management.
This comprehensive modernization initiative has positioned the client for enhanced data management capabilities, cost efficiency, and scalability in their operations.
Business Impact
- Achieved a 30% reduction in overall infrastructure costs.
- Enhanced data pipeline processing efficiency by ~35%.
- Implemented automated monitoring and service support.
- Achieved scalability according to the business demand.
- Optimized Redshift performance and costs with detailed visibility for client stakeholders on maintenance, operational, and SKU-level expenses.
- Established effective Data Governance practices with data protection, and role-based row and column-level access controls.
The Searce Edge
Initially, the client had partnered with another vendor, but this partnership fell short of meeting project delivery expectations. With the project still in its early stages, the client decided to replace the vendor and selected Searce as their partner of choice for AWS. In just a few weeks, we resolved all outstanding issues, successfully streamlined project delivery, and ensured the project progressed smoothly and efficiently.
Our team went above and beyond the initial scope to accommodate additional customer requirements, prioritizing their business needs for Searce. Key process improvements we implemented include:
- Developing and deploying a comprehensive, robust, and dynamic orchestration framework with support for job-level backfilling.
- Designing and implementing advanced data lakes in AWS S3 using Medallion architecture. This included SCD Type 2 tables, Hudi, and parquet format for efficient CRUD operations, time-travel queries, and point-in-time recovery.
- Consistently delivering high-quality work on time while fostering a collaborative environment with other teams involved in the project.
Collaboration and Innovation:
- Successfully worked with multiple teams in a collaborative environment to develop a robust, end-to-end data platform on AWS.
- Designed an orchestration framework capable of handling a wide range of job types, schedules, and edge cases.
more case studies
Driving Logistics Innovation with Searce & Google Cloud
Yaantra partners with Searce & Google Cloud to help consumers with a single window stopover for smart gadgets in India
