Profile
Technical people leader with 17+ years of experience. Strong background in AWS Cloud, Data Engineering (Spark, Delta Lake), Microservices, System Design, and Full-stack Development. Recognized as an expert Engineering Manager and Cloud Architect in Pune.
Technical Writer: I regularly contribute to leading Medium publications including Towards Data Engineering, Stackademic, and AWS In Plain English. My articles focus on cloud, data engineering, distributed systems, and software best practices.
- Load Testing with K6: A Step-by-Step Guide for Developers
- RICE Model: A product feature prioritization technique for Engineering & Product managers
- Designing Reliable Distributed Systems: Transactional Outbox + Change Data Capture (CDC) Pattern
- Encoding vs Collation in RDBMS Databases - What’s the Difference and Why Should You Care?
- dbt for Developers - Part 2: Getting Your Hands Dirty with MySQL, Models, Tests & Seeds
- Flyway for Developers - Part 2: Hands-On with MySQL and Real-World Migrations
Work Experience (last 3)
Nielsen (Sep 2017 – Present)
- Migrated high-traffic public site (3M hits/day) across AWS accounts
- Built Delta Lake pipelines using Spark & AWS Glue
- Led product roadmap planning and hiring
Bigtree Entertainment (2014 – 2017)
- Led development of One click Cinema payment modules for BookMyShow
- Managed a 4-member dev team and interview panel
Idealake Technologies (2011 – 2013)
- Handled offsite/onsite delivery for India's mutual fund houses like hdfc, dspblackrock etc and client relationships
- Led a team of 10 comprising of devs & designers
Projects
Led the development of a public SaaS web application, collaboratively built by a team of three developers using ReactJS, NodeJS, and EMR Clusters, hosted on Kubernetes (K8s). This platform is a critical revenue generator and the flagship project in the company’s pipeline.
Tech Stack: ReactJS, NodeJS, AWS EMR, Kubernetes
- Served as Technical Lead, mentoring and grooming developers from diverse technical backgrounds.
- Ensured seamless collaboration and adoption of modern development practices.
- Oversaw end-to-end delivery, from architecture to deployment, for a high-visibility SaaS product.
- Enabled scalable, cloud-native infrastructure to support business growth.
Managing a team comprising 1 Staff Engineer, 1 Senior Engineer, and 1 Junior Engineer to develop and maintain tvlistings.zap2it.com, a public site geo-restricted to the US and Canada market with an impressive 3 million hits per day. The project is fully hosted on AWS infrastructure and leverages a modern and robust tech stack, including ReactJS, ASP.NET, Redis, MySQL, and MSMQ.
Tech Stack: ReactJS, ASP.NET, Redis, MySQL, MSMQ, AWS
- Oversaw technical and operational efforts to ensure smooth functioning and scalability of the platform.
- Provided leadership in managing resources, troubleshooting, and mentoring engineers to enhance expertise and align with project goals.
- Drove best practices to sustain high availability and performance for a substantial user base (3M+ hits/day).
- Implemented robust monitoring and incident response processes for 24/7 uptime.
Data Pipeline from DeltaLake using Spark
– Dev / Manager
Apr 2023 – May 2024
▼
Designed and implemented a comprehensive Delta Lake solution to enable incremental data retrieval and integration for Producers and downstream applications. Developed a robust Spark Job-based data pipeline, ensuring the scheduled extraction of data from a 2 TB Delta Lake, and orchestrated seamless data flow into the company's database. This solution enhanced data accessibility and empowered downstream applications with real-time analytics capabilities.
Tech Stack: Apache Spark, Delta Lake, SQL, Python
- Led the project, focusing on Spark and Delta Lake technologies for scalable data integration.
- Mentored and guided a team of 4 developers in Spark Job and Delta Lake implementation.
- Facilitated comprehensive knowledge-building sessions and ensured effective knowledge transfer across the team.
- Enabled real-time analytics for downstream applications by improving data accessibility and pipeline reliability.
Entitlement Tool
– Engineering Manager
May 2018 – Current
▼
Developed and maintained an internal tool primarily used by CX and Engineering teams to manage entitlement needs for datasets consumed by clients. This tool ensures proper access control, determining which customers receive specific datasets. It integrates seamlessly with third-party solutions such as Mashery (API gateway) and Salesforce and has become the de-facto standard across all Nielsen verticals for dataset entitlement. Key functionalities include ingesting Parquet and Avro files from S3 buckets and handling upstream data from Kafka servers. The infrastructure is built entirely on AWS, with a modern tech stack including ReactJS, Spring Boot (Java), MySQL, Apache Solr, Apache Kafka, AWS Lambda, and other AWS services.
Tech Stack: ReactJS, Spring Boot (Java), MySQL, Apache Solr, Apache Kafka, AWS Lambda, AWS, Mashery, Salesforce
- Designed and implemented critical features to support entitlement workflows and ensure data security across datasets.
- Integrated Parquet and Avro file handling from upstream systems for seamless data processing.
- Ensured tool reliability and scalability by leveraging AWS services and best practices.
- Collaborated with CX and engineering teams to gather requirements and address evolving needs.
- Contributed to knowledge-sharing initiatives and technical mentorship within the team.
Catapult Navigator
– Engineering Manager
Sep 2017 – Current
▼
Developed and maintained a search platform designed for CX teams at Nielsen in the U.S. to explore and address issues raised by major clients such as Google, Amazon, and Roku, who consume the GVD Dataset (a key metadata product). The platform operates on a robust 8 TB database, enabling efficient and scalable search capabilities. Implemented a Rate Limiter in the client ingestion application using the Token Bucket Algorithm to regulate API hits at 5 QPS. The infrastructure is fully deployed on AWS, utilizing a cutting-edge tech stack including ReactJS, Spring Boot (Java), MySQL, Apache Solr, AWS Lambda, and several other AWS services.
Tech Stack: ReactJS, Spring Boot (Java), MySQL, Apache Solr, AWS Lambda, AWS
- Designed and implemented critical features, such as the rate limiter, to ensure stability and efficiency in client ingestion workflows.
- Integrated various AWS services to support a scalable and high-performance platform.
- Collaborated with CX teams to identify and resolve client-specific issues and meet evolving business needs.
- Mentored team members on advanced concepts in AWS and data processing.
Side Projects
Speed Dialer gives you quick access to your most visited pages with fewer clicks! Organize, search, and access your favorite websites faster with an intuitive, customizable Chrome extension.
- One-click add, drag & drop, and custom folders for organization
- Theme toggle (Light/Dark), smart search bar, and persistent Chrome sync
- 152+ users
Instantly view your public and private IP addresses, location, and network details with a single click. MyIP QuickOverview is a lightweight, user-friendly Chrome extension for tech enthusiasts, developers, and privacy-conscious users.
- One-click IP lookup with real-time updates
- Displays public/private IP, city, state, and country
- Lightweight, intuitive, and privacy-focused design
- 5+ users