About Me
Senior Data Engineer | Data Platform Architect | Engineering Lead
Short Bio
Results-driven Senior Data Engineer with 12+ years of experience architecting, building, and scaling enterprise-grade data platforms across cloud-native environments. Deep expertise in the Databricks Lakehouse ecosystem (Delta Lake, Delta Live Tables, Asset Bundles), PySpark at scale, and Azure data services. Proven ability to lead engineering teams, drive platform modernisation from batch to real-time streaming, and translate complex business requirements into high-impact technical solutions.
Core Competencies
- Databricks, Delta Lake, Delta Live Tables, Apache Spark
- PySpark, Python, Scala, SQL, C#, PowerShell
- Azure Data Factory, Azure DevOps, Azure Functions
- AWS Lambda, S3, Glue, SQS, SNS
- Lakehouse Architecture, Medallion Architecture, Real-time Streaming
- CI/CD Pipelines, Databricks Asset Bundles, GitHub Actions
- Power BI, Data Contracts, GDPR / PII Compliance
Certifications
- Databricks Certified Data Engineer Professional
- AWS Certified Solutions Architect - Associate
- Microsoft Certified: Azure Data Engineer Associate
- Microsoft Certified: Azure Data Fundamentals
Experience
May 2025 - Present
Senior Data Engineer
Enable Data
Spearheaded platform-wide transition from batch to near real-time streaming using Databricks Delta Live Tables. Led a team of 3 engineers, reducing frequency from 24 hours to 15 minutes and cutting manual deployment effort by 20%.
Apr 2024 - Feb 2025
Senior Data Engineer
Info Services
Architected Databricks/PySpark pipelines processing ~2 TB/day of advertising data. Led multi-platform spend and conversion aggregation pipelines, reducing stakeholder reporting time by 50%.
Jul 2023 - Apr 2024
Senior Data Engineer
Elastacloud
Architected Databricks PII masking/unmasking workflows for GDPR compliance. Built serverless event-driven pipelines using AWS Lambda, SQS, and SNS, reducing pipeline failure rates by 20%.
Jul 2021 - Jul 2023
Data Engineer
Elastacloud
Built in-house Knowledge Mining platform on Azure integrating Cognitive Search and Cognitive Services. Developed RESTful backend APIs and managed Azure DevOps pipelines for full-stack deployment.
Jan 2021 - Jul 2021
Technology Lead
Infosys
Led a cross-functional team of 4 engineers to deliver a multi-system automation solution for a UK-based enterprise client using Azure and .NET, resulting in significant operational cost savings.
Jan 2017 - Jan 2021
Technology Analyst
Infosys
Managed big-data applications on AWS using PySpark. Delivered end-to-end data analytics on Azure using C#, Scala, ADF, Databricks, and Power BI. Established CI/CD pipelines reducing release cycle time by 50%.
Oct 2015 - Dec 2016
Senior Systems Engineer
Infosys
Developed SQL automation scripts for temp table usage across ~150 stored procedures. Led code reviews and produced executive-level business reports.
Oct 2013 - Sep 2015
Systems Engineer
Infosys
Delivered enterprise solutions using C#, SQL, and MS Dynamics CRM for multinational clients. Gained foundational expertise in agile delivery and Microsoft enterprise technologies.
Let's Connect
I'm open to Staff/Principal Data Engineer, Data Engineering Lead, and Data Architect roles with global-scope impact. Feel free to connect on LinkedIn, or send me an email and I'll be sure to get back to you.