Hello, I'm Amit.

Senior Data Engineer with 12+ years building enterprise-grade data platforms across cloud-native environments. Deep expertise in Databricks, PySpark at scale, and Azure data services.

I can help you with:

  • Data Platform Architecture
  • Databricks & PySpark at Scale
  • Azure & AWS Cloud Services
  • CI/CD & DevOps Pipelines
  • Technical Team Leadership
Connect on LinkedIn

Check out my projects

My Projects

Here are some of the data platforms and solutions I've built across Databricks, Azure, and AWS.

D
Databricks DLT Streaming Platform Platform-wide transition from daily batch to near real-time streaming using Delta Live Tables, reducing data freshness from 24h to 15 minutes.
P
PII Masking & GDPR Compliance Designed Databricks PII masking/unmasking workflows ensuring GDPR compliance across sensitive enterprise data assets at scale.
A
AWS Event-Driven Pipeline Built serverless event-driven pipelines using AWS Lambda, SQS, and SNS, improving fault tolerance and reducing failure rates by 20%.
A
Azure Knowledge Mining Platform In-house platform integrating Azure Cognitive Search, Cognitive Services (NLP, CV, Sentiment), and Azure Functions for insights from unstructured data.
M
Multi-System Automation Cross-functional team delivery of a multi-system automation solution for a UK-based enterprise client using Azure and .NET.
C
CI/CD Pipeline Modernization Databricks Asset Bundles via Azure DevOps, cutting manual deployment effort by 20% and reducing release-related incidents.
View All My Projects

Some of my writing

My Writings

I write about data platform architecture, Databricks, PySpark, and building reliable data engineering systems.

Building High-Performing Data Engineering Teams

Lessons from leading data engineering teams across Databricks, Azure, and AWS environments.

Posted on June 20, 2026

Technical Strategy for Data Platform Scaling

How to approach architectural decisions when building enterprise-grade data platforms.

Posted on June 15, 2026

Developer Experience in Data Platforms

Why developer experience matters for data engineering teams and how to improve it.

Posted on June 10, 2026
View All Posts
✦ Amit Channagiri

© 2026 Amit Channagiri

LinkedIn X GitHub Email