SOLUTION ARCHITECT · 2026

Architecting data platforms that think at scale.

Abhishek Mishra // Solution Architect — Big Data Platforms & AI Systems

Eight years of building and running production data platforms — from Hadoop clusters and DevOps automation to Databricks lakehouses, governed Unity Catalog estates, and AI-powered data operations across AWS, Azure, and GCP.

Based in Bengaluru, India · Building at Sigmoid
lakehouse.live
Governance — Unity CatalogACTIVE
Deployment — zero-touch CI/CDACTIVE
Observability — end to endACTIVE
0

Years engineering platforms

0

Projects delivered

0

Clouds — AWS · Azure · GCP

0

Certifications

// What I do

Four disciplines, one platform mindset

I design and review architectures end to end — from the infrastructure that runs the platform to the AI systems that run on top of it.

Platform Engineering

Governed, cost-optimized lakehouse foundations — Unity Catalog, Databricks Asset Bundles, zero-touch CI/CD, Kubernetes, and infrastructure as code across Azure and GCP.

Data Engineering

Medallion architectures at TB scale — Delta Lake, declarative pipelines, Autoloader, Spark optimization, and orchestration with Airflow and Azure Data Factory.

Data Operations

Reliability as a discipline — observability, data freshness SLAs, incident runbooks, self-healing pipelines, and root-cause automation for production data estates.

AI Engineering

LLMOps and agentic systems grounded in real platforms — RAG over enterprise metadata, AI-assisted analytics with Databricks Genie, and governed GenAI delivery.

// The pipeline

Bronze → Silver → Gold

Like the data I work with, the career has been refined layer by layer — eight years at Sigmoid, from the terminal to the architecture board.

2018 — 2019BRONZE · RAW

Technical Support Engineer

Deployed and managed GCP and AWS Hadoop clusters running Spark ETL — scripting, monitoring, and keeping thousand-node estates alive 24/7.

2019 — 2021BRONZE · RAW

DevOps Engineer

Built and secured AWS Hadoop platforms at TB scale — zero-trust networking, bastion architectures, Grafana auditing, and PoCs that brought Delta Lake into the stack.

2021 — 2022SILVER · REFINED

DevOps Engineer II

Migrated Python pipelines to Databricks — ACID transactions, schema evolution, Delta optimization over billions of rows, and Airflow-orchestrated job clusters.

2023SILVER · REFINED

Senior Data Operations Engineer

Owned production reliability for enterprise data pipelines — performance, monitoring, and operational excellence across cloud data estates.

2024 — 2025GOLD · CURATED

Data Operations & Engineering Lead

Led delivery across data engineering and operations — team leadership, client-facing architecture, and platform modernization on Databricks, Azure, and GCP.

2026 — PresentGOLD · CURATED

Solution Architect

Designing and reviewing scalable, reliable architectures for big data platforms and AI systems — spanning platform engineering, data engineering, data operations, and AI engineering.

// The stack

Tools of the trade

Chosen per problem, governed by default.

Data Platform

DatabricksUnity Catalog Delta LakeApache Spark AirflowHadoop

Cloud & Infrastructure

AWSAzureGCP KubernetesTerraformDocker

DevOps & Delivery

GitHub ActionsAzure DevOps Databricks Asset BundlesCI/CD ELK StackGrafana

AI & Languages

PythonSQLShell GenAI / LLMOpsMLOpsRAG
"Obsessed with automation. Passionate about performance.
Focused on impact."

// Contact

Let's build something governed, scalable & smart

Open to collaborations, mentoring, and speaking engagements on platform engineering, DataOps culture, FinOps governance, and cloud-native data & AI practices.

Find me

Bengaluru, India — usually somewhere between a Databricks workspace and an architecture diagram.

Send a message

// opening your email app with the message pre-filled…