// Resume
Abhishek Mishra
Solutions Architect — AI Solutions & Intelligent Data Platforms
Summary // PROFILE
I design scalable, governed data and AI platforms, with 8 years of experience evolving from hands-on data engineering into platform and solution architecture. My work spans the full platform lifecycle — data engineering, AI/ML enablement, and the operational foundations (DataOps, MLOps, LLMOps, AIOps) that keep enterprise platforms reliable in production.
Today I architect enterprise-grade AI solutions and intelligent data platforms on Databricks and Spark for global CPG and pharma clients, while bringing agentic systems into production to drive self-healing, zero-touch operations. Beyond the technology, I have led the intern-to-full-time journey end to end — hiring, technical assessment, training, mentorship, and conversion — helping new engineers grow into strong contributors.
Experience // SIGMOID · 8 YRS
Solutions Architect
Architecting enterprise-grade AI solutions and intelligent data platforms, and reimagining platform engineering with agentic systems. Own the design of scalable, resilient platforms spanning data engineering, AI engineering, and DataOps — embedding governance, observability, and automation, and leveraging agentic AI to drive self-healing, zero-touch operations for global CPG and pharma clients.
Data Operations & Engineering Lead
- Led a team of 18+ engineers, owning delivery across the full data lifecycle — from ingestion and pipeline reliability to production support and platform governance.
- Drove a large-scale platform modernization on Databricks (Unity Catalog, Delta Live Tables, Asset Bundles), establishing governed, observable, production-grade standards.
- Built the team from the ground up — defining hiring bars, onboarding engineers, and shaping the technical practices that scaled delivery.
- Introduced GenAI and LLMOps into operational workflows, applying LLMs and agentic patterns to improve automation, triage, and self-healing.
- Partnered with L&D to design and run a structured intern-to-full-time program — mentoring, assessing, and evaluating 40+ interns through hiring, training, and conversion.
Senior Data Operations Engineer
- Designed and operated production pipelines on Databricks, applying data modeling and engineering best practices to improve reliability and maintainability.
- Implemented security architecture and access-governance controls across data platforms, strengthening compliance and auditability.
- Drove automation across operational workflows, reducing manual intervention and improving pipeline stability and recovery.
- Mentored junior engineers, establishing standards that raised the quality bar for pipeline development.
DataOps Engineer II
- Migrated Python pipelines to Databricks to leverage ACID transactions, schema evolution, merge/update/delete DML, scalable metadata, and delta-log auditing.
- Optimized PySpark and Delta workloads over billions of rows using partitioning, OPTIMIZE, and time travel.
- Orchestrated Databricks jobs from Airflow using job and all-purpose clusters; managed AWS web servers with performance monitoring.
DataOps Engineer I
- Set up and managed AWS Hadoop clusters running TB-scale ETL pipelines for multiple customers.
- Implemented zero-trust security, bastion-host architecture, and Grafana-based log auditing with continuous monitoring.
- Ran PoCs that brought new technology into the stack — Alluxio caching, Databricks Delta Lake — and deployed Hadoop, Kubernetes monitoring, and GitLab estates.
Associate DataOps Engineer
- Deployed and managed GCP and AWS Hadoop clusters running Spark ETL jobs.
- Wrote scripts to manage and monitor thousand-node clusters running 24/7 real-time pipelines.
Skills & tools // STACK
Data & AI Platform
Agentic AI & ML
Cloud & DevOps
Languages & foundations
Leadership & people // BEYOND TECH
I lead a team of 18+ engineers, and in partnership with the L&D team I have driven the intern-to-full-time journey end to end — mentoring, assessing, and evaluating 40+ interns from hiring and technical assessment through structured training to full-time conversion, helping them enter the organization, build confidence, and grow into strong engineers.
Education // FOUNDATIONS
B.E. Computer Engineering — 77%
University Institute of Technology, The University of Burdwan
Languages // SPOKEN
English (Full Professional) · Hindi (Native / Bilingual) · Bengali