Machine Learning Engineer II · Microsoft

I build agentic AI systems and the large-scale data platforms they run on.

I'm Anshaj Khare — a machine learning engineer in Microsoft Cloud Supply Chain. I take systems from notebook to production: streaming data platforms, agentic services, and the tooling that makes both maintainable.

  • 16h → 1h

    Recommendation latency after replatforming the circular cloud engine

  • 400 hrs

    Saved per developer per year by the data orchestration framework

  • 100+

    Microsoft engineers mentored on building scalable AI agents

  • 4,000+

    Professionals upskilled through teaching and guest lectures

About

Notebook to production

I am a machine learning engineer working in Microsoft Cloud Supply Chain, where I design and ship agentic AI systems and the data platforms underneath them. Most of my work sits at the seam between research and production: taking something that works in a notebook and turning it into a service that runs reliably at enterprise scale.

Over the last few years that has meant replacing a 16-hour batch pipeline with a streaming platform that answers in under an hour, building an orchestration framework that removes hundreds of hours of pipeline plumbing per engineer per year, and putting real agentic systems in front of both internal services and end users.

Outside of work I write The Compute Blog, build side projects to scratch my own itches, and teach — around four thousand engineers and leaders so far, on agentic AI, generative AI, and machine learning.

Selected work

Things I've built

Side projects and open source where I get to make the architectural calls end to end.

  • Open source8 stars on GitHub

    MCP Boilerplate

    A reference implementation for the Model Context Protocol — a working starting point for wiring tools and resources into an MCP server.

    • Python
    • MCP
  • Open source3 stars on GitHub

    A2A Boilerplate

    A demonstration of the Agent-to-Agent protocol, showing how independent agents discover each other and collaborate on a task.

    • Python
    • A2A protocol
  • Open source

    RAG App

    A template for building a scalable retrieval-augmented generation system, structured for production rather than for a demo notebook.

    • Python
    • RAG
    • Vector search
  • Open source6 stars on GitHub

    Python Frameworks

    A curated tour of powerful Python frameworks across web, data and ML, each with a runnable example — a map of the ecosystem for engineers deciding what to reach for.

    • Python
  • Collaboration

    Omdena — Student Debt

    Worked as a machine learning engineer on Omdena's open collaborative platform, on a project studying the social and financial implications of student debt in the United States.

    • Python
    • Machine learning

Experience

Where I've done the work

Eight years across machine learning engineering, data platforms and cloud infrastructure.

  1. Feb 2022 — Present

    India

    Current role

    Machine Learning Engineer II

    Microsoft

    Building agentic AI systems and the modern data platform behind Microsoft Cloud Supply Chain's circular cloud operations.

    • Agentic AI systems

      Designed, built and deployed multiple production agentic systems — both user-facing and service-to-service. Received the org-level CSCP Stellar Quest award for driving this end to end.

    • Platform modernization

      Led the migration of the legacy engineering system that acts as the brain of the circular cloud operation, replacing SQL-based batch processing with Apache Spark, Kafka streams, a data lake and FastAPI service layers. The V-Next system produces intelligent recommendations in about an hour, down from sixteen.

    • Data orchestration framework

      Built an event-driven framework that automatically creates, updates and deploys data pipelines and their supporting Azure resources — enabling high-scale enterprise ETL and saving roughly 400 hours per developer each year.

    • AI capability building

      Mentored and upskilled 100+ engineers through targeted programs on scalable AI agents and modern agent frameworks, driving organizational readiness for AI-native product development.

    • ML platform for Lean Six Sigma

      Architected the backend and MLOps layer for an in-house Lean Six Sigma product, covering model deployment and OpenAI integration.

    • Python
    • Apache Spark
    • Kafka
    • Azure
    • FastAPI
    • Kubernetes
    • Agent frameworks
  2. Dec 2019 — Feb 2022

    India

    Machine Learning Engineer

    Tech9

    Shipped production ML services and cloud-native backends across fintech, SEO and e-commerce clients.

    • ML models in production

      Built and deployed a transaction-classification service for a fintech product, containerized and served on AWS SageMaker, plus a spam-backlink detection model for an SEO business.

    • Serverless GraphQL API

      Developed a complete serverless GraphQL backend deployed on Google Cloud Functions.

    • Distributed ETL

      Implemented distributed ETL pipelines on Cloud Composer (managed Apache Airflow) and designed the relational schema for an e-commerce platform from the ground up.

    • Delivery engineering

      Designed CI/CD pipelines for reliable deployment to GCP, and built resilient web scrapers for marketplace data collection.

    • Python
    • GraphQL
    • AWS SageMaker
    • Google Cloud
    • Airflow
    • Docker
  3. Dec 2017 — Nov 2019

    India

    Data Engineer

    Octathorpe Web Consultants

    Modernized an analytics stack from spreadsheets to a cloud-native pipeline on Google Cloud.

    • Google Cloud migration

      Migrated the analytics stack to GCP for reliability and consistency, with tighter BigQuery integration.

    • From Excel to Python

      Moved analytics processes off Excel — first to R, then to Python — automating data extraction and powering visualization dashboards.

    • Event ETL

      Built ETL pipelines to process user event data into relational stores backing the dashboards, along with Python mailers and notifiers that improved data visibility across the organization.

    • Python
    • R
    • BigQuery
    • Google Cloud
    • SQL

Recognition

Named for the work, not the title

Two awards I'm proud of — one for putting AI agents into production, one for teaching.

  • Microsoft Cloud Supply Chain Stellar Quest Award certificate for AI Agents, awarded to Anshaj Khare.

    Microsoft · 2026

    Cloud Supply Chain Stellar Quest Award

    AI Agents

    Celebrating those who propel our Cloud Supply Chain into the AI-driven future by development of AI agents.

    Presented by the Corporate Vice President for Cloud Supply Chain, for designing and shipping agentic systems that went into production use.

  • Interview Kickstart All Rounder Instructor certificate awarded to Anshaj Khare.

    Interview Kickstart · 2025

    All Rounder Instructor

    For his outstanding contributions in teaching, mentoring, and guiding learners with excellence, dedication, and impact.

    Awarded by the founders for teaching across the full curriculum, from Python fundamentals through applied machine learning.

Teaching & speaking

Explaining is part of the job

I've taught roughly 4,000 engineers and leaders — the fastest way I know to find the holes in your own understanding.

  • Technical Instructor

    Interview Kickstart · Nov 2023 — Present

    I teach working engineers preparing for senior roles at top technology companies, covering the full path from Python fundamentals through applied machine learning.

    • Python
    • Machine learning
    • Deep learning
    • Data analytics
  • Guest Lecturer & Mentor

    Industry programs

    I run technical programs for audiences ranging from individual software engineers to executive leadership across multiple organizations, translating fast-moving AI research into decisions teams can act on.

    • Agentic AI
    • Generative AI
    • Machine learning
    • Software engineering
  • AI Enablement

    Microsoft

    Inside Microsoft I designed and delivered the technical programs that took 100+ engineers from curiosity to shipping agentic systems, building the organizational readiness for AI-native product development.

    • Agent frameworks
    • Evaluation
    • Production AI

Toolbox

What I reach for

Tools I've shipped production systems with, not just read about.

Languages
  • Python
  • Go
  • SQL
  • TypeScript
  • R
AI & machine learning
  • Agentic systems
  • LLM applications
  • MCP
  • RAG
  • MLOps
  • Spark ML
  • scikit-learn
  • PyTorch
Data platform
  • Apache Spark
  • Kafka
  • Airflow
  • Data lakes
  • Streaming ETL
  • Pipeline orchestration
Cloud & infrastructure
  • Azure
  • Google Cloud
  • AWS
  • Kubernetes
  • Docker
  • Serverless
  • CI/CD
  • Unix
  • Git
Data stores
  • PostgreSQL
  • MySQL
  • SQL Server
  • MongoDB
  • BigQuery
  • Azure Data Explorer
  • ADLS
  • HDFS
  • SQLite

Certifications

Verified credentials

A sample of formal training in cloud, data engineering and machine learning.

  • AWS Certified Developer — Associate

    Amazon Web Services

    Developing, deploying and debugging cloud-based applications on AWS.

  • Data Engineering, Big Data and Machine Learning on GCP

    Google Cloud · Coursera

    Five-course specialization.

    Verify
  • Advanced Data Science with IBM

    IBM · Coursera

    Four-course specialization.

    Verify
All certifications