Anup Jadhav

Staff Applied AI Engineer

whoami

Staff Applied AI Engineer building AI agent systems that hold up in production: multi-agent orchestration, durable workflows, RAG and MCP/A2A.

Anup Jadhav

About Me

👋🏽 I'm Anup, a Staff Applied AI Engineer. I build AI agent systems that hold up in production, including in enterprise and defence settings. My work spans multi-agent orchestration, durable workflows, RAG and LLM application engineering, using LangGraph, Temporal and LlamaIndex, and protocols like MCP and A2A.

I write about what I learn in The AI Engineering Brief, including a series on running multi-agent systems in production: failure modes, observability, retries, and the unglamorous middleware nobody demos. X/Twitter/Bluesky: @anup.

Writing

Latest from The AI Engineering Brief. Engineering notes that ship.

What is Jev? A Simple Primer on AI That Makes Decisions

Most of the AI we encounter today is designed to generate things: text, images, code, answers. Jev, a new model from former OpenAI researcher Diogo Almeida, is…

Read More

TIL: The AI Wall

Very interesting HBR research/article on how Gen AI won't make employees experts in a domain or topic if they don't have the expertise or knowledge the task req…

Read More

Defining an AI Agent

Netflix's latest AI documentary, “The AI Doc", kicks off by lobbing the world's simplest question at a bunch of AI boffins: "What is AI?" You'd think thi…

Read More

Skills & Expertise

Generative AI

Large Language Models (LLMs), RAG Systems, LlamaIndex, LangChain, Fine-Tuning, Vector Databases, Knowledge Graphs, Text-to-Image Models

Agentic AI Architecture

Multi-agent Systems, Tool-using Agents, Autonomous Agents, Prompt Engineering, Orchestration Frameworks, Chain-of-Thought

AI Engineering

Python, PyTorch, Transformers, Hugging Face, Prompt Engineering, API Integration, LLM Deployment, Performance Optimization

AI System Design

Enterprise AI Solutions, Solution Architecture, Implementation Planning, ML Pipelines, Model Evaluation, Scalable Architectures

Enterprise Architecture

Multi-cloud Deployments, Systems Integration, Data Architecture, Cloud Strategy, API Development, Distributed Systems

Leadership

Technical Team Management, Mentoring, Strategic Planning, Executive Relationships, Cross-functional Collaboration, Technical Community Building

Featured Projects

Crisis Support Voice AI Agent

Prototype real-time voice agent for crisis support conversations. GPT-4o function calling drives its tools: grounding and breathing exercises, a safety assessment, and finding directions to the nearest hospital or police station with OpenStreetMap. Speech runs through Layercode (Deepgram STT, Rime TTS), with Twilio for phone calls and the backend on Cloudflare Workers.

Voice AI Tool Calling Cloudflare Workers

GitHub Code Explorer (MCP)

A Model Context Protocol tool server that lets an AI assistant search code across GitHub, read files, and find repositories. Tools are described with JSON Schema so a model can discover and call them, and a browser client simulates an assistant using them.

MCP Agent Tools Node.js

LLM VRAM Calculator

Interactive tool to estimate GPU VRAM required to serve large language models on self-hosted hardware. Supports DeepSeek-V3.1, Llama, and Mixtral across A100, H100, B200 and other enterprise GPUs, with breakdowns of model weights, KV cache, and runtime overhead at multiple precisions.

LLM Inference GPU Memory Self-hosting

Matrix-themed Chat Interface

Built an immersive Matrix-themed chatbot interface leveraging Heroku's AI inference and agent APIs. The project showcases modern AI capabilities while paying homage to the iconic film through its visual design and interaction patterns. Features include real-time message streaming, dynamic animations, and context-aware responses.

Heroku AI LLM Integration UI/UX Design

EfficientNetB2 Computer Vision Model

An EfficientNetB2 feature extractor computer vision model to classify images of food as pizza, steak or sushi. The model performs at 95%+ accuracy, and can classify an image at 0.03 seconds inference time per image.

CNN PyTorch Computer Vision

Vision Transformer (ViT) Paper PyTorch Implementation

Replicated the famous Vision Transformer paper using PyTorch to improve my understanding of Transformer architecture applied to vision problem(s).

LLM/Transformers Computer Vision PyTorch

Technical Publications

A collection of articles and publications about AI Agents, software architecture, engineering management, and technology. Focused on making complex technical concepts accessible.

Generative AI AI Agents Engineering

Get in Touch

Interested in collaborating or learning more about my work?