Devanshu Chicholikar, Software Engineer, AI Engineer and Forward Deployed Engineer (MCP servers, RAG, evals, voice agents)
Open to Software Engineer, AI Engineer and Forward Deployed Engineer roles. Based in Boston, MA.
Hey! I ship AI systems to production end to end: MCP servers, RAG with retrieval evals, LLM-as-a-judge eval harnesses and voice agents, plus the full-stack, infra and design work around them. OpenCodeIntel is a code-search platform for AI coding agents (web app, API and MCP server), and Overhear grades every call a voice agent takes: code checks the call log, and an LLM judge checks what the agent said against the clinic's real open slots. MS Software Engineering Systems from Northeastern, finished May 2026.
Before that I spent two years full-time building a Java / Spring Boot quotation platform, and TA'd Network Structures & Cloud Computing for 100+ grad students across two semesters. Teaching set my bar: if I can't explain it at 11 PM to someone whose AWS setup is on fire, I don't understand it yet.
Projects
OpenCodeIntel: Code-search platform for AI coding agents: vector search fused with BM25 keyword scoring and reranking, tree-sitter AST chunking, a web app, a REST API and a 12-tool MCP server.
Overhear: AI QA analyst for voice agents: grades every call a Retell scheduling agent takes. Code checks what the call log proves, and an LLM-as-a-judge checks what the agent said against the clinic's real slots.
CallBudget: Active-sensing pharmacy search: predict which pharmacy most likely has a hard-to-find drug, rank who a voice agent should call first, and learn from every answer. Tested on a simulated pharmacist with real pharmacy data.
Saar: Chrome extension that tracks Claude.ai token usage and cost in real time, entirely in the browser. Published on the Chrome Web Store.
Portfolio OS: A desktop operating system in a browser tab: window manager, terminal and dock, built from scratch.
saar CLI: Statically analyzes a codebase and generates agent context files (AGENTS.md, CLAUDE.md, .cursorrules). Published on PyPI.
Financial Copilot: AI expense tracker with automatic categorization, category budgets, spending insights and a daily safe-to-spend figure.
SecureScale: SecureScale is a fully automated AWS infrastructure setup.
watsonx Test Forge: IBM watsonx Orchestrate hackathon. The problem: manually authoring Journey Success test cases for watsonx agents is tedious and error-prone. Test Forge is a multi-tool agent that reads deployed agent specs and generates validated test cases automatically.
Tool Crowding Benchmark: When an agent has dozens of MCP tools loaded, does it start picking the wrong one? Tool Crowding is a harness built to measure that cleanly, with the design and its hypotheses pre-registered before any data.
Mem Machines: Mem Machines is a serverless data ingestion pipeline built entirely on GCP: Cloud Run, Pub/Sub and Firestore working together on high-throughput data streams.
Campus Resources: A clean, searchable directory of campus resources that cuts through the maze of services, tools, and support systems on campus.
Claude kept guessing about my code. So I built it a map.: Why I built OpenCodeIntel: Claude Desktop kept making things up about my repo, and new teammates had no map either. What I built, what the research found, and what production taught me.
Experience
Graduate Teaching Assistant, CSYE 6225 Network Structures and Cloud Computing, Northeastern University, Sep 2025 - May 2026
Software Development Engineer Intern, Pitney Bowes, Jan 2022 - Jul 2022
Skills
AI-Assisted Development: Claude Code (subagents, hooks, custom skills), MCP server development, Agentic workflows, Spec-first development with AI agents, LLM evals, Cursor