Senior AI Engineer
Forward Deployed AI Infrastructure Specialist
Taking AI solutions from business problems to production-grade systems inside client VPCs, air-gapped networks, and Kubernetes GPU clusters.
11 Real Systems
Local Codebase Repos
100% Private
Air-Gapped & On-Prem
vLLM & Rust
GPU Inference Engine
Full Lifecycle
Problem → Cost Opt
The Complete Enterprise AI Pipeline
Data Ingestion
OCR, Parsing, Chunking, Embeddings
Model Engine
Open-Weight LLMs, vLLM, Fine-Tuned LoRA
AI Application
Agents, RAG, Typed Tool Calling
APIs & Gateways
FastAPI, Semantic Router, Rate Limiter
Enterprise Systems
Core Banking, ERP, CRM, Identity
Kubernetes Cluster
GPU Autoscaling, vLLM Node Pools
Cloud & On-Prem
Private VPC, Air-Gapped Datacenters
Monitoring & Tracing
OpenTelemetry, Self-Hosted Evals
Alerts & Governance
Hallucination Checks, Drift Detection
Cost Optimization
Semantic Caching, Quantization
Kiran Machha
Senior AI Engineer | Forward Deployed Engineer
Singapore · Founder @ KaviAI
Embedding inside customer teams to ship Sovereign AI that works inside their walls.
As a Senior AI Engineer & Forward Deployed Engineer (FDE), I sit inside customer engineering repos, infrastructure clusters, and compliance reviews to build, deploy, and scale AI systems.
My specialism is Sovereign AI & Private On-Premises Infrastructure — tuning and serving open-weight models (Llama 3, Qwen2, DeepSeek, Mistral) in private VPCs, air-gapped data centers, or local GPU nodes for banks, healthcare systems, and regulated enterprises.
From fine-tuning open weights to containerized vLLM serving, hybrid vector retrieval, agent tool calling, and Kubernetes GPU scaling — I deliver fully operational AI systems with complete cost optimization and self-hosted observability.
11 Featured Production Systems
Click any project card to open an interactive deep dive into its architecture flow, API endpoints, performance metrics, and tech stack.
ODS — Osmantic Deployment System
Turn your PC, Mac, or Linux box into a self-hosted private AI server with a single command
A self-hosted AI deployment platform built around 24 bundled Docker service manifests, hardware-accelerated overlays (NVIDIA, AMD, Apple Silicon, Intel Arc), a control dashboard, LiteLLM gateway, RAG pipeline, local voice STT/TTS, and privacy tools.
KaviAgent — Local-First Personal AI Assistant
Local-first personal assistant with SQLite memory state, local web cockpit, and 95-line plain Python loop
A local-first personal AI assistant framework demonstrating the four pillars of serious agents: Harness, Reasoning Loop, Stateful Memory (SQLite), and LLM-as-Judge Evals. Features a local web dashboard cockpit at localhost:7777.
KaviSpace — Tauri v2 Multi-Agent Desktop & Swarm Platform
Desktop application with Tauri v2, xterm.js terminals, and KaviSwarm multi-agent pipeline
A Tauri v2 + Rust desktop application and multi-agent development environment that autonomously writes, builds, deploys, and live-demos full-stack applications through a three-phase AI swarm pipeline (KaviSwarm).
KaviAI — Growth & Multi-Channel Content Platform
AI agent platform planning, generating, and publishing content across 10+ platforms automatically
An enterprise AI agent platform for growth, marketing, and distribution. Uses Google Gemini with LiteLLM gateway and OpenAI fallback to automate SEO, Reddit, LinkedIn, X, Instagram, and YouTube publishing.
Agentic Coding Platform & Workspaces
Self-hosted AI development infrastructure for secure, governed agentic coding
A self-hosted developer platform providing containerized workspace environments, AI coding agents, and governance controls. Allows developers and AI agents to code side-by-side inside controlled sandbox environments.
Corporate Organization RAG System
Production-grade Retrieval-Augmented Generation for enterprise knowledge management
A complete corporate organization RAG system that ingests internal documents, enables hybrid search across organizational knowledge, and provides intelligent Q&A through agentic retrieval with LangGraph.
Bank Cheque OCR Automation
Handwriting-aware cheque processing with automatic fraud detection for regulated banking
A production-ready Bank Cheque OCR API automating the extraction and verification of critical information from scanned bank cheques. Designed for high-volume banking back-offices processing 5,000+ cheques daily.
Realtime Customer Service Voice Agent
Production-ready realtime voice agent for customer service call centers
A complete customer service voice agent system capable of handling inbound and outbound telephone calls with sub-second speech recognition, intelligent tool-calling responses, knowledge lookup, and conversation tracing.
n8n AI Agents & Workflow Automation Collection
Production-ready n8n automation workflows powered by AI agents for enterprise operations
A curated collection of 17 enterprise-grade n8n automation workflows integrating LLM agents, automated triage, email notification generators, IT ticket processors, and daily reporting systems.
Invoice OCR & Multi-Scale Processing Pipeline
High-throughput document parsing with vLLM, Rust API gateway, and async GPU queues
A multi-stage asynchronous invoice processing system engineered with vLLM vision model inference, a high-concurrency Rust API gateway, and async task queues for enterprise accounting teams.
PageBolt MCP Server for AI Coding Assistants
Model Context Protocol (MCP) server giving AI agents web capture, screenshots, and page inspection
An open-source Model Context Protocol (MCP) server connecting AI coding assistants (Cursor, Windsurf, Claude Desktop, Cline) to PageBolt capture APIs for screenshotting, PDF generation, and page inspection.
Business Problem → Production AI
Not just an AI developer. An FDE who owns the full lifecycle from initial business discovery to GPU cost optimization.
Business Problem
Identify workflow bottlenecks, regulatory constraints, ROI targets, and latency requirements.
AI Architecture
Design model strategy, open vs closed weights, vector storage, context windows, and safety barriers.
Development
Fine-tune open-weight models (LoRA/QLoRA), build RAG pipelines, typed agent tools, and evaluation harnesses.
Enterprise Integration
Connect models to ERPs, core banking APIs, CRM database queues, and OAuth/RBAC identity systems.
Deployment
Containerize with vLLM/Triton, deploy on Kubernetes, GPU autoscaling, and zero-downtime rollouts.
Observability
Self-hosted tracing, evals, hallucination monitoring, semantic logging, and token usage analytics.
Production Operations
Automated failover, load balancing, continuous eval gates, and human-in-the-loop fallback queues.
Cost Optimization
Semantic caching, model distillation, dynamic batching, and GPU node pool scale-to-zero.
Integrating AI Into Operational Systems
Models add value when integrated cleanly into business workflows, databases, and core APIs.
RAG
IntegratedVector Search
IntegratedOCR
IntegratedNLP
IntegratedVision
IntegratedVoice
IntegratedAI Agents
IntegratedPrediction
IntegratedForecasting
IntegratedAutomation
IntegratedOpen-Source & Self-Hosted Stack
Proven technology choices enabling enterprises to run AI models on-premises or in private clouds without third-party API dependencies.
AI/ML
11 ToolsLLM
10 ToolsAgents
6 ToolsInfrastructure
7 ToolsData
5 ToolsCloud
7 ToolsObservability
8 ToolsEnterprise Delivery Experience
From regulated banking change control to SaaS GPU platforms and forward-deployed client engagements.
Founder & Forward Deployed AI Engineer
KaviAI · kaviagentic.com
- Builds and deploys agentic AI systems with customers — multi-agent orchestration, tool calling, and self-correcting reasoning loops that survive real inputs.
- Runs the full LLMOps chain: serving, gateway routing, evaluation harnesses and observability, so quality regressions are caught before customers find them.
- Ships production infrastructure on Kubernetes with GPU autoscaling, and publishes the patterns as open workshops.
AI Platform / LLM Ops Engineer
Enterprise SaaS
- Stood up the shared inference platform — model gateway, quota and usage-based billing, and semantic caching to hold cost per request down as traffic grew.
- Introduced evaluation gates into CI so prompt and model changes shipped on evidence rather than vibes.
- Moved batch and streaming inference onto autoscaling GPU node pools with scale-to-zero for off-peak hours.
Full Stack AI Engineer
Payments
- Delivered customer-facing AI features end to end — Next.js and FastAPI through to the retrieval and ranking layers behind them.
- Built hybrid search and RAG over transaction and policy corpora, with citation enforcement for audit trails.
- Hardened the path to production: async workers, idempotent retries and structured tracing across services.
Software Engineer — Enterprise Applications
Banking
- Built and maintained enterprise-grade applications under regulated change control, where a failed release is an incident report.
- Microservices and API platforms on Spring Boot and Node.js, containerised and delivered through automated pipelines.
- The grounding that makes the AI work deployable: security review, access control and data handling as defaults rather than afterthoughts.
Need a Senior AI Engineer or FDE?
Available for Senior AI Engineer, Forward Deployed Engineer (FDE), or Sovereign AI Infrastructure contracts and permanent roles across Singapore, APAC, and EMEA.