N.A.lab notebookvol. 2026, Nishanth Antony, back to top

Fig. 00 / subject  ·  AI/ML engineer, Bengaluru

Nishanth Antony.

I build AI that has to work on Monday: vision-LLM graders that land within one mark of the teacher, agents that chase failed payments and get re-scored when the demo was circular, and the unglamorous backend underneath. Unfamiliar stack? I learn it on the way.

Fig. 00b / learning ledger[SINCE 2024]

every stack I picked up because something had to ship. 19 in two years, about one every six weeks.

2026-10 · 16 / 16

Postgres row-level security

because one school's fees are not another school's business. Kwilo admissions and fees.

Fig. 01 / shell [LIVE]
nishanth-lab shell 1.0. type , or tap a command.
try:

tab completes · ↑↓ history · esc leaves

location
Bengaluru, IN · UTC+5:30
availability
[OPEN TO: AI/ML ROLES, 2027]
current focus
Kwilo AI · PayRecover-Jev · Paylock
last updated
§01 / work

Selected work

6 entries. each states the problem, the approach, the result, and what it cost me to learn.

Fig. 02 / project / 2026[SHIPPED]

Kwilo AI · production research

Vision-LLM exam grader

problemMarking handwritten university scripts eats teachers' evenings, and a model that is two marks off per subpart is worse than no model.

approachScanned PDF to page images, pages mapped to each subpart, then a vision LLM reads the marking scheme plus a few teacher-marked exemplars. Benchmarked GPT-5.4 Mini, Gemini 3 Flash and 3.1 Pro over 4 subjects and 11 test cells.

  • python
  • azure openai
  • vertex ai
  • pymupdf
  • uv
  • matplotlib
pooled MAE, marks per subpart (few-shot subparts)
0.855
error vs zero-shot, GPT (1.259 to 0.910)
−28%
subparts within ±1 mark of the teacher
81.7%
what I learnedExemplars beat model size: few-shot Flash (0.890) beat zero-shot Pro (1.195). And a harness that writes run manifests is worth more than any single prompt tweak, because it turns "feels better" into a number.
show the pipeline
Pipeline: scanned PDF, page images, subpart page map, prompt builder, vision LLM, marks with evidence, metrics against held-out teacher marks scanned PDFanswer script page imagesrendered subpart map2a -> pp. 2-4 promptrubric + exemplars vision LLMgpt / gemini marks + evidenceJSON per subpart metricsMAE, ±1, QWK teacher marksground truth dashed: never shown to the model, used only for scoring
Fig. 02a. One subpart per call in the subparts pipeline; that variant had zero script failures.
Fig. 03 / project / 2026[SHIPPED]

Razorpay · v1 buildathon, then Jev · 2026

PayRecover-Jev

problemA failed UPI or card payment can't be silently re-charged. Merchants either spam the customer or lose the sale.

approachv1: rules diagnose, Gemini sees the ambiguous cases, every action passes a policy gate. The demo score was circular, eight sentences the rules already knew. Jev is the second build: rules, a keyword baseline, then a typed decision with probabilities. Thresholds freeze on train. The number comes from a held-out test split. Gemini is the comparison arm, not the authority.

  • python
  • razorpay api
  • jev
  • gemini
  • sqlite
  • pytest
expected calibration error, Jev vs Gemini 0.189
0.059
held-out cases. accuracy intervals overlap, so this is not an accuracy claim
166
high-confidence errors on ambiguous, Jev. Gemini had 2
0
what I learned87.95% vs 80.72% looks like a win, and the Wilson intervals overlap, so the number I publish is calibration. On conflicting fields Jev is 0/11 because it trusts the structured error reason. That is in the README on purpose. v1 still recovered 31.3% of failed value on 80 seeded cases, one dry run.
show the loop
Loop: failed payment, diagnose, policy gate, act, all steps written to an append-only audit log; act loops back to diagnose on the next tick next tick failed paymentrazorpay diagnoserules, then Jev policy gatecaps, kill switch actlink / remind / stop audit log: append-only, one corr id per case
Fig. 03a. Jev sits inside "diagnose". It never gets to skip the gate.
Fig. 04 / project / 2026[IN PROD]

Kwilo AI · Apr–May, Jul 2026–now

Shipping on an AI learning platform

problemSchools run exams, fees and admissions on this product, so a bug costs real money or leaks a real parent's phone number.

approachAnswer sheets auto-matched to students (filename first, then header OCR, never blocking the upload). A public blog stack end to end. Fee receipts with race-safe installment settlement. Admissions with a primary guardian and a one-page A4 form.

  • fastapi
  • sqlalchemy async
  • postgres + RLS
  • alembic
  • react 19
  • typescript
  • tanstack query
  • gemini
uploads blocked when OCR can't read a sheet
0
product areas: exams, content, blog, fees, admissions
5
guardians per admission, one becomes the parent login
2
what I learnedA self-reported phone number is not proof of identity, so admitting a student now asks staff before linking a parent account. And lock the row before two payments settle the same installment milliseconds apart.
Fig. 05 / project / 2026[SHIPPED]

Clocked hackathon · with Nikhil

Paylock

problemAn invoice can say the chef approved the extra cases by phone. A model that reads the invoice, the purchase order and the dock note will treat the vendor's sentence as proof of itself.

approachThe pay button fires only if the purchase order and the receiving note agree. Clocked Decide may say PAY. The ledger can only turn that into HOLD, never the other way. I set the trust rule and the later holds. Nikhil and I built the app.

  • typescript
  • next.js
  • clocked
  • vitest
button verdicts on the synthetic bench
8/8
times the model said PAY and the ledger held
2
dollars the bad-math invoice tried to add
$91
what I learnedDecide was 100% sure the flour invoice should be paid. The lines add to $1,198 and the total says $1,289. The button stayed locked. A sentence on the invoice is not evidence for that invoice.
Fig. 06 / open source / 2026[OSS]

Intervues Club · open-aiops cohort · Apache-2.0

open-aiops governance

problemEnterprise LLM apps die on a single provider outage or a 429. Callers shouldn't rewrite code every time a model flakes.

approachI own governance/ in the open-source AI ops control plane: a model router that ranks providers by cost, latency and overload, walks a ranked list for failover on rate limits and timeouts, and retries with exponential backoff plus full jitter. Public PRs, reviewed by someone else.

  • python
  • pydantic
  • fastapi
  • pytest
  • circuit / failover
  • open source
merged PRs I own on governance
4+
modules: router, failover, retry, config import
4
real API keys in CI
0
what I learnedPer-request fallback must walk a ranked decision list. Marking a provider "overloaded" on shared router state would poison other in-flight requests. Small PRs with fake providers beat one giant "add LiteLLM" dump.
Fig. 07 / hackathon / 2026[SERVERPOD]

Serverpod hackathon · Lazy Monks · in progress

Dhātrī care companion

problemElders in India manage chronic meds while adult children live elsewhere. A missed dose at 8 PM shouldn't wait for the next family call.

approachFlutter app (patient / caregiver / doctor) on a Serverpod backend: prescription photo → Gemini draft schedule → human confirm → Future Calls for reminders and escalation → live caregiver alerts over WebSockets → Hindi voice check-ins (Sarvam STT/TTS) with pgvector patient memory.

  • serverpod
  • dart
  • flutter
  • postgres + pgvector
  • gemini
  • sarvam
  • websockets
roles on one typed client
3
AI smoke gates (extract + STT) green
5/5
prescriptions activated without caregiver review
0
what I learnedServerpod's auth, Future Calls, streams and pgvector map almost 1:1 to a care loop. The rule that kept the demo alive: mutate Postgres, then post a CareUpdate. AI drafts; humans confirm.
§02 / notebook

Lab log

smaller experiments, hackathons and write-ups. including the ones that didn't work.

Fig. 10 / notebook.log[SCROLL · 19]
Lab log of experiments and builds, newest first. About ten rows visible; scroll for the rest.
dateentrytagresult
2026-11PayRecover-Jev, held-out benchEVALv1's 8-sentence score was circular. Jev ECE 0.059 vs Gemini 0.189 on n=166. Accuracy intervals overlap. Conflicting fields: Jev 0/11, it trusts the structured reason.
2026-11Paylock, invoice gate (with Nikhil)HACK8/8 button verdicts. Decide said PAY at 100% on a total $91 high; the ledger held. The model may say pay. The dock decides.
2026Federated IoT anomaly detectorRESEARCHFedProx 0.98 AUC. The instability was a shard bug, not the optimizer. progress report. IEEE paper in preparation.
2026-10Dhātrī, Serverpod care companionHACKBE + AI final-ready: Future Calls, CareUpdate stream, Sarvam Hindi voice, pgvector memory. Flutter wiring next.
2026-10open-aiops governance (Intervues Club)OSSrouter, failover, retry with full jitter. public PRs merged into SupriyankaKharade/open-aiops.
2026-10w2v-BERT 2.0 vs Whisper-large encodersMLOOF 0.9346, best so far. public LB didn't move; the changes landed in the private split.
2026-09Fine-tuning Whisper-large on 826 clipsMLlost to a frozen probe, 0.904 vs 0.925. overfits by epoch 5.
2026-09Face-tracking water gunIOTMediaPipe face centre to pan/tilt angles to two ESP32 servos. shoot is still a stub.
2026-07AssetFlow, 8-hour hackathonHACKowned the asset track: registry, allocation state machine, transfers, overdue flagger.
2026-05Gemini 3.1 Pro vs 3 Flash, zero-shot gradingEVALFlash wins File Structures by 0.42 MAE, loses Math by 0.54. no free lunch.
2026-05Sarvam document OCR as a grading front-endEVALbenchmarked, then removed. documented why so nobody re-tries it blind.
2026-04Kannada name generator, char-level GRUMLloss 2.08 to 1.41 over 10k epochs. some names are real, most are merely plausible.
2025-12OWASP Top 10 lab seriesSEC17/17 PortSwigger labs written up. the README updates itself via Actions.
2025-11DFA-based intrusion detection, from scratchSECSnort-style rules compiled to a DFA plus PCRE, TCP reassembly, live dashboard.
2025-11Zero-knowledge medical records vaultSECAES-256-GCM with RSA-OAEP key wrap in the browser. the server only ever sees ciphertext.
2025-09Samudra Prahari, Smart India HackathonHACKoffline BLE-mesh hazard reports with image verification before broadcast.
2025-08REINFOSEC CTF sprintSEC100+ challenges in 8 weeks. TryHackMe top 2%.
2025-05Green Quest, Social HackathonHACKadopt a plant on a map, AI-verified care quests, and a plant you can chat with.
2024-10Green Terrace, BuzzOnEarth @ IIT KanpurHACK3rd place. first podium, first all-nighter that paid off.
§03 / about

About

the readable version of the resume.

about.md · utf-8 · lf[README]

I'm Nishanth. I build LLM systems that have to be right, then the boring code that keeps them right.

Final-year computer science at Bangalore Institute of Technology (IoT, cybersecurity and blockchain track, CGPA 8.50). AI/ML intern at Kwilo AI since April 2026, with a two-month break in the middle, working on answer-script grading and the product around it.

## how I work

I don't pick a lane. I pick a problem and learn whatever lane it lives in. In two years that has meant:

  • 100+ CTFs to learn how web apps break (REINFOSEC, 2025)
  • Spring Boot to learn how they're built (Goloka IT, 2025–26)
  • LangGraph, to make an agent investigate instead of autocomplete
  • vision LLMs and an eval harness, to grade handwriting against teachers
  • Soroban, to store a notepad on the Stellar chain, mostly to see if I could
  • servo trigonometry, to aim a water gun at faces (it misses less now)
  • Postgres row-level security, because one school's fees are not another school's business
  • a second eval, when the first score was eight sentences the rules already knew

## currently

  • shipping ERP and AI features at Kwilo
  • PayRecover-Jev: typed diagnosis for failed payments, calibration published, accuracy claim withheld
  • Paylock, with Nikhil: the model may say PAY, the ledger can only hold
  • open-source contributor on open-aiops (Intervues Club): LLM provider routing, failover, retries
  • building Dhātrī for a Serverpod hackathon: Hindi voice care companion for elders
  • 290 LeetCode problems in, 253 of them in Java

## off the clock

Lazy Monks: four of us, 10+ hackathons, one podium (3rd at BuzzOnEarth, IIT Kanpur). First place at Turing Much, the college ML competition. Core member of cryptX, the college technical team.

Fig. A / subject[NO PHOTO]
photo: N/A. which are also my initials.
Fig. B / facts[VERIFIED]
based in
Bengaluru
graduating
Jul 2027
CGPA
8.50 / 10
LeetCode
290
TryHackMe
top 2%
certs
OCI GenAI Pro, APIsec ACP
§04 / skills

Skills, honestly

no logo wall. you can't grep a logo.

Fig. 11 / skills.txt[SELF-REPORTED]
Skills by domain and how often I use them
domain dailyused this week comfortableshipped it, no docs for basics dabblingshipped once, docs open
LLMs & agents
  • few-shot prompt design
  • Gemini on Vertex AI
  • Azure OpenAI
  • eval harnesses
  • Sarvam STT/TTS
  • LangGraph
  • LangChain
  • Jev
  • RAG with pgvector
  • AWS Bedrock
  • multi-agent loops
  • provider failover / retry
  • Clocked
  • Claude API
Models & data
  • pandas
  • NumPy
  • PyTorch
  • scikit-learn
  • Whisper / w2v-BERT probing
  • matplotlib
  • TensorFlow
  • OpenCV
  • MediaPipe
  • federated learning
Backend
  • FastAPI
  • SQLAlchemy async
  • PostgreSQL
  • Alembic
  • pytest
  • Serverpod
  • Flask
  • Spring Boot
  • REST
  • WebSockets
  • Postgres RLS
  • Supabase
  • Firebase
  • Prisma
Frontend
  • React
  • TanStack Query
  • Flutter
  • Tailwind
  • Vite
  • React Native (Expo)
  • vitest
  • Next.js
  • Phaser
MLOps & cloud
  • Git
  • Docker
  • CI on GitHub Actions
  • GCP Cloud Run + GCS
  • Kaggle GPU pipelines
  • uv
  • Azure Container Apps
  • AWS EC2 / S3
  • Cloudflare
Languages
  • Python
  • TypeScript
  • Dart
  • Java
  • SQL
  • Bash
  • C
  • C++
  • Rust (Soroban)
Security none right now (was daily in 2025)
  • Burp Suite
  • nmap
  • OWASP Top 10
  • API security
  • gobuster
  • sqlmap
  • hydra
  • hashcat
  • Scapy
  • Web Crypto
Fig. 12 / contact[OPEN]

Got a problem that has to work?

leetcode
u/Nish345
$ open mailto:nishanthantony5@gmail.com