Nilesh Sarkar

Principal AI Researcher · Interpretability · Knowledge Distillation · World Models · AI × Science

Currently Founding Principal AI Researcher at Erdős AI Lab, working on mechanistic interpretability, knowledge distillation, world models, and AI × Science.

Nilesh Sarkar - Principal AI Researcher
01

Research projects

Language Modeling Experimentation Experiments

Fine-tuning 0.5B-7B LLMs with QLoRA and 4/8-bit quantization, deployed on Jetson Nano. Active threads: diffusion language models and aggressive compression (PTQ/QAT/AWQ/GPTQ/pruning) feeding Indic text generation.

LLM Efficiency PyTorch CUDA Diffusion LMs Quantization Indic NLP

Interpretability Experiments & SAEs Experiments Erdős AI Lab

Mechanistic interpretability with SAEs: attention circuits, feature attribution, and the full SAE gallery from the KD paper. See the gallery.

Mechanistic Interpretability SAEs PyTorch

Medical AI: PCOS Detection Research PCOS

Benchmark of 18 vision architectures on PCOS ultrasound. A hybrid CNN-ViT hit 99.81%; a three-stage dedup pipeline cleaned 70% of the public dataset. Read more.

Medical AI Computer Vision ViT PyTorch

AI × Bio: Protein Folding Experiments Erdős AI Lab

Four results on one A100: a 1 µs chignolin fold, titin I27 force-pulling, an 8-protein ESMFold sweep in 12.9 s, and ESMFold calibration. Read more.

Computational Biology Structure Prediction PyTorch

Autonomous Drone Systems (AIR) Research Group

Real-time computer vision for object detection and autonomous navigation in complex environments.

Robotics Computer Vision UAV

Project Humanoid Robot Research Project

Teleoperated robotic arm with low-latency control for precise manipulation in semi-structured environments.

Teleoperation Robotics Control Systems

Building Axiom Venture

Precision parametric CAD engine with machine-readable proof of correctness attached to every exported file.

Generative 3D CAD AI Parametric Design PyTorch
02

Research experience

Erdős AI Lab: Founding Principal AI Researcher Research

Knowledge distillation, representation learning, world models, and mechanistic interpretability. EF-backed, incubated at IIT Bombay. Read more.

AI Research Representation Learning Knowledge Distillation Interpretability

Moog Controls: Applied AI Research Intern Internship

Air-gapped agentic RAG, document intelligence, an internal MCP server, gesture recognition, and supply-chain AI for aerospace. Read more.

RAG Agentic AI MCP Computer Vision

Undergrad Student Researcher, DSU Department

Department-led research across language models, autonomous drones, humanoid robotics, and medical AI. See all DSU work.

LLMs Drones Humanoid Robotics Medical AI

Humans Care Foundation: Python Developer Intern Internship

Built a portfolio of 24 Python projects: data visualisations, Tkinter GUIs, and an end-to-end chatbot, with project management on GitHub and Notion.

Python Tkinter Chatbot
03

Leadership, community & ventures

Erdős AI Lab: Founding Principal AI Researcher Venture

Student-founded lab on knowledge distillation, world models, and frontier AI. Funded and trusted by Entrepreneurs First (EF); incubated at IIT Bombay. Read more.

AI Research Representation Learning Knowledge Distillation

E-Cell DSU: Tech Lead Leadership

Leading tech initiatives for entrepreneurial ventures: overseeing infrastructure and bridging business ideas with technical solutions.

Roboverse & IET DSU: Core Committee Member Community

Core Committee, Institution of Engineering and Technology (IET) DSU chapter and the Roboverse student community; ran 10+ tech talks, workshops, and hackathons bridging theory with practice in AI and robotics.

IEEE DSU SBC: Executive Committee, RAS & CIS Leadership

Executive Committee, IEEE RAS and IEEE CIS at DSU. 50+ workshops, talks, and hackathons. RAS & CIS Exceptional Volunteering Award, 2025, given to the top 10% of undergraduate researchers at the university.

05

Education

Dayananda Sagar University, Bangalore B.Tech

Artificial Intelligence and Robotics Engineering (2023-2027). Designed the LLM Engineering curriculum and lab manuals featured on the university website.

Computer Vision LLM/ML/AI Deep Learning Robotics Transformers
08

Get in touch

I'm always open to discussing research, engineering challenges, or just chatting about the future of AI.