Certification Frontiers for Gaussian LoRA ↗
Characterizes when Gaussian posteriors around LoRA adapters admit informative PAC-Bayes certificates, and reduces their complexity without changing any prediction.
Research highlights
My research asks how much we can trust, prove, and explain about a learning system when labels, samples, or compute are limited. I study parameter-efficient adaptation of foundation models, evidence and evaluation for language-model systems, and decision-making with guarantees, building on earlier work in lightweight computer vision, medical imaging, and cloud computing.
Adaptation & guarantees
I study when parameter-efficient adaptation can be trusted, and what can be proven about it. My work characterizes when Bayesian low-rank adapters admit useful generalization certificates, and the exact conditions under which a prefix can stand in for a LoRA adapter inside a frozen attention head.
Questions I study
Characterizes when Gaussian posteriors around LoRA adapters admit informative PAC-Bayes certificates, and reduces their complexity without changing any prediction.
Exact, resource-capped tests for whether a continuous prefix can replace a low-rank adapter in a frozen attention head, through observability, realizability, and implementation conditions.
Evidence & evaluation
I study how language-model systems should decide whether they have enough evidence to answer, and how to certify a model update when trusted labels are scarce and the evaluator itself, such as an LLM judge, may drift over time.
Questions I study
Shows that deleting supporting passages leaks the label through memory size, proposes a size-matched construction, and studies a learned estimator that gates when an agent should answer.
A sequential certifier that lets past audits guide label collection while keeping release decisions valid under evaluator drift.
Prunes language-model text classifiers with a saliency score built for conformal prediction, aiming for smaller prediction sets that keep their coverage guarantee.
Learning & decisions
I work on sequential decision-making that is reliable and transparent: contextual bandits that exploit graph structure, with a simple diagnostic that shows in advance when the method will help; bandits that meet exact exposure floors that can be checked in every period; and approximate behavioral-similarity metrics for Markov decision processes that report checkable bounds on their own error.
Questions I study
Projects arm features onto a graph's low-frequency spectral subspace, with regret bounds that depend on the reduced dimension rather than the full one.
Treats exact minimum-exposure floors as a rounding problem, meeting every floor while matching the minimax regret rate.
Uses approximate nearest neighbors to compute bisimulation metrics in sub-quadratic time, with computable two-sided certificates on the result.
Environment & agriculture
My earlier work built lightweight deep learning models for real-world vision problems under limited compute, from estimating local air quality with smartphone photos to identifying plant leaf diseases.
Questions I studied
Estimates a location-specific aggregated air quality index from smartphone-captured images with an efficient deep convolutional network.
A limited-resource deep convolutional network for identifying plant leaf diseases.
Healthcare AI
I worked on medical image analysis through small architectural changes, such as a single involution layer before a CNN that improves classification and segmentation with a negligible number of extra parameters, along with polyp segmentation and eye-tracking-based autism classification.
Questions I studied
Adds a single involution layer before a CNN to improve medical image classification and segmentation with a negligible number of extra parameters.
Combines involution and convolution to classify eye-tracking patterns of children with autism spectrum disorder.
A bi-axial Mamba bottleneck for segmenting gastrointestinal polyps.
Distributed systems
I also worked on cloud systems for images: orchestrating image storage and retrieval across a cloud system, and content-based search inside object storage.
Questions I studied
Orchestrates image retrieval and storage across a cloud system.
A content-based searching approach for object storage systems.
A connected agenda
Each thread feeds the next: lean models and cloud systems made learning efficient where compute and bandwidth were scarce, reliability work asks what can be certified when labels or samples run short, and transparency comes from explainable models and guarantees that can be checked, or that hold back an answer when the evidence is not there.
See the complete publication record, including papers beyond these selected projects.
View all publications