📝 Publications

2024

Anthony Sarah, Sharath Nittur Sridhar, Maciej Szankin, Sairam Sundaresan
LLaMA-NAS: Efficient Neural Architecture Search for Large Language Models
ECCV 2024.
[ECCV] [project] [code]

Shamik Kundu, Sanjay Das, Sayar Karmakar, Arnab Raha, Souvik Kundu, Yiorgos Makris, Kanad Basu
Bit-by-Bit: Investigating the Vulnerabilities of Binary Neural Networks to Adversarial Bit Flipping
TMLR 2024.
[TMLR] [project] [code]

Changhoon Kim, Kyle Min, Yezhou Yang
R.A.C.E.: Robust Adversarial Concept Erasure for Secure Text-to-Image Diffusion Model
ECCV 2024.
[ECCV] [project] [code]

A. Ramachandran, Souvik Kundu, Tushar Krishna
CLAMP-ViT: Contrastive Data-Free Learning for Adaptive Post-Training Quantization of ViTs
ECCV 2024.
[ECCV] [project] [code]

A. Ramachandran, Souvik Kundu, Tushar Krishna
GenQ: Quantization in Low Data Regimes with Generative Synthetic Data
ECCV 2024.
[ECCV] [project] [code]

Souvik Kundu, Sharath Nittur Sridhar, Maciej Szankin, Sairam Sundaresan
Sensi-BERT: Towards Sensitivity Driven Fine-Tuning for Parameter Efficient BERT
ICASSP 2024.
[ICASSP] [project] [code]

Sharath Nittur Sridhar, Maciej Szankin, Fang Chen, Sairam Sundaresan, Anthony Sarah
SimQ-NAS: Simultaneous Quantization Policy and Neural Architecture Search
Association for the Advancement of Artificial Intelligence (AAAI) 2024.
[arXiv] [project] [code]

Raj Ghugare, Santiago Miret, Adriana Hugessen, Mariano Phielipp, Glen Berseth
Searching the Space of High-Value Molecules Using Reinforcement Learning and Language Models
ICLR 2024.
[ICLR] [project] [code]

Mikhail Galkin, Xinyu Yuan, Hesham Mostafa, Jian Tang, Zhaocheng Zhu
Towards Foundation Models for Knowledge Graph Reasoning
ICLR 2024.
[ICLR] [project] [code]

Hongyi Wang, Felipe Maia Polo, Yuekai Sun, Souvik Kundu, Eric Xing, Mikhail Yurochkin
Fusing Models with Complementary Expertise
ICLR 2024.
[ICLR] [project] [code]

Souvik Kundu, Zeyu Liu, Anni Li, Junrui Wan, Lianghao Jiang, Peter A. Beerel
AFLoRA: Adaptive Freezing of Low-Rank Adapters for Parameter Efficient Fine-Tuning of Language Models
ACL (best paper nomination from Meta-reviewer) 2024.
[ACL] [project] [code]

Souvik Kundu, Sreetama Sarkar, Peter A. Beerel
RLNet: Robust Linearized Networks for Efficient Private Inference
CVPR (Trusted Computer Vision) 2024.
[CVPRW] [project] [code]

Sreetama Sarkar, Souvik Kundu, Kai Zheng, Peter A. Beerel
Block Selective Reprogramming for On-device Training of Vision Transformers
CVPR (ECV) ORAL presentation 2024.
[CVPRW] [project] [code]

Jose Rojas Chaves, Subarna Tripathi
VideoSAGE: Video Summarization with Graph Representation Learning
CVPR 2024.
[CVPRW] [project] [code]

Hengyue Liu, Kyle Min, Hector A Valdez, Subarna Tripathi
LAVITI: Contrastive Language Video Time Pre-training
CVPR (EgoVis) 2024.
[CVPRW] [project] [code]

Lu Yin, Shiwei Liu, Ajay Jaiswal, Souvik Kundu, Zhangyang (Atlas) Wang
Pruning Small Magnitude Weights Monotonically and Irreversibly Impairs Difficult Downstream Tasks in LLMs
ICML 2024.
[arXiv] [project] [code]

Souvik Kundu, Anthony Sarah, Vinay Joshi, Om J Omer, Sreenivas Subramoney
Towards Joint Optimization for DNN Architecture and Configuration for Compute-In-Memory Hardware
TinyML 2024.
[arXiv] [project] [code]

Tz-Ying Wu, Kyle Min, Subarna Tripathi, Nuno Vasconcelos
Ego-VPA: Egocentric Video Understanding with Parameter-efficient Adaptation
under review 2024.
[Under review] [project] [code]

Ting Hsuan Liao, Sainan Liu, Ilke Demir, Jia-Bin Huang
PASTE: Prompt-Aligned Scene TExture synthesis
under review 2024.
[Under review] [project] [code]

Jiraphon Yenphraphai, Xichen Pan, Sainan Liu, Daniele Panozzo, Saining Xie
Image Sculpting: Precise Object Editing with 3D Geometry Control
CVPR 2024.
[CVPR] [project] [code]

Changhoon Kim, Kyle Min, Maitreya Patel, Sheng Cheng, Yezhou Yang
WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Models
CVPR 2024.
[CVPR] [project] [code]

Ivan Rodin, Antonino Furnari, Kyle Min, Subarna Tripathi, Giovanni Maria Farinella
Action Scene Graphs for Long-Form Understanding of Egocentric Videos
CVPR 2024.
[CVPR] [project] [code]

Sainan Liu, Shan Lin, Jingpei Lu, Shreya Saha, Alexey Supikov, Michael Yip
BAA-NGP: Bundle-Adjusting Accelerated Neural Graphics Primitives
CVPRW 2024.
[ArXiv] [project] [code]

2023

Shreya Saha, Sainan Liu, Shan Lin, Jingpei Lu, Michael Yip
BASED: Bundle-Adjusting Surgical Endoscopic Dynamic Video Reconstruction using Neural Radiance Fields
arXiv 2023.
[ArXiv] [project] [code]

Kyle Min
STHG: Spatial-Temporal Heterogeneous Graph Learning for Advanced Audio-Visual Diarization
Ego4D challenge at CVPR 2023.
[ArXiv] [project] [code]

Yi Li, Kyle Min, Subarna Tripathi, Nuno Vasconcelos
SViTT: Temporal Learning of Sparse Video-Text Transformer
Computer Vision and Pattern Recognition (CVPR), 2023.
[arXiv] [project] [code]

Sayak Nag, Kyle Min, Subarna Tripathi, Amit Roy Choudhury
Unbiased video scene graph generation
Computer Vision and Pattern Recognition (CVPR), 2023.
[arXiv] [project] [code]

Shengyu Feng, Hesham Mostafa, Marcel Nassar, Somdeb Majumdar, Subarna Tripathi
Exploiting Long-Term Dependencies for Generating Dynamic Scene Graphs
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023.
[CVF] [project] [code]

Fang Chen, Gourav Datta, Souvik Kundu, Peter A. Beerel
Self-Attentive Pooling for Efficient Deep Learning
WACV 2023.
[WACV] [project] []

Yan Han, Peihao Wang, Souvik Kundu, Ding Ying, Zhangyang (Atlas) Wang
Vision HGNN: An Image is More than a Graph of Nodes
International Conference on Computer Vision (ICCV) ORAL, 2023.
[ICCV] [project] []

Souvik Kundu, Yuke Zhang, Dake Chen*, Chenghao Li, Peter A. Beerel
SAL-ViT: Towards Latency Efficient Private Inference on ViT using Selective Attention Search with a Learnable Softmax Approximation
International Conference on Computer Vision (ICCV), 2023.
[ICCV] [project] []

Sharath Nittur Sridhar, Souvik Kundu, Sairam Sundaresan, Maciej Szankin, Anthony Sarah
InstaTune: Instantaneous Neural Architecture Search During Fine-Tuning
International Conference on Computer Vision (ICCV) Workshop 2023.
[CVF] [project] []

Yonggan Fu, Ye Yuan, Souvik Kundu, Shang Wu, Shunyao Zhang, Celine Lin
NeRFool: Uncovering the Vulnerability of Generalizable Neural Radiance Fields against Adversarial Perturbations
International Conference on Machine Learning (ICML), 2023.
[PMLR] [project] []

Souvik Kundu, Shunlin Lu, Yuke Zhang, Jacqueline Liu, Peter A. Beerel
Learning to Linearize Deep Neural Networks for Secure and Efficient Private Inference
International Conference on Learning Representation (ICLR), 2023.
[OpenReview] [project] []

Yuke Zhang, Dake Chen, Souvik Kundu, Haomei Liu, Ruiheng Peng, Peter A. Beerel
C2PI: An Efficient Crypto-Clear Two-Party Neural Network Private Inference
Design Automation Conference (DAC), 2023.
[arxiv] [project] []

2022

Shaowei Liu, Subarna Tripathi, Somdeb Majumdar, Xiaolong Wang
Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videos
Computer Vision and Pattern Recognition (CVPR), 2022.
[arXiv] [project] [code]

Xiang Zhang, Yongwen Su, Subarna Tripathi, Zhuowen Tu
Text Spotting Transformers
Computer Vision and Pattern Recognition (CVPR), 2022.
[arXiv] [project] [code]

Kyle Min, Sourya Roy, Subarna Tripathi, Tanaya Guha, Somdeb Majumdar
Learning long-term spatial-temporal graphs for active speaker detection
European Conference on Computer Vision (ECCV), 2022.
[arXiv] [project] [code]

Alakh Desai, Tz-Ying Wu, Subarna Tripathi, Nuno Vasconcelos
Single-Stage Visual Relationship Learning using Conditional Queries
Neural Information Processing Systems (NeurIPS), 2022.
[openReview] [project] [code]

Sharath Nittur Sridhar, Anthony Sarah, Sairam Sundaresan
TrimBERT: Tailoring BERT for Trade-offs
International Conference on Machine Learning (ICML) 2022.
[arXiv] [project] [code]

Daniel Cummings, Sharath Nittur Sridhar, Anthony Sarah, Maciej Szankin
Accelerating Neural Architecture Exploration Across Modalities Using Genetic Algorithms
Genetic and Evolutionary Computation Conference (GECCO) 2022.
[arXiv] [project] []

Daniel Cummings, Anthony Sarah, Sharath Nittur Sridhar, Maciej Szankin, Pablo Munoz, Sairam Sundaresan
A Hardware-Aware Framework for Accelerating Neural Architecture Search Across Modalities
Automated Machine Learning (AutoML) 2022.
[arXiv] [project] []

J. Pablo Munoz, Nikolay Lyalyushkin, Chaunté W. Lacewell, Anastasia Senina, Daniel Cummings, Anthony Sarah, Alexander Kozlov, Nilesh Jain
Automated Super-Network Generation for Scalable Neural Architecture Search
Automated Machine Learning (AutoML) 2022.
[OpenReview] [project] []

Souvik Kundu, Sairam Sundaresan, M. Pedram, P. A. Beerel
FLOAT: Fast Learnable Once-for-All Adversarial Training for Tunable Trade-off between Accuracy and Robustness
ICLR 2022.
[OpenReview] [project] []

Souvik Kundu, Sairam Sundaresan, Sharath Nittur Sridhar, S Lu, H Tang, P. A. Beerel
Sparse Mixture Once-for-all Adversarial Training for Efficient in-situ Trade-off between Accuracy and Robustness of DNNs
International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2022.
[arXiv] [project] []

2021

Souvik Kundu, Sairam Sundaresan
AttentionLite: Towards Efficient Self-attention models for Vision
International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2021.
[arXiv] [project] []

Alicja Kwasniewska, Maciej Szankin, Jacek Ruminski, Anthony Sarah, David Gamba
Improving Accuracy of Respiratory Rate Estimation by Restoring High Resolution Features With Transformers and Recursive Convolutional Models
CVPRW 2021.
[CVF] [project] []

Sharath Nittur Sridhar, Anthony Sarah
Undivided Attention: Are Intermediate Layers Necessary for BERT?
NeurIPS 2021.
[NeurIPS] [project] []

Hala Lamdouar, Sairam Sundaresan, Anna Jungbluth, Sudeshna Boro Saikia, Amanda Joy Camarata, Nathan Miles, Marcella Scoczynski, Mavis Stone, Anthony Sarah, Andres Munoz-Jaramillo, Ayris Narock, Adam Szabo
Deep-SWIM: A few-shot learning approach to classify Solar WInd Magnetic field structures
NeurIPS 2021.
[NeurIPS] [project] []

2020