Anand D. Sarwate

I am an Associate Professor in the Department of Electrical and Computer Engineering at Rutgers, The State University of New Jersey. I also am a member of the graduate faculty in the Department of Computer Science and the Department of Statistics. I like to work on problems that involve probability, mathematical statistics,
and optimization, with applications in information theory, communication, signal processing, and machine learning. I’m particularly interested in how these things intersect in the context of distributed/decentralized systems with constraints like privacy, bandwidth, latency, power, and so on.

This page is still somewhat under construction. I anticipate that will be the state for quite a while.

news

Jan 19, 2024	To appear at ICLR 2024 (spotlight): A. W. Engel, Z. Wang, N. Frank, I. Dumitriu, S. Choudhury, A. Sarwate, T. Chiang, Faithful and Efficient Explanations for Neural Networks via Neural Tangent Kernel Surrogate Models. To appear at ICASSP 2024: J. Hoyos Sanchez, B. Taki,, W. U. Bajwa, A. D. Sarwate, Federated Learning of Tensor Generalized Linear Models with Low Separation Rank. I’m teaching ECE 549 this semester, which was traditionally called Detection and Estimation Theory.
Nov 27, 2023	I have been appointed as a Distinguished Lecturer for 2024-2025 by the IEEE Information Theory Society. I’m happy to visit to give a talk!
Nov 22, 2023	I received the Outstanding Engineering Professor Award from the Rutgers School of Engineering!
Sep 22, 2023	Some recent activity: Critical AI and Design Justice: An Interview with Sasha Costanza-Chock, to appear in Critical AI. This is the transcript of a panel interview with Sasha Costanza-Chock, author of Design Justice. Zhichao Wang, Andrew Engel, Anand Sarwate, Ioana Dumitriu, Tony Chiang, Spectral Evolution and Invariance in Linear-width Neural Networks, accepted to NeurIPS 2023.
Jun 20, 2023	A few new papers to appear: D. Martin et al. “Enhancing Collaborative Neuroimaging Research: Introducing COINSTAC Vaults for Federated Analysis and Reproducibility”, to Frontiers in Neuroinformatics. Z. Wang et al., “Spectral Evolution and Invariance in Linear-width Neural Networks”, to the ICML 2023 High-dimensional Learning Dynamics Workshop. D. Saha et al, “Federated, Fast, and Private Visualization of Decentralized Data”, to the ICML 2023 Workshop on Federated Learning and Analytics in Practice: Algorithms, Systems, Applications, and Opportunities.

selected publications

Faithful and Efficient Explanations for Neural Networks via Neural Tangent Kernel Surrogate Models

A. W. Engel, Z. Wang, N. Frank, I. Dumitriu, S. Choudhury, A. Sarwate, and T. Chiang

In The Twelfth International Conference on Learning Representations, May 2024

Bib

@inproceedings{EngelWFDCSC:24explanations,
  address = {Vienna, Austria},
  author = {Engel, A. W. and Wang, Z. and Frank, N. and Dumitriu, I. and Choudhury, S. and Sarwate, A. and Chiang, T.},
  booktitle = {The Twelfth International Conference on Learning Representations},
  cvcategory = {archival},
  date-added = {2024-01-28 14:11:52 -0500},
  date-modified = {2024-06-21 13:49:12 -0400},
  month = may,
  title = {Faithful and Efficient Explanations for Neural Networks via Neural Tangent Kernel Surrogate Models},
  url = {https://openreview.net/forum?id=yKksu38BpM},
  year = {2024},
  bdsk-url-1 = {https://openreview.net/forum?id=yKksu38BpM}
}

Low Separation Rank in Tensor Generalized Linear Models: an Asymptotic Analysis

Batoul Taki, Anand D. Sarwate, and Waheed U. Bajwa

In Proceedings of the 2024 Annual Conference on Information Science and Systems (CISS), Mar 2024

Bib

@inproceedings{TakiSB:24asymptotics,
  address = {Princeton, NJ, USA},
  author = {Taki, Batoul and Sarwate, Anand D. and Bajwa, Waheed U.},
  booktitle = {Proceedings of the 2024 Annual Conference on Information Science and Systems (CISS)},
  date-added = {2024-01-28 14:16:16 -0500},
  date-modified = {2024-01-28 14:19:36 -0500},
  month = mar,
  title = {Low Separation Rank in Tensor Generalized Linear Models: an Asymptotic Analysis},
  year = {2024}
}

Spectral Evolution and Invariance in Linear-width Neural Networks

Zhichao Wang, Andrew Engel, Anand Sarwate, Ioana Dumitriu, and Tony Chiang

In Advances in Neural Information Processing Systems 36 (NeurIPS 2023), Dec 2023

Bib

@incollection{WangESDC:23neurips,
  author = {Wang, Zhichao and Engel, Andrew and Sarwate, Anand and Dumitriu, Ioana and Chiang, Tony},
  booktitle = {Advances in Neural Information Processing Systems 36 (NeurIPS 2023)},
  cvcategory = {archival},
  date-added = {2023-09-22 12:16:24 -0400},
  date-modified = {2024-06-21 13:55:22 -0400},
  month = dec,
  publisher = {Curran Associates, Inc.},
  title = {Spectral Evolution and Invariance in Linear-width Neural Networks},
  url = {https://openreview.net/forum?id=gpqBGyKeKH},
  year = {2023},
  bdsk-url-1 = {https://drive.google.com/file/d/1dzxXlayANDzFOFSC6jOgwvOZ-Iweo44C/view}
}

Federated, Fast, and Private Visualization of Decentralized Data

Debbrata Kumar Saha, Vince Calhoun, Soo Min Kwon, Anand Sarwate, Rekha Saha, and Sergey Plis

In Federated Learning and Analytics in Practice: Algorithms, Systems, Applications, and Opportunities (FL-ICML 2023), Jul 2023

Bib

@inproceedings{SahaCKSSP:23dnse:workshop,
  author = {Saha, Debbrata Kumar and Calhoun, Vince and Kwon, Soo Min and Sarwate, Anand and Saha, Rekha and Plis, Sergey},
  booktitle = {Federated Learning and Analytics in Practice: Algorithms, Systems, Applications, and Opportunities (FL-ICML 2023)},
  date-added = {2023-11-24 17:11:41 -0500},
  date-modified = {2024-01-28 14:19:28 -0500},
  month = jul,
  title = {Federated, Fast, and Private Visualization of Decentralized Data},
  url = {https://openreview.net/forum?id=XkfbFUqvek},
  year = {2023},
  bdsk-url-1 = {https://openreview.net/forum?id=XkfbFUqvek}
}

Computationally Efficient Codes for Adversarial Binary-Erasure Channels

Sijie Li, Prasad Krishan, Sidharth Jaggi, Michael Langberg, and Anand D Sarwate

In Proceedings of the 2023 IEEE International Symposium on Information Theory (ISIT), Jun 2023

DOI Bib

@inproceedings{LKJLS:23efficient,
  author = {Li, Sijie and Krishan, Prasad and Jaggi, Sidharth and Langberg, Michael and Sarwate, Anand D},
  booktitle = {Proceedings of the 2023 IEEE International Symposium on Information Theory (ISIT)},
  date-added = {2020-06-20 10:20:00 -0400},
  date-modified = {2023-11-26 14:38:14 -0500},
  doi = {10.1109/ISIT54713.2023.10206731},
  month = jun,
  pages = {228--233},
  title = {Computationally Efficient Codes for Adversarial Binary-Erasure Channels},
  url = {https://doi.org/10.1109/ISIT54713.2023.10206731},
  year = {2023},
  bdsk-url-1 = {https://dx.doi.org/10.1109/ISIT44484.2020.9174487}
}

Spectral evolution and invariance in linear-width neural networks

Zhichao Wang, Andrew Engel, Anand Sarwate, Ioana Dumitriu, and Tony Chiang

Nov 2022

DOI Bib

@unpublished{WangWSDC:22spectral,
  author = {Wang, Zhichao and Engel, Andrew and Sarwate, Anand and Dumitriu, Ioana and Chiang, Tony},
  date-added = {2023-05-09 13:53:40 -0400},
  date-modified = {2024-06-21 14:17:26 -0400},
  doi = {10.48550/arXiv.2211.06506},
  institution = {ArXiV},
  month = nov,
  number = {arXiv:2211.06506 [cs.LG]},
  title = {Spectral evolution and invariance in linear-width neural networks},
  url = {https://arxiv.org/abs/2211.06506},
  year = {2022},
  bdsk-url-1 = {https://arxiv.org/abs/2211.06506},
  bdsk-url-2 = {https://doi.org/10.48550/arXiv.2211.06506}
}

Federated Analysis in COINSTAC Reveals Functional Network Connectivity and Spectral Links to Smoking and Alcohol Consumption in Nearly 2,000 Adolescent Brains

Harshvardhan Gazula, Kelly Rootes-Murdy, Bharath Holla, Sunitha Basodi, Zuo Zhang, Eric Verner, Ross Kelly, Pratima Murthy, and 47 more authors

Neuroinformatics, Nov 2022

Abs DOI Bib

With the growth of decentralized/federated analysis approaches in neuroimaging, the opportunities to study brain disorders using data from multiple sites has grown multi-fold. One such initiative is the Neuromark, a fully automated spatially constrained independent component analysis (ICA) that is used to link brain network abnormalities among different datasets, studies, and disorders while leveraging subject-specific networks. In this study, we implement the neuromark pipeline in COINSTAC, an open-source neuroimaging framework for collaborative/decentralized analysis. Decentralized exploratory analysis of nearly 2000 resting-state functional magnetic resonance imaging datasets collected at different sites across two cohorts and co-located in different countries was performed to study the resting brain functional network connectivity changes in adolescents who smoke and consume alcohol. Results showed hypoconnectivity across the majority of networks including sensory, default mode, and subcortical domains, more for alcohol than smoking, and decreased low frequency power. These findings suggest that global reduced synchronization is associated with both tobacco and alcohol use. This proof-of-concept work demonstrates the utility and incentives associated with large-scale decentralized collaborations spanning multiple sites.

@article{Gazula:22federated,
  author = {Gazula, Harshvardhan and Rootes-Murdy, Kelly and Holla, Bharath and Basodi, Sunitha and Zhang, Zuo and Verner, Eric and Kelly, Ross and Murthy, Pratima and Chakrabarti, Amit and Basu, Debasish and Bhagyalakshmi Nanjayya, Subodh and Lenin Singh, Rajkumar and Lourembam Singh, Roshan and Kalyanram, Kartik and Kartik, Kamakshi and Kalyanaraman, Kumaran and Ghattu, Krishnaveni and Kuriyan, Rebecca and Kurpad, Sunita Simon and Barker, Gareth J. and Bharath, Rose Dawn and Desrivieres, Sylvane and Purushottam, Meera and Orfanos, Dimitri Papadopoulos and Sharma, Eesha and Hickman, Matthew and Toledano, Mireille and Vaidya, Nilakshi and Banaschewski, Tobias and Bokde, Arun L. W. and Flor, Herta and Grigis, Antoine and Garavan, Hugh and Gowland, Penny and Heinz, Andreas and Br{\"u}hl, R{\"u}diger and Martinot, Jean-Luc and Paill{\'e}re Martinot, Marie-Laure and Artiges, Eric and Nees, Frauke and Paus, Tom{\'a}s and Poustka, Luise and Fr{\"o}hner, Juliane H. and Robinson, Lauren and Smolka, Michael N. and Walter, Henrik and Winterer, Jeanne and Whelan, Robert and Turner, Jessica A. and Sarwate, Anand D. and Plis, Sergey M. and Benegal, Vivek and Schumann, Gunter and Calhoun, Vince D. and {IMAGEN Consortium}},
  date-added = {2023-02-22 12:02:30 -0500},
  date-modified = {2025-02-17 15:27:32 -0500},
  doi = {10.1007/s12021-022-09604-4},
  journal = {Neuroinformatics},
  month = nov,
  pages = {287--301},
  title = {Federated Analysis in COINSTAC Reveals Functional Network Connectivity and Spectral Links to Smoking and Alcohol Consumption in Nearly 2,000 Adolescent Brains},
  url = {https://doi.org/10.1007/s12021-022-09604-4},
  volume = {21},
  year = {2022},
  bdsk-url-1 = {https://doi.org/10.1007/s12021-022-09604-4}
}

Quadratically Constrained Myopic Adversarial Channels

Yihan Zhang, Shashank Vatedka, Sidharth Jaggi, and Anand D. Sarwate

IEEE Transactions on Information Theory, Aug 2022

DOI Bib

@article{ZhangVJS:22myopicgavc,
  author = {Zhang, Yihan and Vatedka, Shashank and Jaggi, Sidharth and Sarwate, Anand D.},
  date-added = {2022-02-09 10:54:40 -0500},
  date-modified = {2023-05-21 10:54:45 -0700},
  doi = {10.1109/TIT.2022.3167554},
  journal = {IEEE Transactions on Information Theory},
  month = aug,
  pages = {4901--4948},
  title = {Quadratically Constrained Myopic Adversarial Channels},
  url = {https://doi.org/10.1109/TIT.2022.3167554},
  volume = {68},
  year = {2022},
  bdsk-url-1 = {https://doi.org/10.1109/TIT.2022.3167554}
}

The Capacity of Causal Adversarial Channels

Yihan Zhang, Sidharth Jaggi, Michael Langberg, and Anand D. Sarwate

In Proceedings of the 2022 IEEE International Symposium on Information Theory (ISIT), Jun 2022

DOI ArXiV Bib

@inproceedings{ZhangJLS:22isit,
  author = {Zhang, Yihan and Jaggi, Sidharth and Langberg, Michael and Sarwate, Anand D.},
  booktitle = {Proceedings of the 2022 IEEE International Symposium on Information Theory (ISIT)},
  date-added = {2022-07-08 12:34:18 +0100},
  date-modified = {2023-05-29 10:31:05 -0400},
  doi = {10.1109/ISIT50566.2022.9834709},
  month = jun,
  title = {The Capacity of Causal Adversarial Channels},
  url = {https://doi.org/10.1109/ISIT50566.2022.9834709},
  year = {2022},
  bdsk-url-1 = {https://doi.org/10.1109/ISIT50566.2022.9834709}
}

Privacy Leakage in Discrete Time Updating Systems

Nitya Sathyavageeswaran, Roy D. Yates, Anand D. Sarwate, and Narayan Mandayam

In Proceedings of the 2022 IEEE International Symposium on Information Theory (ISIT), Jun 2022

DOI ArXiV Bib

@inproceedings{SathyavageeswaranYSM:22isit,
  author = {Sathyavageeswaran, Nitya and Yates, Roy D. and Sarwate, Anand D. and Mandayam, Narayan},
  booktitle = {Proceedings of the 2022 IEEE International Symposium on Information Theory (ISIT)},
  date-added = {2022-07-08 12:26:36 +0100},
  date-modified = {2023-05-29 10:30:20 -0400},
  doi = {10.1109/ISIT50566.2022.9834673},
  month = jun,
  title = {Privacy Leakage in Discrete Time Updating Systems},
  url = {https://doi.org/10.1109/ISIT50566.2022.9834673},
  year = {2022},
  bdsk-url-1 = {https://doi.org/10.1109/ISIT50566.2022.9834673}
}