Anand D. Sarwate

CoRE Building Rm. 517

Busch Campus

Rutgers University

Piscataway, NJ 08854-8058

(848) 445-8516

I am an Associate Professor in the Department of Electrical and Computer Engineering at Rutgers, The State University of New Jersey. I also am a member of the graduate faculty in the Department of Computer Science and the Department of Statistics. I like to work on problems that involve probability, mathematical statistics,
and optimization, with applications in information theory, communication, signal processing, and machine learning. I’m particularly interested in how these things intersect in the context of distributed/decentralized systems with constraints like privacy, bandwidth, latency, power, and so on.

This page is still somewhat under construction. I anticipate that will be the state for quite a while.

news

Jan 19, 2024	To appear at ICLR 2024 (spotlight): A. W. Engel, Z. Wang, N. Frank, I. Dumitriu, S. Choudhury, A. Sarwate, T. Chiang, Faithful and Efficient Explanations for Neural Networks via Neural Tangent Kernel Surrogate Models. To appear at ICASSP 2024: J. Hoyos Sanchez, B. Taki,, W. U. Bajwa, A. D. Sarwate, Federated Learning of Tensor Generalized Linear Models with Low Separation Rank. I’m teaching ECE 549 this semester, which was traditionally called Detection and Estimation Theory.
Nov 27, 2023	I have been appointed as a Distinguished Lecturer for 2024-2025 by the IEEE Information Theory Society. I’m happy to visit to give a talk!
Nov 22, 2023	I received the Outstanding Engineering Professor Award from the Rutgers School of Engineering!
Sep 22, 2023	Some recent activity: Critical AI and Design Justice: An Interview with Sasha Costanza-Chock, to appear in Critical AI. This is the transcript of a panel interview with Sasha Costanza-Chock, author of Design Justice. Zhichao Wang, Andrew Engel, Anand Sarwate, Ioana Dumitriu, Tony Chiang, Spectral Evolution and Invariance in Linear-width Neural Networks, accepted to NeurIPS 2023.
Jun 20, 2023	A few new papers to appear: D. Martin et al. “Enhancing Collaborative Neuroimaging Research: Introducing COINSTAC Vaults for Federated Analysis and Reproducibility”, to Frontiers in Neuroinformatics. Z. Wang et al., “Spectral Evolution and Invariance in Linear-width Neural Networks”, to the ICML 2023 High-dimensional Learning Dynamics Workshop. D. Saha et al, “Federated, Fast, and Private Visualization of Decentralized Data”, to the ICML 2023 Workshop on Federated Learning and Analytics in Practice: Algorithms, Systems, Applications, and Opportunities.

selected publications

A. W. Engel, Z. Wang, N. Frank, I. Dumitriu, S. Choudhury, A. Sarwate, and T. Chiang, “Faithful and Efficient Explanations for Neural Networks via Neural Tangent Kernel Surrogate Models,” in The Twelfth International Conference on Learning Representations, Vienna, Austria, 2024.

Bib URL

@inproceedings{EngelWFDCSC:24explanations,
  address = {Vienna, Austria},
  author = {Engel, A. W. and Wang, Z. and Frank, N. and Dumitriu, I. and Choudhury, S. and Sarwate, A. and Chiang, T.},
  booktitle = {The Twelfth International Conference on Learning Representations},
  cvcategory = {archival},
  month = may,
  title = {Faithful and Efficient Explanations for Neural Networks via Neural Tangent Kernel Surrogate Models},
  url = {https://openreview.net/forum?id=yKksu38BpM},
  year = {2024},
}

B. Taki, A. D. Sarwate, and W. U. Bajwa, “Low Separation Rank in Tensor Generalized Linear Models: an Asymptotic Analysis,” in Proceedings of the 2024 Annual Conference on Information Science and Systems (CISS), Princeton, NJ, USA, 2024.

Bib

@inproceedings{TakiSB:24asymptotics,
  address = {Princeton, NJ, USA},
  author = {Taki, Batoul and Sarwate, Anand D. and Bajwa, Waheed U.},
  booktitle = {Proceedings of the 2024 Annual Conference on Information Science and Systems (CISS)},
  month = mar,
  title = {Low Separation Rank in Tensor Generalized Linear Models: an Asymptotic Analysis},
  year = {2024}
}

Z. Wang, A. Engel, A. Sarwate, I. Dumitriu, and T. Chiang, “Spectral Evolution and Invariance in Linear-width Neural Networks,” in Advances in Neural Information Processing Systems 36 (NeurIPS 2023), Curran Associates, Inc., 2023.

Bib URL

@incollection{WangESDC:23neurips,
  author = {Wang, Zhichao and Engel, Andrew and Sarwate, Anand and Dumitriu, Ioana and Chiang, Tony},
  booktitle = {Advances in Neural Information Processing Systems 36 (NeurIPS 2023)},
  cvcategory = {archival},
  month = dec,
  publisher = {Curran Associates, Inc.},
  title = {Spectral Evolution and Invariance in Linear-width Neural Networks},
  url = {https://openreview.net/forum?id=gpqBGyKeKH},
  year = {2023},
}

D. K. Saha, V. Calhoun, S. M. Kwon, A. Sarwate, R. Saha, and S. Plis, “Federated, Fast, and Private Visualization of Decentralized Data,” in Federated Learning and Analytics in Practice: Algorithms, Systems, Applications, and Opportunities (FL-ICML 2023), 2023.

Bib URL

@inproceedings{SahaCKSSP:23dnse:workshop,
  author = {Saha, Debbrata Kumar and Calhoun, Vince and Kwon, Soo Min and Sarwate, Anand and Saha, Rekha and Plis, Sergey},
  booktitle = {Federated Learning and Analytics in Practice: Algorithms, Systems, Applications, and Opportunities (FL-ICML 2023)},
  month = jul,
  title = {Federated, Fast, and Private Visualization of Decentralized Data},
  url = {https://openreview.net/forum?id=XkfbFUqvek},
  year = {2023},
}

S. Li, P. Krishan, S. Jaggi, M. Langberg, and A. D. Sarwate, “Computationally Efficient Codes for Adversarial Binary-Erasure Channels,” in Proceedings of the 2023 IEEE International Symposium on Information Theory (ISIT), 2023, pp. 228–233.

Bib DOI

@inproceedings{LKJLS:23efficient,
  author = {Li, Sijie and Krishan, Prasad and Jaggi, Sidharth and Langberg, Michael and Sarwate, Anand D},
  booktitle = {Proceedings of the 2023 IEEE International Symposium on Information Theory (ISIT)},
  doi = {10.1109/ISIT54713.2023.10206731},
  month = jun,
  pages = {228--233},
  title = {Computationally Efficient Codes for Adversarial Binary-Erasure Channels},
  url = {https://doi.org/10.1109/ISIT54713.2023.10206731},
  year = {2023},
}

H. Gazula, K. Rootes-Murdy, B. Holla, S. Basodi, Z. Zhang, E. Verner, R. Kelly, P. Murthy, A. Chakrabarti, D. Basu, S. Bhagyalakshmi Nanjayya, R. Lenin Singh, R. Lourembam Singh, K. Kalyanram, K. Kartik, K. Kalyanaraman, K. Ghattu, R. Kuriyan, S. S. Kurpad, G. J. Barker, R. D. Bharath, S. Desrivieres, M. Purushottam, D. P. Orfanos, E. Sharma, M. Hickman, M. Toledano, N. Vaidya, T. Banaschewski, A. L. W. Bokde, H. Flor, A. Grigis, H. Garavan, P. Gowland, A. Heinz, R. Brühl, J.-L. Martinot, M.-L. Paillére Martinot, E. Artiges, F. Nees, T. Paus, L. Poustka, J. H. Fröhner, L. Robinson, M. N. Smolka, H. Walter, J. Winterer, R. Whelan, J. A. Turner, A. D. Sarwate, et al., “Federated Analysis in COINSTAC Reveals Functional Network Connectivity and Spectral Links to Smoking and Alcohol Consumption in Nearly 2,000 Adolescent Brains,” Neuroinformatics, vol. 21, pp. 287–301, Apr. 2023.
Abs Bib DOI

With the growth of decentralized/federated analysis approaches in neuroimaging, the opportunities to study brain disorders using data from multiple sites has grown multi-fold. One such initiative is the Neuromark, a fully automated spatially constrained independent component analysis (ICA) that is used to link brain network abnormalities among different datasets, studies, and disorders while leveraging subject-specific networks. In this study, we implement the neuromark pipeline in COINSTAC, an open-source neuroimaging framework for collaborative/decentralized analysis. Decentralized exploratory analysis of nearly 2000 resting-state functional magnetic resonance imaging datasets collected at different sites across two cohorts and co-located in different countries was performed to study the resting brain functional network connectivity changes in adolescents who smoke and consume alcohol. Results showed hypoconnectivity across the majority of networks including sensory, default mode, and subcortical domains, more for alcohol than smoking, and decreased low frequency power. These findings suggest that global reduced synchronization is associated with both tobacco and alcohol use. This proof-of-concept work demonstrates the utility and incentives associated with large-scale decentralized collaborations spanning multiple sites.
```
@article{Gazula:22federated,
  author = {Gazula, Harshvardhan and Rootes-Murdy, Kelly and Holla, Bharath and Basodi, Sunitha and Zhang, Zuo and Verner, Eric and Kelly, Ross and Murthy, Pratima and Chakrabarti, Amit and Basu, Debasish and Bhagyalakshmi Nanjayya, Subodh and Lenin Singh, Rajkumar and Lourembam Singh, Roshan and Kalyanram, Kartik and Kartik, Kamakshi and Kalyanaraman, Kumaran and Ghattu, Krishnaveni and Kuriyan, Rebecca and Kurpad, Sunita Simon and Barker, Gareth J. and Bharath, Rose Dawn and Desrivieres, Sylvane and Purushottam, Meera and Orfanos, Dimitri Papadopoulos and Sharma, Eesha and Hickman, Matthew and Toledano, Mireille and Vaidya, Nilakshi and Banaschewski, Tobias and Bokde, Arun L. W. and Flor, Herta and Grigis, Antoine and Garavan, Hugh and Gowland, Penny and Heinz, Andreas and Br{\"u}hl, R{\"u}diger and Martinot, Jean-Luc and Paill{\'e}re Martinot, Marie-Laure and Artiges, Eric and Nees, Frauke and Paus, Tom{\'a}s and Poustka, Luise and Fr{\"o}hner, Juliane H. and Robinson, Lauren and Smolka, Michael N. and Walter, Henrik and Winterer, Jeanne and Whelan, Robert and Turner, Jessica A. and Sarwate, Anand D. and Plis, Sergey M. and Benegal, Vivek and Schumann, Gunter and Calhoun, Vince D. and {IMAGEN Consortium}},
  doi = {10.1007/s12021-022-09604-4},
  journal = {Neuroinformatics},
  month = apr,
  pages = {287--301},
  title = {Federated Analysis in COINSTAC Reveals Functional Network Connectivity and Spectral Links to Smoking and Alcohol Consumption in Nearly 2,000 Adolescent Brains},
  url = {https://doi.org/10.1007/s12021-022-09604-4},
  volume = {21},
  year = {2023},
}
```

Z. Wang, A. Engel, A. Sarwate, I. Dumitriu, and T. Chiang, “Spectral evolution and invariance in linear-width neural networks,” no. arXiv:2211.06506 [cs.LG], ArXiV, Nov-2022.

Bib DOI

@unpublished{WangWSDC:22spectral,
  author = {Wang, Zhichao and Engel, Andrew and Sarwate, Anand and Dumitriu, Ioana and Chiang, Tony},
  doi = {10.48550/arXiv.2211.06506},
  institution = {ArXiV},
  month = nov,
  number = {arXiv:2211.06506 [cs.LG]},
  title = {Spectral evolution and invariance in linear-width neural networks},
  year = {2022},
}

Y. Zhang, S. Vatedka, S. Jaggi, and A. D. Sarwate, “Quadratically Constrained Myopic Adversarial Channels,” IEEE Transactions on Information Theory, vol. 68, pp. 4901–4948, Aug. 2022.

Bib DOI

@article{ZhangVJS:22myopicgavc,
  author = {Zhang, Yihan and Vatedka, Shashank and Jaggi, Sidharth and Sarwate, Anand D.},
  doi = {10.1109/TIT.2022.3167554},
  journal = {IEEE Transactions on Information Theory},
  month = aug,
  pages = {4901--4948},
  title = {Quadratically Constrained Myopic Adversarial Channels},
  url = {https://doi.org/10.1109/TIT.2022.3167554},
  volume = {68},
  year = {2022},
}

Y. Zhang, S. Jaggi, M. Langberg, and A. D. Sarwate, “The Capacity of Causal Adversarial Channels,” in Proceedings of the 2022 IEEE International Symposium on Information Theory (ISIT), 2022.

arXiv Bib DOI

@inproceedings{ZhangJLS:22isit,
  author = {Zhang, Yihan and Jaggi, Sidharth and Langberg, Michael and Sarwate, Anand D.},
  booktitle = {Proceedings of the 2022 IEEE International Symposium on Information Theory (ISIT)},
  doi = {10.1109/ISIT50566.2022.9834709},
  month = jun,
  title = {The Capacity of Causal Adversarial Channels},
  url = {https://doi.org/10.1109/ISIT50566.2022.9834709},
  year = {2022},
}

N. Sathyavageeswaran, R. D. Yates, A. D. Sarwate, and N. Mandayam, “Privacy Leakage in Discrete Time Updating Systems,” in Proceedings of the 2022 IEEE International Symposium on Information Theory (ISIT), 2022.

arXiv Bib DOI

@inproceedings{SathyavageeswaranYSM:22isit,
  author = {Sathyavageeswaran, Nitya and Yates, Roy D. and Sarwate, Anand D. and Mandayam, Narayan},
  booktitle = {Proceedings of the 2022 IEEE International Symposium on Information Theory (ISIT)},
  doi = {10.1109/ISIT50566.2022.9834673},
  month = jun,
  title = {Privacy Leakage in Discrete Time Updating Systems},
  url = {https://doi.org/10.1109/ISIT50566.2022.9834673},
  year = {2022},
}