Publications

22
Total Publications Listed

For the most complete and up-to-date list of publications, please visit our PI's profile on
Google Scholar

ML8HCI6Music/Audio2General Science2arXiv4
* denotes equal contribution

2025

6 publications

A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments

Manuel Cherep, Chengtian Ma, Abigail Xu, Maya Shaked, Pattie Maes, Nikhil Singh
arXiv Preprint
Published in 2025
PaperCode
BibTeX
@article{cherepa2025,
  title={A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments},
  author={Cherep, Manuel and Ma, Chengtian and Xu, Abigail and Shaked, Maya and Maes, Pattie and Singh, Nikhil},
  journal={arXiv Preprint},
  year={2025}
}
arXiv

LLM Agents are Hypersensitive to Nudges

Manuel Cherep, Pattie Maes, Nikhil Singh
arXiv Preprint
Published in 2025
Paper
BibTeX
@article{cherepllm2025,
  title={LLM Agents are Hypersensitive to Nudges},
  author={Cherep, Manuel and Maes, Pattie and Singh, Nikhil},
  journal={arXiv Preprint},
  year={2025}
}
arXiv

Discovering Interpretable Concepts in Large Generative Music Models

Nikhil Singh*, Manuel Cherep*, Pattie Maes
arXiv Preprint
Published in 2025
Paper
BibTeX
@article{singhdiscovering2025,
  title={Discovering Interpretable Concepts in Large Generative Music Models},
  author={Singh, Nikhil and Cherep, Manuel and Maes, Pattie},
  journal={arXiv Preprint},
  year={2025}
}
arXiv

Contrastive Learning from Synthetic Audio Doppelgangers

Manuel Cherep*, Nikhil Singh*
International Conference on Learning Representations
Published in 2025
Paper
BibTeX
@article{cherepcontrastive2025,
  title={Contrastive Learning from Synthetic Audio Doppelgangers},
  author={Cherep, Manuel and Singh, Nikhil},
  journal={International Conference on Learning Representations},
  year={2025}
}
ICLR

Bridging the Data Provenance Gap Across Text, Speech and Video

Shayne Longpre, Nikhil Singh, Manuel Cherep, Kushagra Tiwary, Joanna Materzynska, William Brannon, Robert Mahari, Manan Dey, Mohammed Hamdy, Nayan Saxena, Ahmad Anis, Emad Alghamdi, Vu Minh Chien, Naana Obeng-Marnu, Da Yin, Kun Qian, Yizhi Li, Minnie Liang, An Dinh, Shrestha Mohanty, Deividas Mataciunas, Tobin South, Jianguo Zhang, Ariel N Lee, Campbell S Lund, Christopher Klamm, Damien Sileo, Diganta Misra, Enrico Shippole, Kevin Klyman, Lester JV Miranda, Niklas Muennighoff, Seonghyeon Ye, Seungone Kim, Vipul Gupta, Vivek Sharma, Xuhui Zhou, Caiming Xiong, Luis Villa, Stella Biderman, Alex Pentland, Sara Hooker, Jad Kabbara
International Conference on Learning Representations
Published in 2025
Paper
BibTeX
@article{longprebridging2025,
  title={Bridging the Data Provenance Gap Across Text, Speech and Video},
  author={Longpre, Shayne and Singh, Nikhil and Cherep, Manuel and Tiwary, Kushagra and Materzynska, Joanna and Brannon, William and Mahari, Robert and Dey, Manan and Hamdy, Mohammed and Saxena, Nayan and Anis, Ahmad and Alghamdi, Emad and Minh Chien, Vu and Obeng-Marnu, Naana and Yin, Da and Qian, Kun and Li, Yizhi and Liang, Minnie and Dinh, An and Mohanty, Shrestha and Mataciunas, Deividas and South, Tobin and Zhang, Jianguo and N Lee, Ariel and S Lund, Campbell and Klamm, Christopher and Sileo, Damien and Misra, Diganta and Shippole, Enrico and Klyman, Kevin and JV Miranda, Lester and Muennighoff, Niklas and Ye, Seonghyeon and Kim, Seungone and Gupta, Vipul and Sharma, Vivek and Zhou, Xuhui and Xiong, Caiming and Villa, Luis and Biderman, Stella and Pentland, Alex and Hooker, Sara and Kabbara, Jad},
  journal={International Conference on Learning Representations},
  year={2025}
}
ICLR

Purrfect Pitch: Exploring Musical Interval Learning through Multisensory Interfaces

Sam Chin*, Cathy Mengying Fang*, Nikhil Singh, Ibrahim Ibrahim, Joe Paradiso, Pattie Maes
Augmented Humans
Published in 2025
Paper
BibTeX
@article{chinpurrfect2025,
  title={Purrfect Pitch: Exploring Musical Interval Learning through Multisensory Interfaces},
  author={Chin, Sam and Fang, Cathy Mengying and Singh, Nikhil and Ibrahim, Ibrahim and Paradiso, Joe and Maes, Pattie},
  journal={Augmented Humans},
  year={2025}
}
AH

2024

8 publications

Creative Text-to-Audio Generation via Synthesizer Programming

Manuel Cherep*, Nikhil Singh*, Jessica Shand
Forty-first International Conference on Machine Learning
Published in 2024
Paper
BibTeX
@article{cherepcreative2024,
  title={Creative Text-to-Audio Generation via Synthesizer Programming},
  author={Cherep, Manuel and Singh, Nikhil and Shand, Jessica},
  journal={Forty-first International Conference on Machine Learning},
  year={2024}
}
ICML

FigurA11y: AI Assistance for Writing Scientific Alt Text

Nikhil Singh, Lucy Lu Wang, Jonathan Bragg
Proceedings of the 29th International Conference on Intelligent User Interfaces
Published in 2024
Paper
BibTeX
@article{singhfigura11y:2024,
  title={FigurA11y: AI Assistance for Writing Scientific Alt Text},
  author={Singh, Nikhil and Wang, Lucy Lu and Bragg, Jonathan},
  journal={Proceedings of the 29th International Conference on Intelligent User Interfaces},
  year={2024}
}
IUI

Superficial Alignment and Subtle Divergence in LLM Decision-Making

Manuel Cherep*, Nikhil Singh*, Pattie Maes
NeurIPS 2024 Workshop on Behavioral Machine Learning
Published in 2024
Paper
BibTeX
@article{cherepsuperficial2024,
  title={Superficial Alignment and Subtle Divergence in LLM Decision-Making},
  author={Cherep, Manuel and Singh, Nikhil and Maes, Pattie},
  journal={NeurIPS 2024 Workshop on Behavioral Machine Learning},
  year={2024}
}
NeurIPS BehavioralML

Human detection of political speech deepfakes across transcripts, audio, and video

Matthew Groh*, Aruna Sankaranarayanan*, Nikhil Singh, Dong Young Kim, Andrew Lippman, Rosalind Picard
Nature Communications
Published in 2024
Paper
BibTeX
@article{grohhuman2024,
  title={Human detection of political speech deepfakes across transcripts, audio, and video},
  author={Groh, Matthew and Sankaranarayanan, Aruna and Singh, Nikhil and Kim, Dong Young and Lippman, Andrew and Picard, Rosalind},
  journal={Nature Communications},
  year={2024}
}
Nature Communications

Looking similar sounding different: Leveraging counterfactual cross-modal pairs for audiovisual representation learning

Nikhil Singh, Chih-Wei Wu, Iroro Orife, Mahdi Kalayeh
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Published in 2024
Paper
BibTeX
@article{singhlooking2024,
  title={Looking similar sounding different: Leveraging counterfactual cross-modal pairs for audiovisual representation learning},
  author={Singh, Nikhil and Wu, Chih-Wei and Orife, Iroro and Kalayeh, Mahdi},
  journal={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year={2024}
}
CVPR

Articulatory Synthesis of Speech and Diverse Vocal Sounds via Optimization

Luke Mo*, Manuel Cherep*, Nikhil Singh*, Quinn Langford, Pattie Maes
Audio Imagination: NeurIPS 2024 Workshop AI-Driven Speech, Music, and Sound Generation
Published in 2024
Paper
BibTeX
@article{moarticulatory2024,
  title={Articulatory Synthesis of Speech and Diverse Vocal Sounds via Optimization},
  author={Mo, Luke and Cherep, Manuel and Singh, Nikhil and Langford, Quinn and Maes, Pattie},
  journal={Audio Imagination: NeurIPS 2024 Workshop AI-Driven Speech, Music, and Sound Generation},
  year={2024}
}
NeurIPS AudioImagination

Consent in Crisis: The Rapid Decline of the AI Data Commons

Shayne Longpre, Robert Mahari, Ariel Lee, Campbell Lund, Hamidah Oderinwale, William Brannon, Nayan Saxena, Naana Obeng-Marnu, Tobin South, Cole Hunter, Kevin Klyman, Christopher Klamm, Hailey Schoelkopf, Nikhil Singh, Manuel Cherep, Ahmad Anis, An Dinh, Caroline Chitongo, Da Yin, Damien Sileo, Deividas Mataciunas, Diganta Misra, Emad Alghamdi, Enrico Shippole, Jianguo Zhang, Joanna Materzynska, Kun Qian, Kush Tiwary, Lester Miranda, Manan Dey, Minnie Liang, Mohammed Hamdy, Niklas Muennighoff, Seonghyeon Ye, Seungone Kim, Shrestha Mohanty, Vipul Gupta, Vivek Sharma, Vu Minh Chien, Xuhui Zhou, Yizhi Li, Caiming Xiong, Luis Villa, Stella Biderman, Hanlin Li, Daphne Ippolito, Sara Hooker, Jad Kabbara, Sandy Pentland
NeurIPS (Datasets & Benchmarks Track)
Published in 2024
Paper
BibTeX
@article{longpreconsent2024,
  title={Consent in Crisis: The Rapid Decline of the AI Data Commons},
  author={Longpre, Shayne and Mahari, Robert and Lee, Ariel and Lund, Campbell and Oderinwale, Hamidah and Brannon, William and Saxena, Nayan and Obeng-Marnu, Naana and South, Tobin and Hunter, Cole and Klyman, Kevin and Klamm, Christopher and Schoelkopf, Hailey and Singh, Nikhil and Cherep, Manuel and Anis, Ahmad and Dinh, An and Chitongo, Caroline and Yin, Da and Sileo, Damien and Mataciunas, Deividas and Misra, Diganta and Alghamdi, Emad and Shippole, Enrico and Zhang, Jianguo and Materzynska, Joanna and Qian, Kun and Tiwary, Kush and Miranda, Lester and Dey, Manan and Liang, Minnie and Hamdy, Mohammed and Muennighoff, Niklas and Ye, Seonghyeon and Kim, Seungone and Mohanty, Shrestha and Gupta, Vipul and Sharma, Vivek and Minh Chien, Vu and Zhou, Xuhui and Li, Yizhi and Xiong, Caiming and Villa, Luis and Biderman, Stella and Li, Hanlin and Ippolito, Daphne and Hooker, Sara and Kabbara, Jad and Pentland, Sandy},
  journal={NeurIPS (Datasets & Benchmarks Track)},
  year={2024}
}
NeurIPS D&B Track

Ellie Talks About the Weather: Toward Evaluating the Expressive and Enrichment Potential of a Tablet-Based Speech Board in a Single Goffin’s Cockatoo

Jennifer Cunha, Corinne C Renguette, Nikhil Singh, Lily Stella, Megan Mcmahon, Hao Jin, Rebecca Kleinberger
Proceedings of the CHI Conference on Human Factors in Computing Systems
Published in 2024
Paper
BibTeX
@article{cunhaellie2024,
  title={Ellie Talks About the Weather: Toward Evaluating the Expressive and Enrichment Potential of a Tablet-Based Speech Board in a Single Goffin’s Cockatoo},
  author={Cunha, Jennifer and Renguette, Corinne C and Singh, Nikhil and Stella, Lily and Mcmahon, Megan and Jin, Hao and Kleinberger, Rebecca},
  journal={Proceedings of the CHI Conference on Human Factors in Computing Systems},
  year={2024}
}
CHI

2023

2 publications

SynthAX: A Fast Modular Synthesizer in JAX

Manuel Cherep*, Nikhil Singh*
Audio Engineering Society Convention 155
Published in 2023
Paper
BibTeX
@article{cherepsynthax:2023,
  title={SynthAX: A Fast Modular Synthesizer in JAX},
  author={Cherep, Manuel and Singh, Nikhil},
  journal={Audio Engineering Society Convention 155},
  year={2023}
}
AES

Investigating the Physiological and Psychological Effect of an Interactive Musical Interface for Stress and Anxiety Reduction

Kimaya Lecamwasam, Samantha Gutierrez Arango, Nikhil Singh, Neska Elhaouij, Max Addae, Rosalind Picard
Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
Published in 2023
Paper
BibTeX
@article{lecamwasaminvestigating2023,
  title={Investigating the Physiological and Psychological Effect of an Interactive Musical Interface for Stress and Anxiety Reduction},
  author={Lecamwasam, Kimaya and Gutierrez Arango, Samantha and Singh, Nikhil and Elhaouij, Neska and Addae, Max and Picard, Rosalind},
  journal={Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems},
  year={2023}
}
CHI-LBW

2022

3 publications

Voice at NIME: a Taxonomy of New Interfaces for Vocal Musical Expression

Rébecca Kleinberger, Nikhil Singh, Xiao Xiao, Akito van Troyer
NIME 2022
Published in 2022
Paper
BibTeX
@article{kleinbergervoice2022,
  title={Voice at NIME: a Taxonomy of New Interfaces for Vocal Musical Expression},
  author={Kleinberger, Rébecca and Singh, Nikhil and Xiao, Xiao and van Troyer, Akito},
  journal={NIME 2022},
  year={2022}
}
NIME

Where to hide a stolen elephant: Leaps in creative writing with multimodal machine intelligence

Nikhil Singh*, Guillermo Bernal*, Daria Savchenko*, Elena L Glassman
ACM Transactions on Computer-Human Interaction
Published in 2022
Paper
BibTeX
@article{singhwhere2022,
  title={Where to hide a stolen elephant: Leaps in creative writing with multimodal machine intelligence},
  author={Singh, Nikhil and Bernal, Guillermo and Savchenko, Daria and Glassman, Elena L},
  journal={ACM Transactions on Computer-Human Interaction},
  year={2022}
}
TOCHI

A neural network solves, explains, and generates university math problems by program synthesis and few-shot learning at human level

Iddo Drori, Sarah Zhang, Reece Shuttleworth, Leonard Tang, Albert Lu, Elizabeth Ke, Kevin Liu, Linda Chen, Sunny Tran, Newman Cheng, Roman Wang, Nikhil Singh, Taylor L Patti, Jayson Lynch, Avi Shporer, Nakul Verma, Eugene Wu, Gilbert Strang
Proceedings of the National Academy of Sciences
Published in 2022
Paper
BibTeX
@article{droria2022,
  title={A neural network solves, explains, and generates university math problems by program synthesis and few-shot learning at human level},
  author={Drori, Iddo and Zhang, Sarah and Shuttleworth, Reece and Tang, Leonard and Lu, Albert and Ke, Elizabeth and Liu, Kevin and Chen, Linda and Tran, Sunny and Cheng, Newman and Wang, Roman and Singh, Nikhil and Patti, Taylor L and Lynch, Jayson and Shporer, Avi and Verma, Nakul and Wu, Eugene and Strang, Gilbert},
  journal={Proceedings of the National Academy of Sciences},
  year={2022}
}
PNAS

2021

3 publications

Image2Reverb: Cross-Modal Reverb Impulse Response Synthesis

Nikhil Singh, Jeff Mentch, Jerry Ng, Matthew Beveridge, Iddo Drori
IEEE/CVF International Conference on Computer Vision (ICCV)
Published in 2021
Paper
BibTeX
@article{singhimage2reverb:2021,
  title={Image2Reverb: Cross-Modal Reverb Impulse Response Synthesis},
  author={Singh, Nikhil and Mentch, Jeff and Ng, Jerry and Beveridge, Matthew and Drori, Iddo},
  journal={IEEE/CVF International Conference on Computer Vision (ICCV)},
  year={2021}
}
ICCV

Image2Lego: Customized LEGO Set Generation from Images

Kyle Lennon, Katharina Fransen, Alexander O'Brien, Yumeng Cao, Matthew Beveridge, Yamin Arefeen, Nikhil Singh, Iddo Drori
arXiv preprint arXiv: 2108.08477
Published in 2021
Paper
BibTeX
@article{lennonimage2lego:2021,
  title={Image2Lego: Customized LEGO Set Generation from Images},
  author={Lennon, Kyle and Fransen, Katharina and O'Brien, Alexander and Cao, Yumeng and Beveridge, Matthew and Arefeen, Yamin and Singh, Nikhil and Drori, Iddo},
  journal={arXiv preprint arXiv: 2108.08477},
  year={2021}
}
arXiv