Research

MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Data

Our architecture achieves a 40x finetuning speedup using a novel functional alignment procedure.

ICML 2024ICLR 2024 Re-Align Workshop

Authors

Paul S. Scotti, Mihir Tripathy ... Tong Chen, Jonathan Xu, Thomas Naselaris, Kenneth A. Norman, Tanishq Mathew Abraham

Alljoined1

We create a dataset built specifically for EEG-to-Image decoding, featuring 46,080 epochs of brain responses recorded with a 64-channel EEG headset.

CVPR 2024 DCAMI Workshop

Authors

Jonathan Xu, Bruno Aristimunha, Max Emanuel Feucht, Emma Qian, Charles Liu ... Adrian Nestor

HarvestNet: A Dataset for Detecting Smallholder Farming Activity Using Harvest Piles and Remote Sensing

We introduce 7k hand-labeled images and 2k ground collected labels of harvest piles. Models trained on it detect smallholder farms better than SOTA land cover maps.

AAAI 2024 oral presentationCVPR 2024 V4A Workshop

Authors

Jonathan Xu*, Amna Elmustafa*, Liya Weldegebriel, Emnet Negash, Richard Lee, David Lobell, Stefano Ermon

Structure-Preserved Image Reconstruction from Brain Recordings

We propose a 2D cortical surface-based autoencoder to preserve spatial information in fMRI data, resulting in much better representations. We then decode images from brain recordings.

ISMRM 2024

Authors

Zijiao Chen*, Jonathan Xu*, Jiaxin Qing, Ruilin Li, Juan Helen Zhou