Paper-Conference

Seeing Helps Reasoning in Language Models
Multimodal language models can process both images and texts, yet existing studies often find that naively incorporating visual …
Yulu Gan, Kaiya Ivy Zhao, Tomaso Poggio, Phillip Isola
Cite URL PDF
AI Gamestore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games
Rigorously evaluating machine intelligence against the broad spectrum of human general intelligence has become increasingly important …
Lance Ying, Ryan Truong, Prafull Sharma, Kaiya Ivy Zhao, Nathan Cloos, Kelsey R. Allen, Thomas L. Griffiths, Katherine M. Collins, José Hernández-Orallo, Phillip Isola, Samuel J. Gershman, Joshua B. Tenenbaum
Cite arXiv
HugAgent: Benchmarking LLMs for Simulation of Individualized Human Reasoning
Simulating human reasoning in open-ended tasks has been a long-standing aspiration in AI and cognitive science. While large language …
Chance Jiajie Li, Zhenze Mo, Yuhan Tang, Ao Qu, Jiayi Wu, Kaiya Ivy Zhao, Yulu Gan, Jie Fan, Jiangbo Yu, Hang Jiang, Paul Pu Liang, Jinhua Zhao, Luis Alonso, Kent Larson
Cite arXiv
Assessing Adaptive World Models in Machines with Novel Games
Human intelligence exhibits a remarkable capacity for rapid adaptation and effective problem-solving in novel and unfamiliar contexts. …
Lance Ying, Katherine M. Collins, Prafull Sharma, Cedric Colas, Kaiya Ivy Zhao, Adrian Weller, Zenna Tavares, Phillip Isola, Samuel J. Gershman, Jacob D. Andreas, Thomas L. Griffiths, Francois Chollet, Kelsey R. Allen, Joshua B. Tenenbaum
Cite arXiv
Simulating Society Requires Simulating Thought
Simulating society with large language models (LLMs), we argue, requires more than generating plausible behavior; it demands …
Chance Jiajie Li, Jiayi Wu, Zhenze Mo, Ao Qu, Yuhan Tang, Kaiya Ivy Zhao, Yulu Gan, Jie Fan, Jiangbo Yu, Jinhua Zhao, Paul Liang, Luis Alonso, Kent Larson
Cite arXiv
Cross-Modal Alignment Regularization: Enhancing Language Models with Vision Model Representations
Cross-modal distillation has emerged as a critical technique for leveraging strengths across different modalities. However, existing …
Yulu Gan, Kaiya Ivy Zhao, Phillip Isola
Cite URL
Enhancing Understanding in Generative Agents through Active Inquiring
As artificial intelligence advances, Large Language Models (LLMs) have evolved beyond being just tools, becoming more like human-like …
Jiaxin Ge, Kaiya Zhao, Manuel Cortes, Jovana Kondic, Shuying Luo, Michelangelo Naim, Andrew Ahn, Guangyu Robert Yang
Cite URL