Dear all,
Next week, we have the pleasure of having Dr. Amir Feder give a talk in the
colloquium.
The seminar will be held on Monday, December 18th at 14:00.
Location: C220.
The title, abstract and bio appear below.
Looking forward to seeing you,
Sagie and Liat
*Title*:
Causally-driven ML for Text
*Abstract:*
A fundamental goal of scientific research is to learn about causal
relationships, yet this aspect remains underrepresented in machine
learning. Recent advances, particularly with large language models (LLMs),
have primarily focused on leveraging neural architectures to extract
correlations from extensive datasets. However, despite their success,
correlational predictive models can be untrustworthy: they rely on
shortcuts in the data, leading to errors when applied to
out-of-distribution settings; and their representation of text lacks
interpretability, rendering them unsuitable for scientific inquiry.
In this talk, I will show how a causal perspective can mitigate these
shortcomings. I will show how by understanding causal relationships in data
we can reduce reliance on shortcuts, and present causally-driven methods
that leverage causal structures to perform better out-of-distribution.
Then, I will briefly describe how to build probabilistic models of text
that reveal interpretable latent variables tailored for estimating causal
effects. Finally, I discuss my vision for building science-ready text
models.
*Bio*:
Amir Feder is a postdoctoral fellow at the Columbia University Data Science
Institute, working with David Blei. He is currently also a visiting faculty
researcher at Google Research. He works in the field of machine learning
and causal inference, with a focus on text data. His research develops
methods that integrate causality into natural language processing (NLP) to
improve the reliability of NLP systems, and to facilitate scientific
inquiry with text data. He was a co-organizer of the First Workshop on NLP
and Causal Inference (CI+NLP) at EMNLP 2021, the Tutorial on Causality for
NLP at EMNLP 2022, and the Workshop on Spurious Correlations, Invariance
and Stability at ICML 2023.
Before joining Columbia, Amir received his PhD from the Technion, where he
was advised by Roi Reichart and worked closely with Uri Shalit. In a
previous (academic) life, he was an economics, statistics and history
student at Tel Aviv University, the Hebrew University of Jerusalem and
Northwestern University.