Publications | Clara Meister

Mutual Information and Hallucinations in Abstractive Summarization

Despite significant progress in the quality of language generated from abstractive summarization models, these models still exhibit the …

Liam van der Poel, Ryan Cotterell, Clara Meister

Mutual Information and Hallucinations in Abstractive Summarization

On the probability–quality paradox in language generation generation

Clara Isabel Meister, Gian Wiher, Tiago Pimentel, Ryan Cotterell

Estimating the Entropy of Linguistic Distributions

Aryaman Arora, Clara Isabel Meister, Ryan Cotterell

Analyzing Wrap-Up Effects through an Information-Theoretic Lens

Clara Meister, Tiago Pimentel, Thomas Hikaru Clark, Ryan Cotterell, Roger P. Levy

On Decoding Strategies for Neural Text Generators

When generating text from probabilistic models, the chosen decoding strategy has a profound effect on the resulting text. Yet …

Gian Wiher, Clara Meister, Ryan Cotterell

Naturalistic Causal Probing for Morpho-Syntax

Afra Amini, Tiago Pimentel, Clara Meister, Ryan Cotterell

Locally Typical Sampling

Today’s probabilistic language generators fall short when it comes to producing coherent and fluent text, despite the fact that …

Clara Meister, Tiago Pimentel, Gian Wiher, Ryan Cotterell

Cluster-based Evaluation of Automatically Generated Text

While probabilistic language generators have improved dramatically over the last few years, the automatic evaluation metrics used to …

Tiago Pimentel\*, Clara Meister\*, Ryan Cotterell

Cluster-based Evaluation of Automatically Generated Text

Revisiting the Uniform Information Density Hypothesis

Clara Meister, Tiago Pimentel, Patrick Haller, Lena Jäger, Ryan Cotterell, Roger Levy

Phone-level Uniform Information Density across and within Languages

Tiago Pimentel, Clara Meister, Elizabeth Salesky, Simone Teufel, Damián Blasi, Ryan Cotterell

On Homophony and Rényi Entropy

Tiago Pimentel, Clara Meister, Simone Teufel, Ryan Cotterell

Keyword2Text: A Plug-and-Play Method for Controlled Text Generation

Damian Pascual, Beni Egressy, Clara Meister, Ryan Cotterell, Roger Wattenhofer

Conditional Poisson Stochastic Beams

Clara Meister, Afra Amini, Tim Vieira, Ryan Cotterell

Language Model Evaluation Beyond Perplexity

We propose an alternate approach to quantifying how well language models learn natural language: we ask how well they match the …

Clara Meister, Ryan Cotterell

Is Sparse Attention more Interpretable?

Sparse attention has been claimed to increase model interpretability under the assumption that it highlights influential inputs. Yet …

Clara Meister, Stefan Lazov, Isabelle Augenstein, Ryan Cotterell

Determinantal Beam Search

Beam search is today’s go-to strategy for decoding neural sequence models. The algorithm can naturally be viewed as a subset …

Clara Meister, Martina Forster, Ryan Cotterell

A Cognitive Regularizer for Language Modeling

The uniform information density (UID) hypothesis, which posits that speakers prefer utterances that distribute information uniformly …

Jason Wei, Clara Meister, Ryan Cotterell

Testing Machine Translation via Referential Transparency

Machine translation software has seen rapid progress in recent years due to the advancement of deep neural networks. People routinely …

Pinjia He, Clara Meister, Zhendong Su

Searching for Search Errors in Neural Morphological Inflection

Neural sequence-to-sequence models are currently the predominant choice for language generation tasks. Yet, on word-level tasks, exact …

Martina Forster, Clara Meister, Ryan Cotterell

If Beam Search is the Answer, What was the Question?

Clara Meister, Tim Vieira, Ryan Cotterell

Structure-Invariant Testing for Machine Translation

Machine translation software has increasingly been integrated into our daily lives. People routinely use machine translation for …

Pinjia He, Clara Meister, Zhendong Su

Machine Translation Testing via Pathological Invariance

Machine translation software has become heavily integrated into our daily lives due to the recent improvement in the performance of …

Shahij Gupta, Pinjia He, Clara Meister, Zhendong Su

Best-First Beam Search

Decoding for many NLP tasks requires a heuristic algorithm for approximating exact search since the full search space is often …

Clara Meister, Tim Vieira, Ryan Cotterell

Generalized Entropy Regularization or: There's Nothing Special about Label Smoothing

Prior work has explored directly regularizing the output distributions of probabilistic models to alleviates peaky (i.e. …

Clara Meister, Elizabeth Salesky, Ryan Cotterell