1

Tokenization and the Noiseless Channel

Vilém Zouhar

• Jul 1, 2023 • 1 min read

On the Efficacy of Sampling Adapters

Clara Meister

• Jul 1, 2023 • 1 min read

A Measure-theoretic Characterzation of Tight Language Model

Li Du

• Jul 1, 2023 • 1 min read

A Formal Perspective on Byte-Pair Encoding

Vilém Zouhar

• Jul 1, 2023 • 1 min read

On the Usefulness of Embeddings, Clusters and Strings for Text Generation Evaluation

Tiago Pimentel$^*$

• May 1, 2023 • 1 min read

Mutual Information and Hallucinations in Abstractive Summarization featured image

Mutual Information and Hallucinations in Abstractive Summarization

Liam Van Der Poel

• Dec 1, 2022 • 1 min read

On the probability–quality paradox in language generation generation

Clara Isabel Meister

• May 1, 2022 • 1 min read

Estimating the Entropy of Linguistic Distributions

Aryaman Arora

• May 1, 2022 • 1 min read

Analyzing Wrap-Up Effects through an Information-Theoretic Lens

Clara Meister

• May 1, 2022 • 1 min read

Cluster-based Evaluation of Automatically Generated Text featured image

Cluster-based Evaluation of Automatically Generated Text

Tiago Pimentel\*

• Jan 1, 2022 • 1 min read