Source Themes

Transformers as Transducers
We characterize transformer sequence models as transducers and show some expressivity bounds for several variants.
Lena Strobl, Dana Angluin, David Chiang, Jon Rawski, Ashish Sabharwal
arXiv Preprint
Transformers as Transducers
The Problem-Ladenness of Theory
We give a pragmatic problem-centered account of theories’ epistemic virtues like coherence, depth, and parsimony.
Daniel Levenstein, Aniello De Santo, Saskia Heijnen, M. Narayan, Freek Oude Maatman, Jon Rawski, Cory wright
PDF OSF link
The Problem-Ladenness of Theory