(Notes: 1. If you don’t have access to github or arxiv, contact me for a copy. 2. Google Colaboratory notebooks look messy, but press the “open with colab” button and they sort themselves out.)
Thinking Like Transformers – ICML 2021 — Gail Weiss, Yoav Goldberg, Eran Yahav. PDF // Github (REPL) // Github (Experiments) // Poster // 5 min talk (ICML 2021): slides, talk // 1 hour talk (Edinburgh 2021): talk / slides
On the Practical Computational Power of Finite Precision RNNs for Language Recognition – ACL 2018 — Gail Weiss, Yoav Goldberg, Eran Yahav. PDF // 10 min talk (ACL 2018): talk // Github // Google Colaboratory
- Notes: This paper is mostly an observation that LSTMs can implement a counting mechanism and GRUs can’t, so the code here is just a demonstration of this.
Extracting Automata from Recurrent Neural Networks Using Queries and Counterexamples – ICML 2018 — Gail Weiss, Yoav Goldberg, Eran Yahav. PDF // 10 min talk (ICML 2018): talk // Github // Google Colaboratory // Poster (with thanks to Xiaokun Luan for corrections!) // Extended 2022 Version, open link (Springer)
Talks (Independent of Publications)