Single Headed Attention RNN: Stop Thinking With Your Head with Stephen Merity - #325

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

EpisodeDec 12, 201959m

Single Headed Attention RNN: Stop Thinking With Your Head with Stephen Merity - #325

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

EpisodeDec 12, 201959m

Today we’re joined by Stephen Merity, an independent researcher focused on NLP and Deep Learning. In our conversation, we discuss Stephens latest paper, Single Headed Attention RNN: Stop Thinking With Your Head, detailing his primary motivations behind the paper, the decision to use SHA-RNNs for this research, how he built and trained the model, his approach to benchmarking, and finally his goals for the research in the broader research community.

Top comments

Machine learning and artificial intelligence are dramatically changing the way businesses operate and people live. The TWIML AI Podcast brings the top minds and ideas from the world of ML and AI to a broad and influential community of ML/AI researchers, data scientists, engineers and tech-savvy business and IT leaders. Hosted by Sam Charrington, a sought after industry analyst, speaker, commentator and thought leader. Technologies covered include machine learning, artificial intelligence, deep learning, natural language processing, neural networks, analytics, computer science, data science and more.

twimlai.com

Switch to the Fountain App

Open in Fountain