123B: Scaling Language Modeling with Transformer-XL

This groundbreaking investigation by Google AI explores the potential of Transformer-XL for scaling up language modeling. The authors introduce a novel architecture that enables training of massive language models with billions of parameters, achieving state-of-the-art results on a variety of natural language understanding tasks. By extending the t

read more

Throwback Thursday

MM99, remember that? It feels like a lifetime ago. Back then we were rocking retro sprites. The music was all chiptune melodies. And don't even get me started on the storylines that were wild. It was a golden era for gaming, full of gritty fun. I still think about it Let's talk about A classic that deserves recognition Unveiling the Enigma

read more