allenai/longformer-base-4096
Updated • 965k • 229
Long-Context LLMs
-
-
google/bigbird-roberta-base
Updated • 284k • 62 -
Longformer: The Long-Document Transformer
Paper • 2004.05150 • Published • 4 -
Big Bird: Transformers for Longer Sequences
Paper • 2007.14062 • Published • 2 -
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Paper • 1804.07461 • Published • 4 -
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
Paper • 1905.00537 • Published • 3 -
Attention Is All You Need
Paper • 1706.03762 • Published • 140