Gemstones 💎: A Model Suite for Multi-Faceted Scaling Laws (LR Ablation)

university

https://mcleish7.github.io/gemstone-scaling-laws/

AI & ML interests

None defined yet.

Recent Activity

smcleish updated a Space 4 days ago

Gemstone-Models-LR-Ablation/README

smcleish published a Space 4 days ago

Gemstone-Models-LR-Ablation/README

smcleish authored a paper 5 months ago

Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence

View all activity

Gemstone-Models-LR-Ablation 's models 20

Gemstone-Models-LR-Ablation/Gemstone-3072x12_lr_ablation

Text Generation • 2B • Updated Feb 11, 2025

Gemstone-Models-LR-Ablation/Gemstone-256x23_lr_ablation

Text Generation • 48.4M • Updated Feb 10, 2025 • 8

Gemstone-Models-LR-Ablation/Gemstone-1024x28_lr_ablation

Text Generation • 0.5B • Updated Feb 10, 2025 • 3

Gemstone-Models-LR-Ablation/Gemstone-384x13_lr_ablation

Text Generation • 66.8M • Updated Feb 10, 2025 • 2

Gemstone-Models-LR-Ablation/Gemstone-2048x27_lr_ablation

Text Generation • 2B • Updated Feb 10, 2025

Gemstone-Models-LR-Ablation/Gemstone-512x16_lr_ablation

Text Generation • 0.1B • Updated Feb 10, 2025

Gemstone-Models-LR-Ablation/Gemstone-384x36_lr_ablation

Text Generation • 0.1B • Updated Feb 10, 2025 • 3

Gemstone-Models-LR-Ablation/Gemstone-1792x18_lr_ablation

Text Generation • 1B • Updated Feb 10, 2025

Gemstone-Models-LR-Ablation/Gemstone-2560x8_lr_ablation

Text Generation • 1B • Updated Feb 10, 2025

Gemstone-Models-LR-Ablation/Gemstone-1536x50_lr_ablation

Text Generation • 2B • Updated Feb 10, 2025 • 2

Gemstone-Models-LR-Ablation/Gemstone-1280x36_lr_ablation

Text Generation • 1B • Updated Feb 10, 2025 • 3

Gemstone-Models-LR-Ablation/Gemstone-1792x7_lr_ablation

Text Generation • 0.5B • Updated Feb 10, 2025

Gemstone-Models-LR-Ablation/Gemstone-768x45_lr_ablation

Text Generation • 0.5B • Updated Feb 10, 2025 • 2

Gemstone-Models-LR-Ablation/Gemstone-1280x15_lr_ablation

Text Generation • 0.5B • Updated Feb 10, 2025 • 1

Gemstone-Models-LR-Ablation/Gemstone-768x3_lr_ablation

Text Generation • 0.1B • Updated Feb 10, 2025 • 1

Gemstone-Models-LR-Ablation/Gemstone-256x80_lr_ablation

Text Generation • 0.1B • Updated Feb 10, 2025

Gemstone-Models-LR-Ablation/Gemstone-512x13_lr_ablation

Text Generation • 0.1B • Updated Feb 10, 2025 • 1

Gemstone-Models-LR-Ablation/Gemstone-512x12_lr_ablation

Text Generation • 98.7M • Updated Feb 10, 2025

Gemstone-Models-LR-Ablation/Gemstone-256x71_lr_ablation

Text Generation • 95.6M • Updated Feb 10, 2025 • 3

Gemstone-Models-LR-Ablation/Gemstone-256x27_lr_ablation

Text Generation • 52.3M • Updated Feb 10, 2025 • 2