Pico Language Model

pico-lm's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

suchirsalhan 

authored 5 papers about 2 months ago

BLiSS 1.0: Evaluating Bilingual Learner Competence in Second Language Small Language Models

Paper • 2510.19419 • Published Oct 22 • 1

What is the Best Sequence Length for BABYLM?

Paper • 2510.19493 • Published Oct 22 • 1

Teacher Demonstrations in a BabyLM's Zone of Proximal Development for Contingent Multi-Turn Interaction

Paper • 2510.20411 • Published Oct 23 • 2

BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Data

Paper • 2510.10159 • Published Oct 11 • 3

Looking to Learn: Token-wise Dynamic Gating for Low-Resource Vision-Language Modelling

Paper • 2510.08470 • Published Oct 9 • 1

suchirsalhan 

authored 2 papers 2 months ago

Pico: A Modular Framework for Hypothesis-Driven Small Language Model Research

Paper • 2509.16413 • Published Sep 19 • 1

Meta-Pretraining for Zero-Shot Cross-Lingual Named Entity Recognition in Low-Resource Philippine Languages

Paper • 2509.02160 • Published Sep 2 • 1

rdiehlmartinez 

updated a Space 5 months ago

Running

README

📈

suchirsalhan 

authored a paper 6 months ago

ByteSpan: Information-Driven Subword Tokenisation

Paper • 2506.18639 • Published Jun 23 • 3

rdiehlmartinez 

updated 4 models 6 months ago

pico-lm/pico-decoder-large

Text Generation • 0.6B • Updated Jun 23 • 432

pico-lm/pico-decoder-medium

Text Generation • 0.2B • Updated Jun 23 • 309

pico-lm/pico-decoder-small

Text Generation • 64.6M • Updated Jun 23 • 344

pico-lm/pico-decoder-tiny

Text Generation • 11.3M • Updated Jun 23 • 387 • 3

rdiehlmartinez 

authored 7 papers 8 months ago

CLIMB: Curriculum Learning for Infant-inspired Model Building

Paper • 2311.08886 • Published Nov 15, 2023

Mitigating Frequency Bias and Anisotropy in Language Model Pre-Training with Syntactic Smoothing

Paper • 2410.11462 • Published Oct 15, 2024

Attention-based Contextual Language Model Adaptation for Speech Recognition

Paper • 2106.01451 • Published Jun 2, 2021

From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes

Paper • 2410.22906 • Published Oct 30, 2024

Less is More: Pre-Training Cross-Lingual Small-Scale Language Models with Cognitively-Plausible Curriculum Learning Strategies

Paper • 2410.22886 • Published Oct 30, 2024 • 1

Tending Towards Stability: Convergence Challenges in Small Language Models

Paper • 2410.11451 • Published Oct 15, 2024

Automatically Neutralizing Subjective Bias in Text

Paper • 1911.09709 • Published Nov 21, 2019