Hugging Face's logo
Jim Lai's picture

Jim Lai

grimjim
66
dolwin's profile picture rocca's profile picture nerdigent's profile picture
·

AI & ML interests

Experimenting primarily with 7B-12B parameter text completion models. Not all models are intended for direct end use, but aim for research and/or educational purposes. Recent Contributions: stabilized refusal direction ablation via Gram-Schmidt orthonormalization and norm-preserving interventions; confirmed reasoning transfer via model merger.

Recent Activity

posted an update 4 days ago
I think it's clear in retrospect that "frankenmerges", which repeated blocks of layers, amounted to a crude approximation of looped transformers architecture, hence them able to work at all instead of just breaking. They lucked out due to much of the signal passing through residual streams being preserved and only modulated along the way. That said, not all models are suited for this. Models which feature ever-increasing magnitudes as inference progressess through layers risk exploding precision limits.
new activity about 2 months ago
jukofyork/creative-writing-control-vectors-v3.0:“The doom lies in yourself, not in your name.”
new activity 2 months ago
jukofyork/creative-writing-control-vectors-v3.0:“The doom lies in yourself, not in your name.”
View all activity

Organizations

Blog-explorers's profile picture Social Post Explorers's profile picture SillyTilly's profile picture Hugging Face Discord Community's profile picture Debased AI's profile picture Anthracite's profile picture Anthracite Core's profile picture smE's profile picture Hugging Face Context Course's profile picture GrimJim's Merge Workshop's profile picture Tokenizers and Chat Templates Only's profile picture MCP-1st-Birthday's profile picture GrimJim's Experimental Workshop's profile picture Build Small Hackathon's profile picture ICML 2026 Agent Reproductions's profile picture