🐝 Article: Where the Hivemind Comes From

Burton Lancaster PRO

RiverRider

·

https://sunstonenorth.com

Space-Bacon

AI & ML interests

Explainable AI

Recent Activity

repliedto their post about 11 hours ago

Black Window — a chat model in your browser tab, on your hardware. A memory that stays on the device that opened the page. https://blackwindow.xyz Open the site, pick a model (about 0.6B to 8B), hit Load. The weights run in that tab, on that computer. After they load, the network can drop. The context window is a working set, auto-sized to that device, up to ~32K tokens. Behind the window is the Weave. Every file, picture, recording, link, lookup, and reply is embedded as it arrives. Drop in audio and it is transcribed. Drop in an image and it is described. A question pulls the nearest passages back as notes. A long document is walked once so later questions can use the whole file, not the first pages. Nothing leaves that tab unless you turn on live lookup or connect a rented GPU box, and the chat says so each time. Prompts can go to the box. Files and the Weave stay in the tab. Console on that page: bw.ask, bw.search, bw.digest, bw.notes. A local relay exposes /v1/chat/completions on localhost so other tools on the same computer can talk to the tab. The tab polls the relay. That is the boundary. Not a server with a policy. Your hardware, a window, a Load button. If on mobile add to home-screen for best performance. If you break it lmk. It can serve a few hundred of you at a time before I have to buy a real server.

repliedto their post about 12 hours ago

Where the Hivemind Comes From: Geometry, Tuning and Format, Separated on Open Weights “First, representations are mutually recoverable. On 12 open-weight models from 8 labs, a ridge map from one model's hidden states to another's retrieves the right held-out item 0.9181 of the time across lab boundaries, against a shuffled floor of 0.00101 and a self-map ceiling of 0.999. Shared corporate lineage is worth only 0.0357 of that.” “Second, base models do not reproduce the reported level. Under the original study's own sampling settings, our base models reach intra-model 0.3644 and inter-model 0.3401 on a floor of 0.0993 that matches theirs, and zero of 720 model-prompt cells clear 0.8. The floors agree while the signal differs by more than a factor of two, so this is not a scale artifact.” “Third, and decisively, we recover their level and isolate its cause. Using six matched base/instruct pairs, holding pretrained weights, prompts, decoding and scorer fixed, instruction tuning alone raises intra-model similarity by 0.0786. The same tuned weights prompted through the model's own chat template raise it by 0.3623, reaching 0.7272, with four of six models exceeding 0.80 and reproducing the band reported for frontier systems from models of 0.6B to 2B. The prompt format does roughly 4.6 times the work of the tuning.” paper attached 🧾 https://huggingface.co/blog/RiverRider/where-the-hivemind-comes-from-geometry-tuning-and

published an article about 14 hours ago

Finding the File: Localisation on SWE-bench Verified, Measured Against a Permuted-Query Floor

View all activity

Organizations

RiverRider 's collections 3