278 MB
8 files
Updated 14 days ago
Name
Size
checkpoints
tokenizer
.gitattributes10.1 kB
xet
LICENSE11.4 kB
xet
README.md1.53 kB
xet
config.json1.27 kB
xet
needle3.cact35.3 MB
xet
README.md

Cactus Compute - Sub-50mb Super Intelligence For Consumer Devices

Needle 3

An on-device model for tool calling, structured extraction and text embeddings. See the Needle website for model details, benchmarks and the browser demo.

Get started

pip install -U cactus-compute
import cactus

@cactus.tool
def get_weather(city: str):
    "Get the current weather for a city."
    return {"city": city, "temp_c": 27, "sky": "clear"}

with cactus.Cactus(tools=[get_weather]) as agent:
    print(agent.run("What's the weather in Lagos?")["results"])

The package downloads and caches the engine and weights on first use. This repository provides needle3.cact and checkpoints/needle3.safetensors. Runtime binaries and supported platforms live in the Cactus repository.

Guides

Total size
278 MB
Files
8
Last updated
Nov 6
Pre-warmed CDN
US EU US EU

Contributors