chopratejas
/

kompress-base

Token Classification

token-compression

context-optimization

Eval Results (legacy)

Model card Files Files and versions

760 MB

Ctrl+K

Ctrl+K

1 contributor

History: 10 commits

chopratejas's picture

Add ONNX INT8 model (156MB, no torch dependency needed)

1c91234 verified 2 months ago

onnx
Add ONNX INT8 model (156MB, no torch dependency needed) 2 months ago
.gitattributes

1.52 kB
initial commit 3 months ago
README.md

6.42 kB
Update: v9 results (7.9/10 quality), add kompress-small comparison 3 months ago
config.json

2.78 kB
Initial release: Kompress v1 — ModernBERT token compressor for agentic contexts 3 months ago
model.safetensors

600 MB
xet

Update to v8: density-aware compression (293K Sonnet 4.6 labels with density tags) 2 months ago
tokenizer.json

3.58 MB
Initial release: Kompress v1 — ModernBERT token compressor for agentic contexts 3 months ago
tokenizer_config.json

351 Bytes
Initial release: Kompress v1 — ModernBERT token compressor for agentic contexts 3 months ago
training_args.bin
Detected Pickle imports (10)
- "transformers.training_args.OptimizerNames",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.HubStrategy",
- "accelerate.state.PartialState",
- "torch.device",
- "transformers.training_args.TrainingArguments",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.SchedulerType",
- "transformers.trainer_utils.SaveStrategy"
How to fix it?
5.2 kB
xet

Update to v8: density-aware compression (293K Sonnet 4.6 labels with density tags) 2 months ago