ConTSG-Bench Checkpoints (Public Subset)
This repository hosts the official public checkpoint release for ConTSG-Bench.
Release Scope
The current public release includes checkpoints and reproducibility assets for:
synth-usynth-m
Checkpoints for other benchmark datasets are not publicly released at this stage.
Repository Structure
.
βββ experiments/
β βββ <model>/
β βββ synth-u/
β β βββ seed{0,1,2}/
β β βββ checkpoints/
β β β βββ finetune/
β β β βββ best.ckpt
β β βββ config.template.yaml
β β βββ results/
β β β βββ expected_seed_metrics.json
β β βββ summary.json
β βββ synth-m/
β βββ seed{0,1,2}/
β βββ checkpoints/
β β βββ finetune/
β β βββ best.ckpt
β βββ config.template.yaml
β βββ results/
β β βββ expected_seed_metrics.json
β βββ summary.json
βββ resources/
β βββ cttp/
β βββ synth-u/
β β βββ clip_model_best.pth
β β βββ model_configs.yaml
β βββ synth-m/
β βββ clip_model_best.pth
β βββ model_configs.yaml
βββ expected/
β βββ full_results_synth.csv
β βββ results_mean_std_synth.csv
β βββ seed_metrics_nested.json
βββ manifests/
βββ release_manifest_public.json
Reproducibility Notes
- This release is designed to support leaderboard reproducibility for the public subset.
- Some config templates contain placeholders (for example
${LONGCLIP_ROOT}) that should be set to your local dependency path before running.
Related Links
- Dataset repository: https://huggingface.co/datasets/mldi-lab/ConTSG-Bench-Datasets
- Main project repository: https://github.com/seqml/ConTSG-Bench
- Leaderboard Space: https://huggingface.co/spaces/mldi-lab/ConTSG-Bench-Leaderboard
Inference Providers NEW
This model isn't deployed by any Inference Provider. π Ask for provider support