YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
SciEGQA Bench
Quick start
import json
from pathlib import Path
from PIL import Image, ImageDraw
with open("SciEGQA_Bench.jsonl", "r", encoding="utf-8") as f:
sample = json.loads(next(f))
for page, boxes in zip(sample["evidence_page"], sample["bbox"]):
page_path = (
Path(sample["category"])
/ sample["doc_name"]
/ f"{sample['doc_name']}_{page}.png"
)
image = Image.open(page_path).convert("RGB")
draw = ImageDraw.Draw(image)
for xmin, ymin, xmax, ymax in boxes:
draw.rectangle((xmin, ymin, xmax, ymax), outline="red", width=5)
image.show()
Notes
evidence_pageis 1-based and directly matches the page number in the PNG file name.- Samples may reference either one page or two pages.
- Bounding boxes are provided in both absolute pixel coordinates (
bbox) and normalized coordinates (rel_bbox). - The benchmark is intended for evaluating both answer quality and evidence grounding quality.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support