Grouped Value Attention: Efficient KV Caching via On-Demand Key Reconstruction
Paper • 2609.13285 • Published • 78
AI & ML interests
Open science and open source
ramshakhan
authored a
paper 7 days ago
akhaliq
submitted 3
papers to Daily Papers 4 months ago
DynaFLIP: Rethinking Robotics Perception via Tri-Modal-Dynamics Guided Representation
Paper • 2605.30350 • Published • 10
Contrastive Distribution Matching for Amortized Sequential Monte Carlo in Discrete Diffusion
Paper • 2605.23346 • Published
optimize_anything: A Universal API for Optimizing any Text Parameter
Paper • 2605.19633 • Published • 6
Sri-Vigneshwar-DJ
posted an update 5 months ago
Post
190
We ran Feather DB v0.8.0 on LongMemEval (ICLR 2025) — 500 questions across real multi-session conversations, up to 115K tokens each.
**Score: 0.693** · GPT-4o full-context baseline: 0.640
Full 500-question run with Gemini-Flash: **$2.40**
Per-axis breakdown:
→ Info-extraction: **0.942**
→ Knowledge-update: **0.714**
→ Multi-session: **0.606**
→ Temporal: **0.477** ← the hard one, Phase 9 addresses this
Architecture: Hybrid BM25+dense · adaptive temporal decay · embedded (no server) · p50 = 0.19ms · MIT
Raw results + audit JSONs: Hawky-ai/longmemeval-results
We ran Feather DB v0.8.0 on LongMemEval (ICLR 2025) — 500 questions across real multi-session conversations, up to 115K tokens each.
**Score: 0.693** · GPT-4o full-context baseline: 0.640
Full 500-question run with Gemini-Flash: **$2.40**
Per-axis breakdown:
→ Info-extraction: **0.942**
→ Knowledge-update: **0.714**
→ Multi-session: **0.606**
→ Temporal: **0.477** ← the hard one, Phase 9 addresses this
Architecture: Hybrid BM25+dense · adaptive temporal decay · embedded (no server) · p50 = 0.19ms · MIT
pip install feather-dbRaw results + audit JSONs: Hawky-ai/longmemeval-results
woojun-jung
authored a
paper 5 months ago
akhaliq
submitted a
paper to Daily Papers 5 months ago
akhaliq
submitted 3
papers to Daily Papers 6 months ago
MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines
Paper • 2603.06679 • Published • 5
AVO: Agentic Variation Operators for Autonomous Evolutionary Search
Paper • 2603.24517 • Published • 13
V-Co: A Closer Look at Visual Representation Alignment via Co-Denoising
Paper • 2603.16792 • Published • 3
Keeby-smilyai
posted an update 6 months ago
Post
3194
Hello everyone!
- 1 reply
akhaliq
submitted a
paper to Daily Papers 6 months ago
akhaliq
submitted a
paper to Daily Papers 7 months ago
Sri-Vigneshwar-DJ
posted an update 8 months ago
Post
1474
Just released a new dataset designed for training reasoning models on Meta (Facebook/Instagram) advertising fatigue detection!
What is it? A GRPO (Group Relative Policy Optimization) training dataset with 200+ carefully crafted scenarios covering:
🔍 Fatigue Signal Detection: CTR drops, CPM spikes, frequency analysis
🩺 Performance Diagnosis: Root cause analysis frameworks
📋 Strategy: Creative refresh cadence, testing frameworks
📊 Analysis: ROI calculations, metric interpretation
Why GRPO? GRPO training helps models learn structured reasoning. Each response follows the <thinking> and <answer> format.
Check it out here: Sri-Vigneshwar-DJ/meta-fatigue-grpo-dataset
What is it? A GRPO (Group Relative Policy Optimization) training dataset with 200+ carefully crafted scenarios covering:
🔍 Fatigue Signal Detection: CTR drops, CPM spikes, frequency analysis
🩺 Performance Diagnosis: Root cause analysis frameworks
📋 Strategy: Creative refresh cadence, testing frameworks
📊 Analysis: ROI calculations, metric interpretation
Why GRPO? GRPO training helps models learn structured reasoning. Each response follows the <thinking> and <answer> format.
Check it out here: Sri-Vigneshwar-DJ/meta-fatigue-grpo-dataset
akhaliq
submitted 2
papers to Daily Papers 8 months ago
Sri-Vigneshwar-DJ
posted an update 8 months ago
Post
251
🏙️ Hugging Face Community Post
Title: 🧬 Experimenting with "Dynamic Chaos" in Tamil SLMs
Hi everyone! I just published a new experimental study on Small Language Model (SLM) resilience.
I took the Qwen2.5-0.5B model and put it through a "Chaos Phase" to see how much weight data a tiny model can lose before its understanding of classical Tamil grammar breaks.
Key highlights of the study:
Target Data: Fine-tuned on the Thirukkural (1,330 couplets + modern explanations).
The Chaos Step: Applied 20% random weight pruning but implemented "Layer Protection" for the Token Embeddings and LM Head to keep the characters readable.
Compression: 4-bit (Q4_K_M) quantization for extreme efficiency.
Result: A surrealist classical Tamil model that is ultra-light (~300MB) and ultra-fast!
Check out the model and the experiment logic here: Sri-Vigneshwar-DJ/qwen-tamil-chaos-v1
Title: 🧬 Experimenting with "Dynamic Chaos" in Tamil SLMs
Hi everyone! I just published a new experimental study on Small Language Model (SLM) resilience.
I took the Qwen2.5-0.5B model and put it through a "Chaos Phase" to see how much weight data a tiny model can lose before its understanding of classical Tamil grammar breaks.
Key highlights of the study:
Target Data: Fine-tuned on the Thirukkural (1,330 couplets + modern explanations).
The Chaos Step: Applied 20% random weight pruning but implemented "Layer Protection" for the Token Embeddings and LM Head to keep the characters readable.
Compression: 4-bit (Q4_K_M) quantization for extreme efficiency.
Result: A surrealist classical Tamil model that is ultra-light (~300MB) and ultra-fast!
Check out the model and the experiment logic here: Sri-Vigneshwar-DJ/qwen-tamil-chaos-v1
akhaliq
submitted a
paper to Daily Papers 8 months ago
Sri-Vigneshwar-DJ
posted an update 8 months ago
Post
337
Performance Marketing meets "Thinking Mode" 🧠
I’m excited to release hawky-ai-Qwen3-0.6B-Marketing-MoT, a specialized SLM designed for deep strategic reasoning in performance marketing.
While small at 0.6B parameters, this model punches way above its weight class by utilizing a Mixture of Thoughts (MoT) framework. It doesn't just give you an answer; it thinks through the logic of Meta Ads scaling, GA4 attribution, and unit economics before providing a strategic recommendation.
Key Features:
Thinking-First: Trained on 1,500+ critical thinking scenarios.
MoT Framework: 5 distinct reasoning styles (Linear, Exploratory, Critical, Deconstructive, Analogical).
SLM Speed: Perfect for low-latency, high-precision marketing audits.
Check it out on Hugging Face: 🔗 Sri-Vigneshwar-DJ/hawky-ai-Qwen3-0.6B-Marketing-MoT
I’m excited to release hawky-ai-Qwen3-0.6B-Marketing-MoT, a specialized SLM designed for deep strategic reasoning in performance marketing.
While small at 0.6B parameters, this model punches way above its weight class by utilizing a Mixture of Thoughts (MoT) framework. It doesn't just give you an answer; it thinks through the logic of Meta Ads scaling, GA4 attribution, and unit economics before providing a strategic recommendation.
Key Features:
Thinking-First: Trained on 1,500+ critical thinking scenarios.
MoT Framework: 5 distinct reasoning styles (Linear, Exploratory, Critical, Deconstructive, Analogical).
SLM Speed: Perfect for low-latency, high-precision marketing audits.
Check it out on Hugging Face: 🔗 Sri-Vigneshwar-DJ/hawky-ai-Qwen3-0.6B-Marketing-MoT
akhaliq
submitted a
paper to Daily Papers 8 months ago