Precision on Demand: Escalating Weight Bits at Uncertain Decoding Steps in a Small Local Model
Paper • 2611.14418 • Published • 4
Nayeem
mnknayeem
·
AI & ML interests
Al
Recent Activity
submitted a paper 2 days ago
Precision on Demand: Escalating Weight Bits at Uncertain Decoding Steps in a Small Local Model submitted a paper 2 days ago
PolyRoute: A Twelve-Language and Code-Mixed Benchmark for Typed-Decision Routing, with Baselines and a LeaderboardOrganizations
None yet
submitted 3
papers to Daily Papers 2 days ago
Bits or permutations? Spending a fixed inference budget on weight precision or on option-order averaging in small local language models
Paper • 2611.14413 • Published • 2
PolyRoute: A Twelve-Language and Code-Mixed Benchmark for Typed-Decision Routing, with Baselines and a Leaderboard
Paper • 2611.13843 • Published • 2
authored 3
papers 4 days ago
Soei: Structured Observability of Evidence and Intent for Multi-Agent AI Software Engineering
Paper • 2610.39468 • Published • 1
Enmo Safety: External, Non-invasive, Model-agnostic Oversight for Off-the-Shelf Language Models
Paper • 2611.10099 • Published
Maya a1: Do the Options Read the Model, or Does Their Position? Order Sensitivity in a Non-Autoregressive Decision Model
Paper • 2611.09803 • Published
upvoted a paper 8 days ago
How do i run this?
#1 opened 9 months ago
by mnknayeem
Can you fix the Runtime Error?
1
#1 opened 9 months ago
by mnknayeem
upvoted an article 9 months ago
Article
GGML and llama.cpp join HF to ensure the long-term progress of Local AI
- +4
ggerganov, ngxson, allozaur, lysandre, victor, julien-c
• • 510