Cluster, Route, Escalate: Cascaded Framework for Cost-Aware LLM Serving
Paper • 2606.27457 • Published • 3
Joseph McInerney
jmcinern
·
AI & ML interests
NLP, Financial Markets
Recent Activity
upvoted a paper 2 days ago
Cluster, Route, Escalate: Cascaded Framework for Cost-Aware LLM Serving updated a model 5 months ago
jmcinern/Qomhra updated a dataset 5 months ago
jmcinern/Dolly-V2-gleOrganizations
upvoted a paper 2 days ago
upvoted an article 7 months ago
Article
EuroLLM-22B
eurollm-team
• • 53 upvoted an article 9 months ago
Article
Rank-Stabilized LoRA: Unlocking the Potential of LoRA Fine-Tuning
damjan-k
• • 33