Oct 9, 2024 · We propose, Global and Local Instruction Driven Expert Router (GLIDER) that integrates a multi-scale routing mechanism, encompassing a semantic global router ...
Oct 9, 2024 · This router, employing a shared vector across all queries and tokens, dynamically determines the utilization of the PEFT module based on the ...
Sep 23, 2024 · This paper presents GLIDER, a method that combines global semantic and local token-level routing for LLMs. The key innovation is using an LLM to ...
Oct 15, 2024 · Introducing GLIDER: Global and Local Instruction-Driven Expert Router! Our new approach combines LLM-generated semantic task instructions ...
Oct 13, 2024 · This global guidance is complemented by a local router that facilitates token-level routing decisions within each module, enabling finer control ...
Glider: Global and Local Instruction-Driven Expert Router
www.aimodels.fyi › papers › arxiv › glid...
Oct 9, 2024 · By leveraging both global and local instruction encoding, Glider can more accurately route inputs to the most appropriate expert sub-models, ...
Oct 10, 2024 · Our new approach combines LLM-generated semantic task instructions for global task-level routing with learned local token-level routing for improved ...
Introducing GLIDER: Global and Local Instruction-Driven Expert Router! Our new approach combines LLM-generated semantic task instructions for global task ...
Oct 11, 2024 · Introducing GLIDER: Global and Local Instruction-Driven Expert Router! Our new approach combines LLM-generated semantic task instructions ...
glider Public. Official code for the paper "Glider: Global and Local Instruction-Driven Expert Router". UNITES-Lab/glider's past year of commit activity.
People also search for