Popular repositories Loading

1. LLM-Drop LLM-Drop Public

   The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".

   Python 153 17

2. Unified-MoE-Compression Unified-MoE-Compression Public

   The official implementation of the paper "Demystifying the Compression of Mixture-of-Experts Through a Unified Framework".

   Python 49 5

3. Router-Tuning-Mixture-of-Depths Router-Tuning-Mixture-of-Depths Public

   The open-source Mixture of Depths code and the official implementation of the paper "Router-Tuning: A Simple and Effective Approach for Enabling Dynamic Depth in Transformers."

   Python 8 2

4. FLoRA FLoRA Public

   Python 5 1

5. SHED-Shapley-Based-Automated-Dataset-Refinement SHED-Shapley-Based-Automated-Dataset-Refinement Public

   Forked from Lucidreamer9/SHED-Shapley-Based-Automated-Dataset-Refinement

   Python