Issues

• [Idea] Why can pruning or quantization improve domain-specific performance over the base model?

  exploration
  HectorHHZ/Less-is-MoE#31 · Filter by author jayzou3773 opened on Sep 16, 2026

• [Feature] Compact IntDim-L/G experts and add a ragged Qwen vLLM GPU backend

  HectorHHZ/Less-is-MoE#29 · Filter by author jayzou3773 opened on Sep 16, 2026

• [Experiment] Table 6 (optional): footprint and deployment cost

  HectorHHZ/Less-is-MoE#20 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Experiment] Table 5 (optional): iso-active-parameter comparison

  HectorHHZ/Less-is-MoE#19 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Task] GPQA contamination checks and the format-effect contrast

  HectorHHZ/Less-is-MoE#18 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Experiment] Compression ratio sweep on GPT-OSS-120B and Gemma-4-26B-A4B (optional)

  HectorHHZ/Less-is-MoE#17 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Experiment] Knowledge track: two calibration formats and their out-of-domain cost

  HectorHHZ/Less-is-MoE#15 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Model] Support gemma-4-26B-A4B

  enhancement
  HectorHHZ/Less-is-MoE#13 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Experiment] Run the SlimQwen prune-only baseline

  HectorHHZ/Less-is-MoE#14 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Model] Support gpt-oss-120b

  enhancement
  HectorHHZ/Less-is-MoE#12 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Model] Support Qwen3.5-122B-A10B

  enhancement
  HectorHHZ/Less-is-MoE#11 · Filter by author HectorHHZ opened on Sep 14, 2026
  

• [Feature] Add footprint and throughput measurement

  enhancement
  HectorHHZ/Less-is-MoE#9 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Feature] Add GPQA and GPQA-Diamond evaluation with the s1K-1.1 and GPQA-64 calibration sets

  enhancement
  HectorHHZ/Less-is-MoE#7 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Feature] Add the general evaluation suite: IFEval, IFBench, MMLU-Pro, C-Eval

  enhancement
  HectorHHZ/Less-is-MoE#6 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Task] Define a unified evaluation config and results schema

  HectorHHZ/Less-is-MoE#5 · Filter by author HectorHHZ opened on Sep 14, 2026

• [Roadmap] Less is MoE at Scale — extension experiments

  HectorHHZ/Less-is-MoE#2 · Filter by author HectorHHZ opened on Sep 14, 2026