Repository navigation

Gemma4 MTP - #17

Closed

am17an wants to merge 24 commits into

masterfrom

gemma4-mtp

Closed

Gemma4 MTP#17
am17an wants to merge 24 commits into
masterfrom
gemma4-mtp

Commits on Jun 4, 2026
- llama: Gemma 4 MTP
  am17an
  committed
  f268966
- fix multi-seq
  am17an
  committed
  9af0434
- add assert that draft + shared kv should be on same device
  am17an
  committed
  7b87cd3
- add Q rot when cache is quantized
  am17an
  committed
  27461cd
- add temp hack to not use fit with gemma4, rm later
  am17an
  committed
  777af6a
- add exception in test-llama-archs
  am17an
  committed
  c0da00a
- move assistant to separate file
  am17an
  committed
  dd97604
- ui: added single line reasoning preview (#23601)
  
  gugugiyu
  and
  allozaur
  authored
  5269770
- ui: Fixed packages (#24119)
  allozaur
  authored
  21444c8
- Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)
  bartowski1182
  authored
  e7bcf1c
- webui: [a11y] fix keyboard navigation issues in chat interface and sidebar (#23132)
  vignesh191
  authored
  42b2d60
- arg: fix double mtp downloads (#24128)
  ngxson
  authored
  260862b
- server : disable on-device spec checkpoints (#24108)
  ggerganov
  authored
  7c158fb
Commits on Jun 5, 2026
- sycl : port multi-column MMVQ from CUDA backend (#21845)
  masonmilby
  authored
  7fe2ae4
- ci : build-msys job slimming [no ci] (#24157)
  danbev
  authored
  46fa662
- CUDA: enroll mul_mat_vec_q_moe into pdl (#24087)
  ORippler
  authored
  2154a0f
- add unified assistant
  am17an
  committed
  4eaa3ce
- kleidiai : dynamic chunck-based scheduling for hybrid execution (#23819)
  chaxu01
  authored
  3ecfb15
- hparams : refactor `hparams.n_layer` (#24060)
  
  ggerganov
  and
  CISC
  authored
  7acb4e8
- minor : fix lint issues (#24165)
  ggerganov
  authored
  59917d3
- docs: Update quantization readme (#24133)
  
  pcuenca
  and
  CISC
  authored
  ad1b88c
- Merge branch 'master' into pr/23398
  ggerganov
  committed
  5954f19
- cont : adjust to hparams changes
  ggerganov
  committed
  d78a386
- cont : avoid computations on the CPU
  ggerganov
  committed
  f0438b1

Commits

Commits on Jun 4, 2026

Commits on Jun 5, 2026