Name and Version
System:
- Repo pulled today
- Ubuntu 26.04 with ROCm 10.0 built with TheRock
Operating systems
Linux
GGML backends
HIP
Hardware
2x MI50 32GB + Epyc 7R13 + 256GB RAM
Models
Xiaomi MiMo v2.6 Flash MXFP4 (https://huggingface.co/AesSedai/MiMo-V2.6-Flash-GGUF)
Problem description & steps to reproduce
- When using this fork, I get gibberish output from the new MiMo v2.6 Flash MXFP4 (by AesSedai)
- Using "--no-repack" does not change the behaviour
- When using upstream llama.cpp, everything is back to normal, just much slower (160t/s pp vs. 210t/s pp, tg is about the same)
Output by this fork (using the llama.cpp WebUI):
"20 a-** the0 A, difficulty, The,1 A? for A B, I. the**. the4 the of is**, A1's** of0 difficulty0 the & A4**, " the "2,, you it1 it, to, and 2 for the , I it category, to, the,,6 to and) question, of I & to answer &.". hard a..1 ** of & but you the . and5 and: the and this. in you4. with difficulty and2 a. are to question,** to hard:20 options.8 question your,:, A Hard to you),-:.
., question**，4 you the's the,. the the category to's to in for &, answer::.,)6 " the?,: it question category &,1 in of A you , question answer difficulty** you you2) " to you0 it the of,1 it,0's0 of, question. Medium,. you A in for A** you A5 question options, you a5 it the is**, easy in question, the..."
Output by upstream is proper formatted and contextually right text output.
First Bad Commit
No response
Relevant log output
Logs
Name and Version
System:
Operating systems
Linux
GGML backends
HIP
Hardware
2x MI50 32GB + Epyc 7R13 + 256GB RAM
Models
Xiaomi MiMo v2.6 Flash MXFP4 (https://huggingface.co/AesSedai/MiMo-V2.6-Flash-GGUF)
Problem description & steps to reproduce
Output by this fork (using the llama.cpp WebUI):
"20 a-** the0 A, difficulty, The,1 A? for A B, I. the**. the4 the of is**, A1's** of0 difficulty0 the & A4**, " the "2,, you it1 it, to, and 2 for the , I it category, to, the,,6 to and) question, of I & to answer &.". hard a..1 ** of & but you the . and5 and: the and this. in you4. with difficulty and2 a. are to question,** to hard:20 options.8 question your,:, A Hard to you),-:.
., question**，4 you the's the,. the the category to's to in for &, answer::.,)6 " the?,: it question category &,1 in of A you , question answer difficulty** you you2) " to you0 it the of,1 it,0's0 of, question. Medium,. you A in for A** you A5 question options, you a5 it the is**, easy in question, the..."
Output by upstream is proper formatted and contextually right text output.
First Bad Commit
No response
Relevant log output
Logs