Not quant Q layer?

[laomao0]

I see the code does not quant the Q layer activation.
Does it matter?

[ChenMnZ]

We follow existing work (such as QuaRot, SpinQuant, Qserve)to not quant Q for fair comparison. It is not matter.