Flash_attn

[aokirii]

Is this version suitable for Nvidia RTX PRO 6000 usage? Is there any possibility to change flash_attn library to flash_attn4?

[czpcf]

I do not have RTX PRO 6000 to check the usability. Also TokenRig uses Qwen3, which seems that flash_attn4 is not supported yet.

[aokirii]

Also is there any code about training phase?

[czpcf]

Not scheduled, it takes time to be open source, like UniRig.