The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"
-
Updated
Mar 11, 2024 - Python
The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"
HydraNet is a state-of-the-art transformer architecture that combines Multi-Query Attention (MQA), Mixture of Experts (MoE), and continuous learning capabilities.
Run ComfyUI workflows, query models and nodes, manage queues, and get CLI access to ComfyUI tasks via HTTP/API
Add a description, image, and links to the attn topic page so that developers can more easily learn about it.
To associate your repository with the attn topic, visit your repo's landing page and select "manage topics."