SparseDiTAttention / SparseProjectAttention / ModulatedSparseTransformerCrossBlock - the sparse counterparts of the dense DiT pieces, attending within each batch item. The modulation needs care: it is per batch item ([B, 6C]) while features are a flat [N, C] stack, so each row must pick up its own item's shift/scale/gate. Broadcasting would silently apply item 0's modulation to everything when B == 1. Verified end to end: slat_flow matches upstream at correlation 1.00000000. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| conv.py | ||
| convert.py | ||
| dit.py | ||
| ops.py | ||
| tensor.py | ||