a44a0d7360
ss_flow ships rope_phases precomputed; the SLAT flows do not, because their positions are the input SparseTensor's own coordinates and vary per input. rope_phases_from_coords reproduces RotaryPositionEmbedder, including the pad detail: 3*21=63 frequencies fall one short of head_dim//2=64 and upstream right-pads with 1+0j, so dropping it would shift every later pair by a slot. Verified against ss_flow's own shipped tensor to 9.6e-7 - a real ground truth, since the same embedder produced it. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| conv.py | ||
| convert.py | ||
| dit.py | ||
| ops.py | ||
| tensor.py | ||