ss_flow ships rope_phases precomputed; the SLAT flows do not, because their positions are the input SparseTensor's own coordinates and vary per input. rope_phases_from_coords reproduces RotaryPositionEmbedder, including the pad detail: 3*21=63 frequencies fall one short of head_dim//2=64 and upstream right-pads with 1+0j, so dropping it would shift every later pair by a slot. Verified against ss_flow's own shipped tensor to 9.6e-7 - a real ground truth, since the same embedder produced it. |
||
|---|---|---|
| .. | ||
| test_dit.py | ||
| test_ops.py | ||
| test_sparse.py | ||