Sparse Text Diffusion Balances Attention and Expert Compute
A research framework treats long-context text diffusion as two simultaneous budgeting problems: maintaining attention connections and limiting expert computation. It provides analytical bounds while cautioning that sparsity alone may lose document-level information.