Floating Point

Recursive summation in single precision loses four digits over ten million terms. Pairwise and compensated summation keep them for little extra work.

Subtracting the maximum turns an overflow into an exact identity. The same shift makes softmax safe.