Temperature 0 does not mean reproducible or deterministic for an LLM. Even if setting fixed random seeds, you cannot guarantee parallel workers return in the same order every time. And floating point addition is not generally associative (order matters). https://docs.oracle.com/cd/E19957-01/806-3568/ncg_goldberg.html #ai