We can say probability is a tool used to measure randomness.
Randomness is the phenomenon (the "what"), and probability is the mathematical measurement of the randomness (the "how much").
So if you are measuring the results of LLM which are unpredictable you’re supposed to use probability measurement not just three case average and standard deviation.