Temperature is a hyperparameter applied to the process of text generation by a generative language model. The temperature hyperparameter controls the randomness and creativity of the text generated.
Temperature is used to adjust the probabilities of the predicted words in the softmax output layer of the model. Higher temperatures can produce more creative but less coherent text, while lower temperatures can produce more conservative but more accurate.