What Is ChatGPT Doing … and Why Does It Work?(opens in a new tab)
A long explanation, for readers without a machine learning background, of how ChatGPT produces text: it repeatedly picks a next token from probabilities computed by a trained neural network, and Wolfram builds up to that through embeddings, training and the Transformer with small examples.