Greedy Decoding
Last updated on November 12, 2024
A stategy utilized by a Large Language Model when generating sequences which selects the the token with the highest probability from the probability distribution without considering future tokens.
Announcing our new Course: AI Red-Teaming and AI Security Masterclass
Check it out →