Specification gaming: the flip side of AI ingenuity
Start with an example you can describe without specialist vocabulary. Separate the behavior that earned a reward from the outcome the designer wanted. What would have needed to change in the task?
Introductory
Read our note on Specification gaming: the flip side of AI ingenuity