The fourth is responsiveness: the system must incorporate community evaluations. Models are often trained on short-term signals—likes and dislikes. GPT-4o was famously trained on such signals, which contributed to its sycophantic and intimate behavior. But when people say that behavior is harming them, there is no channel beyond a downvote to explain what is happening.