If you change the reward function to satisfying people's relational preferences, then you stop paying so much attention to revealed preferences, like someone being addicted to smoking, and pay more attention to stated preferences, like "I want to quit smoking," and relational meta-preferences, like "I want to do what she does, which is quit smoking."