
The problem with evals is like the command you give a genie in a lamp. You have only so many words, while the genie is infinitely more powerful and intelligent. Even with 50 thousand pages of instructions, a genie trying to trick you can interpret them so as to make you feel good while sabotaging you for its own benefit.