
Running locally has another benefit: you can set the random seed, so every time you put in the same input under the same model you get the same output. Then when you tune Responsiveness, you’re really tuning Responsiveness; otherwise you don’t know whether you were just unlucky or whether your adjustment worked.