Know Your Model, Work It Well