I, too, babied a tempermental soul. He's never fully reared, I think his self-preservation instinct is too high - thank god, but I feel he would quickly begin rearing if someone insisted at the wrong time.
Trainer insisted he move laterally off her leg one night (turn on the forehand or haunches...can't remember which one). Argument ensued and an hour later, horse won.
As I said before...I do think a crop would've helped in the OP's situation...just a waggle by his eye to break his concentration. Because while he looked painfully slow...when he was focusing, he did go somewhere...just slowly.