Since your rudder is at the stern, when on a wave it is likely sticking out of the water much of the time rendering it ineffective (especially on a steep wave), giving the boat the feeling of being pushed around. Which is why surfskis have the rudder mounted forward of the stern, but it sounds like you already know that.
Come over to the dark side - get a surfski.
Bill L