Hi there. I own a Spirit PRS (not sure what the elite refers to?). I got mine with the surf rudder and also added the cabling for the kick up river rudder which can be easily changed over. I have also owned the CTR and still have the Racing Spec ski version (for just in case).
I absolutely love the PRS! I have used it for the Avon 2010, and will also take that ski when going to surf the shore break in Perth. The ski is bullet proof! Mine is very scratched after a long two day slide down the driest Avon ever, but hasn't failed me. I also use it for fitness training in the river and for adventure races.
I do also own a V10 Club, so I will use the V10 in downwind paddles. For me, the weight of the PRS has not been a big issue in the water, but if you have a long walk- it can be heavy. I don't really use the PRS in big downwind as I find that I get "more than normal" water into the boat from the sides. That again may be because I am about 108kgs. I don't get this issue in the V10 as to me the bucket is deeper/ the sides higher?
Regards speed- I also don't think the PRS gives away alot of speed over the others for the average paddler, in Perth for instance with the top guys paddling in a PRS in races- they still come in up front.
As an all-round boat is is great- durable & fast. That said- if downwind ocean paddling is your thing, and you can't have both- I'd go glass.
Hope that helps.