My suggestion is going to the Knysna Yacht club on Tuesdays around 17h10. (for a 17h30 start) That's when the Knysna Canoe club has their time trial. You can just arrive, and park inside on time trial days.
They are welcoming to visitors, and you can then get the info from them regarding swartvlei over a beer after the time trial.