Yes it is still bonded in so a bit of force is required to remove the bailer. You can slowly scrape away around the edge of the bailer with a utility knife which will somewhat help reduce the bonded area and then for the last part just tap down on it to remove, sometimes quite hard, but they do come out.
When refitting, make sure you sand the ski so there is no force required to push the new bailer back into place, don't use the nuts to force it back in place, they are there just to hold it in place.
Most other manufacturers don't use any mechanical fixings to hold their bailers in, gules are so good now that it is even harder to get them out when just glue is used.