hmmm- never tried that, but when I got my L, I noticed that the cost of the new sunroof fabric alone versus the fabric with a new frame was not that significant, so I just ordered the whole contraption. (I see now that prices for the full roof with frame for certain models (N & D) seem higher than they were.)
My sense of it is you need a way of compressing the rivet, not banging it with a hammer. With a hammer, you're likely to damage the rivet surface (which is exposed) or missing and beating up the fabric. Good luck!