Are you thinking of the internal panel? Which is almost certainly a case of ripping the plastic pins out. It's worth getting a bag of replacement ones off of Ebay (other respectable sources are available)
Now the big section on the external, lower part of the door, which houses the handle and number plate, that is a bit trickier. I would also appreciate info on that.