Very interesting---I have never come across that problem before. When you replace the pump be aware that the 500 and 126 pumps are slightly different in shape. If you have an alternator on your engine you will need to fit a later 126 pump---it has a sloping base which makes it a lot easier to remove/fit. You can fit a late 126 pump onto anything, but you will find it very difficult to fit a 500 fuel-pump onto an engine with an alternator.
When you do replace the pump, check that the operating pin, which comes across from the camshaft is protruding out the correct amount. Inclusive of gasket thickness (which you add or remove as required) the pin should protrude 1-1.5mm when fully out. Don't forget that you will have to turn the engine over TWICE to get the full range of the pin's movement (it is operatedby the camshaft which turns at 1/2 engine speed)