I do not know about the N models but on most 500 & 126 there is a thin metal cover plate under the starter motor. If that was missing it would give the flywheel slightly less clearance on the bendix. I have also come across starter actuating/solenoid arm return springs not locating properly And not working. Sure fire way to pin it on the starter is to remove it and bump start the car.
Yup, I absolutely have that plate, and it was installed on the starter. I really think I had just a half of mm too much tension on the starter cable. It should probably just sag a little bit at the starter pull lever, which mine wasn't. It was taught. Lesson learned.... likely.