It's best to live them on. If you remove them, the water will splash all around the engine and can cause problems. Some engines (I think yours too) have the ECU in the area and it could easily get splash without duck bills. You don't want that!
Best is to clean them and the scuttle bay, too.
Best is to clean them and the scuttle bay, too.