That's interesting I've had putty in the past that dissolved, this isn't recently though, its probably 2-3 years ago so the exact compound I used is lost in time.The putty should be impervious to water.
When heated the putty should harden and completely seal the joint
I have just generic firegum putty, the stuff below, so I'll deffo put some of that on then.