So is the screw coming out after you tighten it up? On mine the screw had torn thru the slide seal and ripped out, allowing the seal to slide off its rail and fall off. So i had to put an new hole in the D seal backer to hold it solid. Caulking the screw, it would help to stop moisture from wicking into the hole, depending on where the seal is.