Though it can be tedious in some situations, other times it can also be pretty painless to remove caulk. Success depends on having the right materials, know-how, and, yes, luck.