"My sisters and my brother were both like, 'Just take some drugs,'" Handler says of her reluctance to visit the Bush compound ...