A builder has been left severely injured after a building site and scaffolding partially collapsed.