A Territory construction giant will challenge a $620,000 fine over the death of a father-of-five at a remote worksite.