Remote object fetch failures will prevent the object fetch job from retrying if the object has been deleted or the fetch was denied with a 403.
