Doesn't "would" work in the blank?
No, "would be" definitely doesn't work. "Would have been" would work, but "be" prevents it. If the answer has to be a modal, then the answer has to be "had to." Alternatively, the test makers could revise the question.