House Speaker Mike Johnson said he was "angry" when he learned of the provision in the bill to reopen the government and that he'll fast-track a bill to undo it next week.