While “broom the floor” isn’t common, “sweep the floor” is. Of course, why we use the tool name as a verb in the case of “mop” or “vacuum”, but not in the case of “broom”, is another case of English being English. But, you shouldn’t expect consistency out of English. It’s not really a language, it’s several languages dressed up in a trench-coat pretending to be one.