What's wrong with the idea of UFOs?

Nothing.  It could be a jumbo jet, a cricket ball or an alien space craft.  If it abducts you, cricks your neck or hits you in the face you might have some evidence, but otherwise it's just something in the sky that you CAN'T IDENTIFY.