A New York City police officer was shot in the arm Tuesday night by a man who was out on the streets despite an extensive criminal background, city officials said.