A Millville man was arrested Friday night after he allegedly stole a bicycle at knifepoint, Bridgeton police said.