The incident happened near the entrance to Madison Square Garden of Penn Station around 1:20 pm
Police said Juvian Rodriguez, 35, approached an undercover officer and began making anti-Asian remarks. He was also alleged to have threatened to stab the police.
Rodriguez faced a number of charges, including harassment hate crime.
The NYPD said this was the second arrest due to covert operations that began when it started two weeks ago.