Christopher Morgan, 40, was arraigned in Orange County Court.
Prosecutors say he punched his psychiatrist and stole her badge to flee the facility.
He was captured the next day in Port Jervis.
Court records reveal Morgan previously threatened to bomb police stations. He remains in jail and is scheduled to return to court in May.