Born in Jersey City, Murphy attended Newark Academy but left in 1862 to be a Civil War soldier with Union forces and had become a first lieutenant. When he returned, his business and political life flourished. After his tenure as governor, he was a delegate at five national GOP conventions.
In Newark, though, he was just as active. Murphy served on the Newark Common Council from 1883 to 1886 and was its president for his last year. In that time, he led programs to light the streets, pave roadways and sidewalks. Even his house was on Broad Street, near Lincoln Park, so he could see his business, which grew to a six-building complex at its peak.