Paul Gallagher's brace ended Crystal Palace's unbeaten home record. Paddy McCarthy's 85th minute goal for the home side proved to be just a consolation.
The two wins have seen Plymouth jump to 18th in the table with 8 points from 7 games.
Next up it's Nottingham Forest at Home Park.