Tony Capaldi and Marino Keith gave Plymouth there first win at Colchester in 45 years and kept themselves on course for promotion.
Capaldi will probably never score a softer goal after U's keeper Simon Brown allowed his free-kick to slip between his hands and his legs and trickle agonisingly into his own net.
Five minutes later the Colchester keeper moved again when he failed to clear an effort on goal and the ball was eventually driven in by Keith to give the Pilgrims a wonderful double boost.
Colchester's day went from bad to worse as they failed to take their unbeaten home record to ten games.
Plymouth keeper Luke McCormick was fortunate only to be yellow carded after a foul on Wayne Andrews three yards outside of his area. It was even luckier for Plymouth as they did not have another recognised keeper on the bench.
Argyle skipper Paul Wotton hit a thunderous wind assisted 30-yard free-kick against a post but, apart from that, chances were sparse for Plymouth as Colchester tried to get themselves back in the game.
Karl Duguid curled in a wonderful free-kick from 25 yards which McCormick fumbled but went for a corner off one of his posts.
The U's dominated for much of the rest of the game but, due to the blustery conditions, they could not break down a well organised Plymouth side.
Andrews was restricted in his attacks while Vine and Fagan pushed and probed without success.
Pinault had volleyed into a cluster of players, while Sam Stockley also had a half volley deflected for a corner, but all in all Plymouth were worthy winners.