How to remove shifter handle?

[Nomake Wan]

Okay, I had the car apart the other day and had to give up and put it back together again because one tiny detail prevented me from replacing my parts.

When you remove the center console and shifter surround, there's a wire coming from the shift handle for the Manual switch. This wire splits into two terminals which lead into the bottom two positions of a four-pin wiring harness. Unfortunately, without pulling this wire, replacing the shifter components is pretty much impossible.

How does one go about removing these two terminals from the wiring harness? I unlocked the back of the harness but the wires refused to come out... is there a trick to it or do you really have to yank on it?

Tom probably knows, he's the one who gave me a replacement shifter and it has the terminals on it...