little button that makes center console open

Howdy again,
The little button that you press to open the center console (behind the gearshift) has come off. I put it back in but it seems like it's missing something to hold it down (it pops out after you close it). Appears to be part number 3 in the diagram at http://www.subaruparts.com/diag/?mod...category=930-A
Is there a way to fix it myself? I don't even see a way to get the rest of it out...

Garrett