I haven't removed the steering wheel from an SVX yet, but normally there is a spring-loaded pin pushing upward into a round plate with about 15-20 matching slots around its periphery. More than likely the spring has broken, the pin is stuck in old, cold grease or you're just unlucky.
Have you re-checked once the car is good and warm inside?