Well, I got pissed enough at my ashtray to try a knife on the "rubbed off" part, and the grey came off! I guess it was soapy deposits or something. It doesn't look 100%, there's still some discolouration and a few more scratches, but it's good enough for now!
This thread can go bye bye.