If your SVX is more than just a car to you, then I say, by all means, go for it!
I started my restoration last September (at 219,000 miles) and put the finishing touches on the first weekend of January.
Many parts I found through my local Subaru dealer or online Subaru parts sites.
Others I found on Ebay, and other online sites. Some parts came from the US and other parts came from Japan.
I do what I can, with the tools I have, to maintain it. When it needs more than I can handle, I take it to my trusted mechanic.
My SVX brings me more joy than I have ever experienced with any other car. I'm sure she can do the same for you.