My Outback is doing the same thing. I haven't had it looked at yet (working at a dealership you'd think I would have fixed it by now
).
Anyway, two common causes of this:
1) bad ignition switch
2) worn starter contacts (you should hear at least a small "click" if it is this)
Mine acts up about once a week, but it always starts after a few tries. I get the same symptoms as you: no sound, no nothing. And then, 5 or 6 tries later....starts right up like nothing is wrong. One of these days I'll look into it and find out exactly what it is.
Dave