It most certainly does make a difference. I was getting bad gas mileage in my 94 Legacy Turbo wagon, and then put in a new subaru O2 sensor and my mileage shot up almost five miles a gallon.
Just make sure your car is properly tuned up to get the most benefit.