I think you nailed it on the head with the fuel filter. About 4 years ago I had a 85 Honda Accord and it had similar problems. After several things that didn't help I replaced the fuel filters because they were on clearance at Walmart (?) for 25 cents. This got rid of it right away.