Sounds like the brake system is actually saying there's something wrong... though I'm not sure what. Have you had any strangeness while coming to a stop since the problem has been happening?
EDIT: Maybe this is your problem... found it while searching for relevant threads on the brake light being on randomly.
http://www.subaru-svx.net/forum/show...00&postcount=6