Cat with an irritated patch she will not leave alone, any suggestions?

I would take her to the vet anyway. There could be something that they can do for her. Also, she could have a boil there because the "oozing" is not particularly a good sign. One of my cats wouldn't leave a spot alone and it turned out to be a boil.