Kristie,
Believe it or not the worse thing you can do if you think you might have an infection starting, is to remove the ring. If you do that the hole will close up and the infection will be trapped inside. At least now it has a drainage outlet.
Unlike ear piercings......naval piercings do close up rather quickly on some people.
I have my belly button pierced also. I have always only used rings or bars that are made of titanium. For cleaing I use saline.
I was playing tennis a couple years ago and a piece of thread on my outfit got wrapped around the ring. When I jumped up to wack the tennis ball it jerked on the ring and OMG
These things can get out of hand quickly. If it doesn't get better soon I would go to the doctor before an infection starts. Always better safe then sorry.
~Brooke