Infected bellybutton piercing?

About a month and a half to two months ago, I got my belly button pierced by a friend who happens to be a professional piercer/tattoo artist. I have been cleaning it regularly with soap and noticed it was infected, since then I have been using hydrogen peroxide on the holes, and soaking the jewelry in it too. I have also been washing it in the shower and I do both of these things daily. Yet the holes are still red and do get crusty but comes off easily, however there is still a light yellowish puss coming out from the bottom. Sometimes it hurts to touch the piercing, other times it doesn't. I am tempted to take it out because it's becoming a hassle but I heard that you should not take out an infected piercing and let it close up or else the infection will be trapped inside. So if you guys could give me some tips on how to get rid of the infection...if not, would it be okay to let it close up?