Open Question: How do you control/get rid of oily skin?

I have really oily skin and it's embarrassing. I hate the feeling of it too. Its just gross and I want it to go away. I put on acne medicine the dermatologist gave me to put on in the mornings and lotion with spf 15 in it and then makeup. Within a few hours or less, my skin is extremely oily. I don't want to touch my face to get germs or anything on it so I'll go to the bathroom and dab it off. But then an hour later it's come back :( Is there something wrong with me? Is there anything I can do to get rid of it or at least help??? Thanks so much (: