You can try tecnu. It will strip the area of oil. Might not give relief right away but it should cut down your healing time.