Not the felt you need to worry about its the tiles above. Roofing felt, despite peoples (and some builders!) ideas, is not for waterproofing, its a vapour barrier which stops warm air from the loft hitting the cold tile surface and condensing. It also acts as a dust barrier stopping the dust from outside getting into your roof space. Get the leak fixed in the roof first.