Minister needs to have told me about alleged rape: PM