It may help you to look at the verb using a pattern that shows how it's used, like this:
permitirle algo a alguien
The verb takes an indirect object, represented by the indirect object pronoun
le. What is permitted is represented by the direct object
algo. The indirect object '
a alguien' reminds us that the indirect object needs to be clarified when the indirect object pronoun is in the third person. Look carefully at the model and you'll discover what you've missed.