It depends.

Generally it doesn't bother me. I love that I'm a pedophile. There are some character flaws that I'm aware of in me. I can get angry about some things too easily. I let work consume too much of my life to the cost of quality time with family and friends. There are other character flaws. But if I hear that I'm a pedophile it's one character trait that I think is a very positive part of who I am and so I don't take offence.

Of course, if it's being used purely to inflict pain then I can take offence as in get angry that someone is being ignorant in their use of the term.

Kind of like a person of colour being told they are a person of colour. Actually that's a good thing, be proud of your race whatever it may be but if someone is just using it to try to inflict pain then they're just being an idiot and it is offensive.