The public seems to have the attitude that "pedophiles" (the media definition, of course) are prone to psychopathic proclivities in general. Their tendency to target kids for sexual assault is just the most non-PC of their many atrocious acts.

For example, Dr. Sarah Goode noted in her first book that many of her colleagues suggested she was putting herself in danger for meeting with MAPs in the course of acquiring research for her book. And this was during the time when she had misled most of her research participants into thinking she was neutral or at least open-minded on the contact issue, and wasn't writing another book connecting adult attraction to minors with adult sexual abuse of minors.

And let's not forget those funny and culturally revealing "I Love Lucy 2000" skits from Mad TV during the titular year. What hi-jinx we could expect if Lucy and Ethel had access to the Internet was the theme humorously portrayed in these skits. And who was the main nemesis of these two women approaching middle age in the realm of cyberspace? The "Internet Pedophile." Why was this stereotypical media "pedophile" harassing and later attempting to murder two women approaching middle age? Well, according to what the skit seemed to imply (however ironically), being a psychopathic menace in general is simply what "pedophiles" do, considering the narrative insists that MAPs have no conscience or ability to empathize with others. So the ironic nature of this portrayal of the narrative seemed to be that the Internet Pedophile casually menaces adults during the interim periods when he can't find children or teens online as his preferred targets.

So yes, I do think this is a legitimate concern.