It's testable, though I think that you're slightly off. It would be interesting to find out the result of such tests.

Could it be an environmental issue of "adults should never touch you there" and it only being acceptable to be in relationships with other children that often result in a life-long conditioning that dictates that children and a child's view of sexuality are right and adults and an adult's view of sexuality are wrong? It could be, though I think that this only adds to the situation rather than creating it. Long before the whole "adult-child is bad" idea came about, adults and children were routinely together.. so that suggests that it's not a conditioning.

On the issue of attraction to personalities... take a look around you. Everyone around here has different flavours of preference in physical attraction, ranging from toddlers to adolescents. There are many here who are even attracted to some adults. In the end, we are ultimately attracted to personality, but physical attraction also plays a role.