I'm glad you got into the fray here, Red Cocoa. Thanks! :-)
Yes, I agree that one of the reasons so many people absolutely hate labels is because of the way they are often used in negative ways. The examples you mentioned are clearly intended for use as pejoratives, which basically serves to completely besmirch the very concept of labels in the eyes of many. But labels with a non-pejorative context that are scientific rather than judgmental, and based upon Greek lexicon that was not intentionally judgmental, may help to provide a sense of identity and unification that the pejorative labels do not. Then again, some scientific labels like "pedophile" have since become pejoratives, but past pejoratives, such as referring to gay people as "queers," have since been embraced by gays and used in non-pejorative but prideful ways. So it may all be a matter of context and intention when it comes to the use of labels.
"Meizon" may indeed remind some of other words from non-Greek languages that have nothing to do with it (and I commend you for knowing a French word that I didn't), but that can be one of many purely aesthetic or semantic reasons for disliking a term. I agree that a non-pejorative term like "meizonphile" that is not related to a term with a pejorative context that essentially judges someone in a negative way for having a certain type of preference is indeed quite useful, including one that can be used for both boys and girls with a preference for significantly older people who are not necessarily elderly (yes, I also find "grave-robber" funny--another one you introduced me to--though "gold digger" is mostly reserved for girls who intentionally use men, older or otherwise, for money and other materialistic gifts).