In consensus usage, "pedophile" means someone who molests or wants to molest (ie, has sexual activity, which is the consensus usage of "molesting)" children.

Even not believing in the Ticking Time Bomb Theory, it retains some accuracy to consider ideological pro-contacters as "pedophiles." We are pedophiles in moratorium, until the laws change.

But if you think contact is wrong and thus decide on celibacy even if the laws changed, you excluded yourself from the population who molests or wants to molest. Therefore you are not pedophiles.

You can call yourself something else, of course.