There are positives and negatives to every technology. I'm sure even fire when figured out how to be started on demand had those people "you bring this into our cave? We'll be burned alive because of your stupidity."
I do think it won't be too long before they create things indistinguishable from human hands.
As for what we do then? Whatever we want. Freed from the bondage of having to toil away in soil it will just be us an our creativity, having fun, getting new experiences.
There's a whole universe out there to explore.