Does a space ship leaving earth affect earth's orbit?

When a space ship leaves earth, earth's m is reduced. Therefore, is the gravitational pull between the earth and sun less? Is it possible that if we start to colonize other planets and send enough material off of the earth that the earth will go out of orbit?