It means you are no longer in contact with your family. Falling out with one's family most likely results from an argument or disagreement. It could also be the result of less communication over the years for reasons that are not necessarily negative.
