He said he wants to "bring relief, share the gospel, and plant churches among" the "ultra poor".
He revealed his plans to move to Hong Kong next year with this family during his final chapel service at Azusa Pacific University in California on Wednesday.
Chan said the idea to make the big move came during a visit to Myanmar with his family a few months ago.
"We were just with a translator going from hut to hut in these slums, trying to explain to people who Jesus is," he said.
"These people had never even heard of Him and the eagerness, the way they listened, seeing people get baptised — it was just like, wow, what do we do on a normal day that even compares to this?
"As we got on the plane home, I was like, 'Honey, I think it's time to move'."
Chan said during his sermon that he had some frustrations about Christian leadership in the US.
"I describe it like this: I feel like I've been fishing in the same pond my whole life and now there's like thousands of other fishermen at the same pond, and our lines are getting tangled and everyone's fighting over stupid things, and one guy tries some new lure and we go, 'Oh, he caught a fish, let's all try his method!' And it just feels like, what are we all doing here?"
"What if I heard of a lake that's like a five-mile hike away, and no one's fishing it. And they're saying, 'Man, the fish are biting — just throw a hook in there and they'll go for it!' Man, I'll make that five-mile hike if I love fishing.
"What would keep me at that same pond? I'll tell you what would keep me at the pond is: I built a house on the pond, and all my friends have houses on the pond. And we don't even fish that much, we just go out, and we hang out, and we talk, and we play, and I don't want to leave my friends.
"But if my calling is to go fish, and there's no one fishing over there, why wouldn't I go?"
Chan, who stepped down as leader of a megachurch in 2010 to start a house church network called We Are Church, said he has a different vision for life as a Christian than most American Christians have.
"In my study of scripture, I saw a goal for Church and family that was radically different from what most American Christians envisioned and enjoyed," he wrote.
"It has taken longer than I expected, but I believe I have completed the work I was supposed to do. Over the past seven years, I have written two books—one about marriage and one about Church. More importantly, I have tried to live those messages out, giving those around me an example of what I wrote about."
He added: "I also have an opportunity there [in Asia] to work with the ultra poor (living off less than 50 cents a day)—to bring relief, share the gospel, and plant churches among them. When I compare that opportunity to things I currently do in the States, the Kingdom profit seems much greater overseas at this point of my life. While I think I will occasionally minister in the US, I plan on being based in Asia for this next season of life."
Chan said he thinks he will occasionally minister in the US.
Stay up to date with the latest news stories from a Christian perspective. Sign up to our daily newsletter and receive more stories like this straight to your inbox every morning.