Youga spent six months at Glanford Park and scored his first professional goal on Tuesday against Barnsley in a 2-2 draw.
Addicks boss Alan Pardew has struggled with left backs this season and 38 year old Chris Powell is the only fit player in that position.
He has now recalled Youga and he may make his debut at The Valley on Saturday.