Daniel Berger is scheduled to appear Tuesday afternoon before Magistrate Judge Lincoln Almond in U.S. District Court.
The girl was the subject of an Amber Alert after disappearing on July 24. She was found 16 hours later in Berger's apartment in Haskell, N.J.
Jeffrey Furtado, interim chief of police in Portsmouth, has said Berger and the girl probably met on the Internet, had previously communicated online and that it appeared that she went with him willingly.
Berger is charged with transporting a minor with intent to engage in criminal sexual activity.