The news comes just one day after Jimmy donned a prosthetic chin and grey wig and imitated Jay's patterns of speech on Tuesday night's "Jimmy Kimmel Live" on ABC.
Jimmy will appear in the "Ten @ Ten" segment on Jay's show – a question and answer spot that has seen guests including Cameron Diaz, Mel Gibson and Tom Cruise.
Jimmy, Jay, Conan O'Brien, David Letterman and Jimmy Fallon have all used their shows to poke fun at NBC's current late night situation.
The network announced over the weekend that they planned to move "The Jay Leno" show to 11:35 PM and that they've asked Conan to accept "The Tonight Show" being pushed to 12:05 AM, with "Late Night with Jimmy Fallon" bumped to 1:05 AM.
Conan has since announced that he would not accept this move.
Related Content from AccessHollywood.com:
VIEW THE PHOTOS: Photo Fun With Hollywood's Hottest Comedians!
PLAY IT NOW: Dish Of Salt: The Fate Of NBC's Late Night Lineup
PLAY IT NOW: On The Set: 'The Jay Leno Show'