Jimmy Fallon Duets With Billy Joel at Madison Square Garden

Getty Images

See how the late night host shows off his New York pride!

Billy Joel made Jimmy Fallon an offer he couldn’t refuse -- to perform with him onstage at his Madison Square Garden residency.

The “New York State of Mind” singer sat down with the host on The Tonight Show Wednesday and proposed that Fallon join him on stage at his performance on Thursday night in New York.

WATCH: Jimmy Fallon, J.K. Simmons and Billy Joel Pull Off an Epic Impromptu Performance

"You coming? So we'll do something on stage," Joel asked.

Fallon, obviously, said yes.

Come Thursday, Fallon, 44, made his way onstage mid-show to duet alongside Joel, 66, singing “Sherry,” “The Lion Sleeps Tonight,” and “Unchained Melody.”

The Saturday Night Live alum showed his true New York spirit during “Start Me Up,” when he donned a New York Rangers hockey jersey. Check out the clips from the performance in the videos below.

WATCH: Jimmy Fallon Completely Loses It When Tina Fey Attempts to Impersonate Sofia Vergara

The pair also had an impromptu jam session and Fallon returned to the stage for the encore.

Fallon has been able to perform alongside an impressive list of celebrities. To see him play the wooden block while Adele performs “Hello,” watch the video below.