News Jimmy Fallon Duets With Billy Joel at Madison Square Garden By Elizabeth VanMetre 9:12 AM PST, January 9, 2016 Getty Images Billy Joel made Jimmy Fallon an offer he couldn’t refuse -- to perform with him onstage at his Madison Square Garden residency. The “New York State of Mind” singer sat down with the host on The Tonight Show Wednesday and proposed that Fallon join him on stage at his performance on Thursday night in New York. WATCH: Jimmy Fallon, J.K. Simmons and Billy Joel Pull Off an Epic Impromptu Performance"You coming? So we'll do something on stage," Joel asked. Fallon, obviously, said yes.Come Thursday, Fallon, 44, made his way onstage mid-show to duet alongside Joel, 66, singing “Sherry,” “The Lion Sleeps Tonight,” and “Unchained Melody.”The Saturday Night Live alum showed his true New York spirit during “Start Me Up,” when he donned a New York Rangers hockey jersey. Check out the clips from the performance in the videos below. WATCH: Jimmy Fallon Completely Loses It When Tina Fey Attempts to Impersonate Sofia VergaraThe pair also had an impromptu jam session and Fallon returned to the stage for the encore. Fallon has been able to perform alongside an impressive list of celebrities. To see him play the wooden block while Adele performs “Hello,” watch the video below.Adele Performs Perfect Rendition of 'Hello' Using Classroom Instruments With Jimmy Fallon This video is unavailable because we were unable to load a message from our sponsors. If you are using ad-blocking software, please disable it and reload the page.