If you thought the fun was over when the show ended at Sunday night’s “Saturday Night Live” 40th anniversary special, it looks like you were wrong.

Taylor Swift, Paul McCartney, Prince, Jimmy Fallon, Bill Murray, Haim and more all jammed at the after-party at the Plaza Hotel. Swift was joined by McCartney while performing “Shake It Off,” and the two played the Beatles’ “I Saw Her Standing There” as well. Fallon was also happy to take the chance to sing with Swift.

McCartney and Swift both had featured roles in the four-hour televised “SNL” celebration.

Prince performed also, on stage with Chris Rock, Haim’s Este, Martin Short and Fallon. And Bill Murray looked happy enough casually playing the tambourine in the corner.

See the video clips, as originally curated by Entertainment Weekly, below.