The actor, 39 — who was rumored to be romancing everyone from Bounty costar Jennifer Aniston to Cameron Diaz — was spotted with the 29-year-old singer — and hairstylist Ken Paves — Tuesday night at NYC’s SoHo House.

They “seemed to only be interested in each other and chatted for hours,” a spy told the New York Post’s Page Six. Simpson or Butler have yet to comment, but a source close to the singer tells Usmagazine.com, “There is nothing romantic there at all.”