Jason Sudeikis has been looking like a real single fella lately -- and during a night out in Hollywood this week ... he looked to be getting cozy with a potential new flame.