I think your non-reaction and polite refusal to take the bait was spot-on. Showed the guy he didn’t get to you. I’d have done the same.