"True, I suppose not," Tony won't argue the point, but L's self-disparaging comments weren't going to make him change his mind, either. He may seem a little strange and pushy but that didn't necessarily mean he was a bad guy. Far less threatening than the guy who will later run Tony over with his car, anyway.
[Action!]
"With the coffee shop, right?"