For as much as the Downton Abbey alum has capitalized on his leading-man presentability—how suited he is to wearing suits—his best performances play deviously on that quality.