The advance reflects IBM’s continued progress toward machines powerful enough to challenge today's cryptography.