Isaiah 53:4 is actually translated: Surely [or certainly] He has borne our sicknesses and carried our pains.
To prove that our sicknesses were carried away by Jesus, just like our sins were carried away, the same Hebrew verb for borne and carried is used to describe both.