He went there to register with Mary, who was pledged to him in marriage and was expecting a child.
To be taxed with Mary his espoused wife, being great with child.