@Snmundelly,
As far as theology and God go, you're both married already. Scripturally, there's no ceremonial requirement and marriage is solemnized in one or all of three ways: sex, giving of a low value coin (has come to be a ring, but Scripturally it's a token value coin,) and writing of a marriage contract.
"Mishnah Kiddushin 1:1 specifies that a woman is acquired (i.e., to be a wife) in three ways: through money, a contract, and sexual intercourse. Ordinarily, all three of these conditions are satisfied, although only one is necessary to effect a binding marriage."
http://www.jewfaq.org/marriage.htm
Though you may not be Jewish, if your concern is what God thinks, might wanna go with God's rules.
The rub is that when things are solemnized with sex, if you 'break up' and have sex with others, it's then adultery. The Scriptural process of divorce isn't as easy to do as getting married in the eyes of God.