@SomeCTO,
First off, please don't assume the only people who would read and answer your question would be male. Seriously. It's 2017.
Now for your issues. You're right; that paper is crap. Don't sign it without your lawyer looking over it closely, but he or she will likely tell you the same thing. And don't be so sure that you don't have the IP anymore. Again, talk to your lawyer about that. A work for hire in the United States means the worker does not hold the IP (usually; copyright law in the US is kind of a mess lately), but you were not in a work for hire situation because you own 1/3 of the company.
His nonsense about you being away is also that - nonsense. You are allowed to take time off just like everyone else.
Lastly, I would have him and the other two buy you out if I were you. Unless you can get your other partners to side with you and not him, then he will continue to hold all the cards. This will not get any better.
Get an independent entity to value your business and your share of it and sell your piece. If you need to sell it to get the IP, then do so, but the IP is probably not worth the same as the business.
Of course listen to your lawyer over me if they disagree with me in any manner.
But go to your lawyer first.