For instance what if how I saw blue is how you see green? You would never be able to tell unless we switched eyes. And if you remember that all color is the reflection of light, wouldn't people with different eye colors reflect away different shades of light, almost how chlorophyll reflects green light away from plants so they never absorb it???
Nope it doesn't work that way. Only the light entering through the pupil get's collected and transformed into data. The iris is on the outside, it doesn't have any impact on actual vision other than to open and close the pupil. So the fact that it reflects a certain light to give the iris color in no way effects the person's vision or color perception.
Here is the thing about color and why what you suggest is not the case.
Every color has a wavelength and it can be monitored. For example the color blue doesn't give off the same frequency that red does. They each have their own distinct frequency and wavelength.
Now with being color blind the problem has to do with the light sensitive cones in the retina. There are millions of these light sensitive cones and each one has a color specific purpose. Which are either green, blue, or red. This means that if a person lacks a certain number of cones of a particular color the data for that color will be limited. This causes either partial color blindness for that color or complete color blindness for that color. This is why green and red are the most common forms of color blindness. Followed by blue.
This is how we know that everyone sees the exact same color. So when you see red, it is the same color that I see. It isn't some magical thing happening where you are actually seeing blue but have learned to call it red.
There are color tests that have determined this is the case. Which uses the wavelength to cut out all colors except a certain wavelength and then it is exposed to the person who then says what color they see. Unless they are color blind for that color they always pick the same color as everyone else.