By the way, the final "ay" sound in allay and allez is not exactly the same, but i doubt that native speakers of the American language would notice any difference. The difference would be in how the native speaker of American pronounced the first "a" in the word allay.
If pronounced as is the "a" in wan, then i doubt the native American speaker would distinguish between the pronunciation of these two words.
If pronounced as is the "a" in cat, then there's an ouside shot that a native speaker of the American language would notice a difference in pronunciation.