@jespah,
I believe Polish Yiddish was different than Russian Yiddish.
Also, there were commonly used Yiddish phrases that really were impolite. No wonder no Yiddish was ever used at the Queen's Teas (a joke).
Personally, I would like to think American Jews are better known for speaking an educated English, which means they may still not be understood by the masses.