Hm. So first, the ADL (Antisemitism Defense League) not only works to fight antisemitism, but also monitors hate in the world at large.
The problem is that because I don’t know you, I don’t know what you consider “acceptable” for Jewish people to do in order to “Get out while they still can.” (i.e. flee to Israel) The other problem is that of course, Jewish people shouldn’t be forced to leave Poland, you know? That is their home. They are poles.
That said, the Jewish Agency was founded in 1929, and they do support “Rescue Aliyah” efforts. Meaning that when Jewish lives are in peril, they seek to rescue them. They were a primary force of rescuing Jewish people fleeing Europe in WWII. You may specify donations go towards the Aliyah of Rescue fund.
If you are interested in supporting the Jewish Community of Poland, that is their website. They provide a wide variety of services, including financial aid for Jewish Holocaust survivors and non-Jewish Righteous Among the Nations survivors.
Similarly, there is Foundation for the Preservation of Jewish Heritage in Poland, and the POLIN Museum of the History of Polish Jews. (They have an additional website dedicated solely to the Polish Righteous.)
If someone has more suggestions, please let me know.