I have the exact same problem with Live Booting from USB stick. I had it with 2019.3 and now with the 2019.4 version of Kali Linux.