I'm using a Kingston 8GB Flashdrive with Kali 1.0.2 on it and running it as Live on a Compaq Mini notebook. I have no persistence defined on the Flashdrive either.
I deleted 1 file once. And moved it to Trash. After I reboot my computer the file is still there. As a LiveCD wasn't everything suppose to vanish after the computer shutdown ?