I waited an hour and a half. I have a pretty responsive laptop. It never did this.
Did you try this while installing to your HDD as well? Or only VirtualBox?