Have you tried changing your virtual box settings for your adapter
Settings==>Network==>adapter==>Attached to (Choose Bidged adapter option)
There should be a label there known as "Promiscuous mode". Choose "Allow All" option..
Now go to "Devices" and tick your wifi adapter...
Devices==>choose your usb device
