Live USB data gets lost on Restart
Universal USB Installer is a Live Linux USB Creator that allows you to choose from a selection of Linux Distributions to put on your USB Flash Drive.
The Universal USB Installer is easy to use. Simply choose a Live Linux Distribution, the ISO file, your Flash Drive and, Click Install. Other features include; Persistence (if available), and the ability to fat32 format the flash drive (recommended) to ensure a clean install.
Upon completion, you should have a ready to run bootable USB Flash Drive with your select Linux version installed.
You need to make the USB installation Persistent
Additional information Here : https://wiki.ubuntu.com/LiveUsbPendrivePersistent