How to find all video type files in windows 8.1
Open up File Explorer and make sure your current directory is on This PC. Copy kind:=video
in the search bar. This should bring up all the video formats. This should also search your entire PC including all drives, files and folders.
You can also see which folders are indexed, by click Advanced options > Changed indexed locations.