Figured it out. If you are experiencing this problem then it is likely a codec issue. Videos can be tested by first trying to open the local file directly in your browsers. H.264 MP4 at 480p with AAC audio works across mostly all browsers. I used Blender to convert my videos.