Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/leandromoreira/http-video-streaming-troubleshooting

A collection of fixes / problem solutions to HTTP video streaming
https://github.com/leandromoreira/http-video-streaming-troubleshooting

hls http-streaming mobile mpeg-dash troubleshooting tv video

Last synced: 10 days ago
JSON representation

A collection of fixes / problem solutions to HTTP video streaming

Awesome Lists containing this project

README 

        
# A troubleshooting guide for video streaming issues



This is a collection of issues related to video streaming, how to check them and, when possible, how to solve them. If you work with video streaming (either live or VOD) for at least two years, [you know what it's like!](https://haasn.xyz/posts/2016-12-25-falsehoods-programmers-believe-about-%5Bvideo-stuff%5D.html) **It's a shame we can't just say it works on [VLC](https://github.com/videolan/vlc) and move on!**



The many problems arise, mostly, from our silly wish to delivery video throughout all of the devices: 

* many browsers (firefox, chrome, edge, ios safari, android browser ...)

* many OSs (linux, macos, windows, ios, android ...)

* many TVs brands (samsung, LG, sony, TCL ...)

* many TVs brands models or release year (2012, 2013, 2016 ...)

* many possible device-specific features available or not (4k, HDR, HEVC...)

* many yet DRM system ([FPS - FairPlay Streaming, PR - PlayReady, WV - Widevine](https://github.com/leandromoreira/digital_video_introduction#how))

* and the multiplication of these factors: Does the **4K (DRM protected)** version of a **video (delivered over HLS "delivery" protocol)** plays well in an **X mobile at a Y version** using the **K browser at version X**?



We'll focus mainly on [HTTP adaptive bitrate streaming](https://en.wikipedia.org/wiki/Adaptive_bitrate_streaming) protocols and the mostly used [CODECs](https://github.com/leandromoreira/digital_video_introduction#how-does-a-video-codec-work).



> **Disclaimer**: the problems and solutions found here were faced and challenged by many of my colleagues so **you are welcomed to contribute with your story too** :mortar_board: or even helping (correcting) us to understand some of the spooky problems. 



# HTTP cookies don't work everywhere!

> The old n' good cookie HTTP header aren't edible in some TVs!



Nope, some TVs doesn't know or care about what [cookies](https://developer.mozilla.org/en-US/docs/Web/HTTP/Cookies) do so **the path might be your only savior.**



# HTTPS doesn't perform well in all TVs

> To be or not to be HTTPS?



Some old TVs doesn't perform well under [HTTPS](https://en.wikipedia.org/wiki/HTTPS), there will be many dropped frames or even unplayable videos. Sometimes what **one needs to do is to be insecure!** PS: you might need to be insecure even for images.



# The 1994 HTTP chunked transfer encoding doesn't work in all TVs

> 9\r\n

>

> it doesnt\r\n

>

> 5\r\n

>

> work\r\n

>

> 0\r\n

>

> \r\n



Some CTV's native player can't handle [chunked transfer encoding](https://en.wikipedia.org/wiki/Chunked_transfer_encoding), therefore you must state your full lenght ahead of time.



# CORS is not followed in all devices

> Some TVs doesn't respect the police



Some TVs also don't respect or work with [CORS](https://en.wikipedia.org/wiki/Cross-origin_resource_sharing)!



# Do not mix video frame rate

> The mixed frame rate isn't a problem in 2018? is it?



Well, some TVs doesn't like to mix different [frame rates](https://en.wikipedia.org/wiki/Frame_rate). For instance, we had our first rendition using 15 FPS while our bigger renditions were using 30 FPS, nice and tide for almost all of the devices, except some TVs, they play the content but dropping a lot of frames :( yeap, **some TVs won't play great with different frame rates**, mostly when they're switching among the renditions.



# Do not mix the audio frame (sample) rate

> Lip sync battle!



If your **audio framerate is not consistent** in all your renditions, some devices might **play glitches** randomly or even worst they won't play it at all, so **stick with a single audio frame rate.**



# Stick to 44.1khz?

> Lip sync battle 2 - the return!



Using the **same audio frame rate isn't enough**, we noticed some devices are really rooted in their causes, they **play better at 44.1khz.** I really don't know why.



# [PTS](https://en.wikipedia.org/wiki/Presentation_timestamp), GOP and segment size must be orchestrated

> Time, it needs time to win back your love again



Sometimes your playback will present strange behaviors like going back in time, freezing and then playing again and etc. And timing might play a big role here, HLS ,for instance, expects your [GOP's](https://en.wikipedia.org/wiki/Group_of_pictures) to be a multiplier of your segment size (and don't forget to [disable scene detection](https://en.wikibooks.org/wiki/MeGUI/x264_Settings#scenecut)). It doesn't hurt to remember that the PTS and the program date time of your renditions should be in sync.



# Encrypted HLS :: some TVs won't mount the correct URL to download the key

> Your expensive smart TV can't mount the right URL using a relative path.



Let's say your master manifest1 points to variant of 480p2 which contains the `mpegts` and the `keys` in the same level as the variant but the TV will try to download the `key` as if it was located on the master manifest.



1. http://example.com/p/s/x/stream.m3u8

2. http://example.com/p/s/x/stream/stream-480p.m3u8

3. http://example.com/p/s/x/stream/stream-480p/key01.ts

4. http://example.com/p/s/x/stream/stream-480p/01.ts



Your TV might try to download the following key `http://example.com/p/s/x/stream/key01.ts`. One thing you can do is to put the whole URL into the variant manifest instead of just the relative path.



# EXT-X-MEDIA-SEQUENCE used to sync renditions

> If it's not on the standard, I'll do what I want!



The playback needs some way to know how to switch among the renditions, they need to use some information to do that and the data that the playback uses to sync the renditions might negatively affect your final users. 



The HLS has a tag called [EXT-X-MEDIA-SEQUENCE](https://tools.ietf.org/html/draft-pantos-http-live-streaming-23#section-4.3.3.2) to indicate the media sequence number of the first media segment that appears in a playlist file.

   

It turns out that some devices and players use this tag to sync all the renditions :( even though the HLS standard in [March 2013](https://tools.ietf.org/html/draft-pantos-http-live-streaming-09#section-3.4.3) (almost 6 years ago) made it clear it MUST NOT BE USED this way.



# Some devices won't play the "high" resolutions renditions

> Your expensive smart TV can't play HD (h264) videos.



Some TVs will present flickering, timing issues and others while playing a normal manifest (i.e. HLS, H264 up until 720p), the solution is just to cut out the higher renditions. Since you found what devices can't do well with high resolution you just need **to offer a limited, resolutions lower than X, manifest for that group of devices**.



# General steps to verify MPEG-DASH or HLS issues



* check if [cors is enabled](https://developer.mozilla.org/en-US/docs/Web/HTTP/CORS) at your servers

* try to run a publicly known, same resource kind, to see if it's a general problem, like does it play a known hls/mpeg-dash url?

* try different devices, OSs and browsers to see if the problem persists

* run some analyzers, for instance, Apple offers its [mediastreamvalidator](https://developer.apple.com/library/archive/documentation/NetworkingInternet/Conceptual/StreamingMediaGuide/UsingHTTPLiveStreaming/UsingHTTPLiveStreaming.html) for HLS and there is [ffprobe](https://www.ffmpeg.org/ffprobe-all.html#Synopsis) and if you search for `" analyzer"` you might find more tools.

* check if there any official recommendation for a given protocol like, [HLS](https://developer.apple.com/documentation/http_live_streaming/hls_authoring_specification_for_apple_devices#2969492) or even [general guide for MPEG-DASH](https://developer.mozilla.org/en-US/docs/Web/Apps/Fundamentals/Audio_and_video_delivery/Setting_up_adaptive_streaming_media_sources#MPEG-DASH_Encoding) they worth to read!