Abstract
HTTP Adaptive Streaming (HAS) solutions utilize various Adaptive BitRate (ABR) algorithms to dynamically select appropriate video representations, aiming to adapt to fluctuations in network bandwidth. However, current ABR implementations have a limitation in that they are designed to function with one set of video representations, i.e., the bitrate ladder, which differ in bitrate and resolution, but are encoded with the same video codec. When multiple codecs are available, current ABR algorithms select one of them prior to the streaming session and stick to it throughout the entire streaming session. Although newer codecs are generally preferred over older ones, their compression efficiencies differ depending on the content’s complexity, which varies over time. Therefore, it is necessary to select the appropriate codec for each video segment to reduce the requested data while delivering the highest possible quality. In this paper, we first provide a practical example where we compare compression efficiencies of different codecs on a set of video sequences. Based on this analysis, we formulate the optimization problem of selecting the appropriate codec for each user and video segment (on a per-segment basis in the outmost case), refining the selection of the ABR algorithms by exploiting key metrics, such as the perceived segment quality and size. Subsequently, to address the scalability issues of this centralized model, we introduce a novel distributed plug-in ABR algorithm for Video on Demand (VoD) applications called MEDUSA to be deployed on top of existing ABR algorithms. MEDUSA enhances the user’s Quality of Experience (QoE) by utilizing a multi-objective function that considers the quality and size of video segments when selecting the next representation. Using quality information and segment size from the modified Media Presentation Description (MPD), MEDUSA utilizes buffer occupancy to prioritize quality or size by assigning specific weights in the objective function. To show the impact of MEDUSA, we compare the proposed plug-in approach on top of state-of-the-art techniques with their original implementations and analyze the results for different network traces, video content, and buffer capacities. According to the experimental findings, MEDUSA shows the ability to improve QoE for various test videos and scenarios. The results reveal an impressive improvement in the QoE score of up to 42% according to the ITU-T P.1203 model (mode 0). Additionally, MEDUSA can reduce the transmitted data volume by up to more than 40% achieving a QoE similar to the techniques compared, reducing the burden on streaming service providers for delivery costs.
- Abdelhak Bentaleb, Bayan Taani, Ali C. Begen, Christian Timmerer, and Roger Zimmermann. 2019. A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTP. IEEE Communications Surveys & Tutorials 21, 1 (2019), 562–585. https://doi.org/10.1109/COMST.2018.2862938Google Scholar
Cross Ref
- Juraj Bienik, Miroslav Uhrina, Michal Kuba, and Martin Vaculik. 2016. Performance of H.264, H.265, VP8 and VP9 Compression Standards for High Resolutions. In 2016 19th International Conference on Network-Based Information Systems (NBiS). 246–252. https://doi.org/10.1109/NBiS.2016.70Google ScholarCross Ref
- Bitmovin Inc. 2020. Optimal Adaptive Streaming Formats MPEG-DASH & HLS Segment Length. [Online] Available: https://bitmovin.com/mpeg-dash-hls-segment-length/. Accessed: 10 September 2021.Google Scholar
- Yue Chen, Debargha Murherjee, Jingning Han, Adrian Grange, Yaowu Xu, Zoe Liu, Sarah Parker, Cheng Chen, Hui Su, Urvang Joshi, Ching-Han Chiang, Yunqing Wang, Paul Wilkins, Jim Bankoski, Luc Trudeau, Nathan Egge, Jean-Marc Valin, Thomas Davies, Steinar Midtskogen, Andrey Norkin, and Peter de Rivaz. 2018. An Overview of Core Coding Tools in the AV1 Video Codec. In 2018 Picture Coding Symposium (PCS). 41–45. https://doi.org/10.1109/PCS.2018.8456249Google ScholarCross Ref
- Federal Communications Commission. [n. d.]. Raw Data—Measuring Broadband America. [Online] Available: https://www.fcc.gov/reports-research/reports.Google Scholar
- Consumer Technology Association. Sept. 2020. CTA-5004: Web Application Video Ecosystem–Common Media Client Data.Google Scholar
- DASH Industry Forum (DASH-IF). [n. d.]. dash.js JavaScript Reference Client. [Online] Available: https://reference.dashif.org/dash.js/. Accessed: 10 August 2020.Google Scholar
- Alireza Erfanian, Farzad Tashtarian, Reza Farahani, Christian Timmerer, and Hermann Hellwagner. 2020. On optimizing resource utilization in AVC-based real-time video streaming. In 2020 6th IEEE conference on network softwarization (NetSoft). IEEE, 301–309.Google ScholarCross Ref
- Ericsson. [n. d.]. Ericsson Mobility Report. [Online] Available: https://www.ericsson.com/4ad7e9/assets/local/reports-papers/mobility-report/documents/2021/ericssonmobility-report-november-2021.pdf. Accessed: 05 May 2022.Google Scholar
- T.Y. Huang, R. Johari, N. McKeown, M. Trunnell, and M. Watson. 2014. A buffer-based approach to rate adaptation: Evidence from a large video streaming service. In ACM SIGCOMM Computer Communication Review, Vol. 44. ACM, 187–198. https://doi.org/10.1145/2619239.2626296.Google ScholarDigital Library
- Bitmovin Inc. [n. d.]. AV1 - The Powerful Next Generation Video Codec. [Online] Available: https://bitmovin.com/av1/. Accessed: 24 January 2023.Google Scholar
- ITU-T. 2017. Rec. P.1203. Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport - video quality estimation module. http://handle.itu.int/11.1002/ps/P1203-01 Accessed: 08 July 2021.Google Scholar
- ITU-T. 2022. ITU-T. 2022. P.910 : Subjective video quality assessment methods for multimedia applications. [Online] Available: https://www.itu.int/rec/T-REC-P.910-202207-I/en. Accessed: 13 July 2023.Google Scholar
- Parikshit Juluri, Venkatesh Tamarapalli, and Deep Medhi. 2015. SARA: Segment aware rate adaptation algorithm for dynamic adaptive streaming over HTTP. In IEEE Int’l. Conf. on Communication Workshops (ICCW). IEEE, 1765–1770. https://doi.org/10.1109/ICCW.2015.7247436.Google ScholarCross Ref
- Andreas Kah, Christopher Friedrich, Thomas Rusert, Christoph Burgmair, Wolfgang Ruppel, and Matthias Narroschke. 2021. Fundamental relationships between subjective quality, user acceptance, and the VMAF metric for a quality-based bit-rate ladder design for over-the-top video streaming services. In Applications of Digital Image Processing XLIV, Andrew G. Tescher and Touradj Ebrahimi (Eds.), Vol. 11842. International Society for Optics and Photonics, SPIE, 118420Z. https://doi.org/10.1117/12.2593952Google ScholarCross Ref
- Zhi Li, Anne Aaron, Ioannis Katsavounidis, Anush Moorthy, and Megha Manohara. [n. d.]. Toward a practical perceptual video quality metric. [Online] Available: https://netflixtechblog.com/toward-a-practical-perceptual-video-quality-metric-653f208b9652. Accessed: 20 June 2021.Google Scholar
- Daniele Lorenzi. 2023. QoE- and Energy-aware Content Consumption For HTTP Adaptive Streaming. In Proceedings of the 14th Conference on ACM Multimedia Systems (Vancouver, BC, Canada) (MMSys ’23). Association for Computing Machinery, New York, NY, USA, 348–352. https://doi.org/10.1145/3587819.3593029Google ScholarDigital Library
- Daniele Lorenzi, Farzad Tashtarian, Hadi Amirpour, Christian Timmerer, and Hermann Hellwagner. 2023. MCOM-Live: A Multi-Codec Optimization Model at the Edge for Live Streaming. In MultiMedia Modeling, Duc-Tien Dang-Nguyen, Cathal Gurrin, Martha Larson, Alan F. Smeaton, Stevan Rudinac, Minh-Son Dao, Christoph Trattner, and Phoebe Chen (Eds.). Springer Nature Switzerland, Cham, 252–264.Google Scholar
- Vignesh V Menon, Christian Feldmann, Hadi Amirpour, Mohammad Ghanbari, and Christian Timmerer. 2022. VCA: Video Complexity Analyzer. In Proceedings of the 13th ACM Multimedia Systems Conference (Athlone, Ireland) (MMSys ’22). Association for Computing Machinery, New York, NY, USA, 259–264. https://doi.org/10.1145/3524273.3532896Google ScholarDigital Library
- Debargha Mukherjee, Jim Bankoski, Adrian Grange, Jingning Han, John Koleszar, Paul Wilkins, Yaowu Xu, and Ronald Bultje. 2013. The latest open-source video codec VP9 - An overview and preliminary results. In 2013 Picture Coding Symposium (PCS). 390–393. https://doi.org/10.1109/PCS.2013.6737765Google ScholarCross Ref
- D. V. Nguyen, H. T. Le, P. N. Nam, A. T. Pham, and T. C. Thang. 2016. Adaptation method for video streaming over HTTP/2. IEICE Communications Express 5, 3 (2016), 69–73. https://doi.org/10.1587/comex.2015XBL0177.Google ScholarCross Ref
- Minh Nguyen, Daniele Lorenzi, Farzad Tashtarian, Hermann Hellwagner, and Christian Timmerer. 2022. DoFP+: An HTTP/3-Based Adaptive Bitrate Approach Using Retransmission Techniques. IEEE Access 10(2022), 109565–109579. https://doi.org/10.1109/ACCESS.2022.3214827Google ScholarCross Ref
- Jens-Rainer Ohm, Gary J. Sullivan, Heiko Schwarz, Thiow Keng Tan, and Thomas Wiegand. 2012. Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC). IEEE Transactions on Circuits and Systems for Video Technology 22, 12(2012), 1669–1684. https://doi.org/10.1109/TCSVT.2012.2221192Google ScholarDigital Library
- Jan Ozer. 2017. Finding the Just Noticeable Difference with Netflix VMAF. [Online] Available: https://www.linkedin.com/pulse/finding-just-noticeabledifference-netflix-vmaf-jan-ozer/. Accessed: 29 May 2023.Google Scholar
- Stefano Petrangeli, Jeroen Famaey, Maxim Claeys, Steven Latré, and Filip De Turck. 2015. QoE-Driven Rate Adaptation Heuristic for Fair Adaptive Video Streaming. ACM Trans. Multimedia Comput. Commun. Appl. 12, 2, Article 28(oct 2015), 24 pages. https://doi.org/10.1145/2818361Google ScholarDigital Library
- R. Pantos, Ed. and May W. [n. d.]. HTTP Live Streaming. RFC 8216. [Online] Available: https://www.rfc-editor.org/info/rfc8216. Accessed: 05 May 2022.Google Scholar
- Alexander Raake, Marie-Neige Garcia, Werner Robitza, Peter List, Steve Göring, and Bernhard Feiten. 2017. A bitstream-based, scalable video-quality model for HTTP adaptive streaming: ITU-T P.1203.1. In 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX). 1–6. https://doi.org/10.1109/QoMEX.2017.7965631Google ScholarCross Ref
- Darijo Raca, Jason J Quinlan, Ahmed H Zahran, and Cormac J Sreenan. 2018. Beyond throughput: a 4G LTE dataset with channel and context metrics. In Proceedings of the 9th ACM Multimedia Systems Conference. 460–465.Google ScholarDigital Library
- Yuriy A. Reznik, Xiangbo Li, Karl O. Lillevold, Abhijith Jagannath, and Justin Greer. 2019. Optimal Multi-Codec Adaptive Bitrate Streaming. In 2019 IEEE International Conference on Multimedia Expo Workshops (ICMEW). 348–353. https://doi.org/10.1109/ICMEW.2019.00066Google ScholarCross Ref
- Lea Skorin-Kapov, Martín Varela, Tobias Hoßfeld, and Kuan-Ta Chen. 2018. A Survey of Emerging Concepts and Challenges for QoE Management of Multimedia Services. ACM Trans. Multimedia Comput. Commun. Appl. 14, 2s, Article 29(may 2018), 29 pages. https://doi.org/10.1145/3176648Google ScholarDigital Library
- Kevin Spiteri, Ramesh Sitaraman, and Daniel Sparacio. 2019. From Theory to Practice: Improving Bitrate Adaptation in the DASH Reference Player. ACM Trans. Multimedia Comput. Commun. Appl. 15, 2s, Article 67(jul 2019), 29 pages. https://doi.org/10.1145/3336497Google ScholarDigital Library
- K. Spiteri, R. Urgaonkar, and R. K. Sitaraman. 2016. BOLA: Near-optimal bitrate adaptation for online videos. In IEEE INFOCOM 2016-The 35th Annual IEEE Int’l. Conf. on Computer Communications. IEEE, 1–9.Google ScholarDigital Library
- Gary J. Sullivan, Jens-Rainer Ohm, Woo-Jin Han, and Thomas Wiegand. 2012. Overview of the High Efficiency Video Coding (HEVC) Standard. IEEE Transactions on Circuits and Systems for Video Technology 22, 12(2012), 1649–1668. https://doi.org/10.1109/TCSVT.2012.2221191Google ScholarDigital Library
- Babak Taraghi, Hadi Amirpour, and Christian Timmerer. 2022. Multi-Codec Ultra High Definition 8K MPEG-DASH Dataset. In Proceedings of the 13th ACM Multimedia Systems Conference (Athlone, Ireland) (MMSys ’22). Association for Computing Machinery, New York, NY, USA, 216–220. https://doi.org/10.1145/3524273.3532889Google ScholarDigital Library
- Babak Taraghi, Anatoliy Zabrovskiy, Christian Timmerer, and Hermann Hellwagner. 2020. CAdViSE: Cloud-Based Adaptive Video Streaming Evaluation Framework for the Automated Testing of Media Players. In Proceedings of the 11th ACM Multimedia Systems Conference (Istanbul, Turkey) (MMSys ’20). Association for Computing Machinery, New York, NY, USA, 349–352. https://doi.org/10.1145/3339825.3393581Google ScholarDigital Library
- Farzad Tashtarian, Alireza Erfanian, and Amir Varasteh. 2018. S2VC: An SDN-based framework for maximizing QoE in SVC-based HTTP adaptive streaming. Computer Networks 146(2018), 33–46.Google ScholarCross Ref
- Yilin Wang, Sasi Inguva, and Balu Adsumilli. 2019. YouTube UGC dataset for video compression research. In 2019 IEEE 21st Int’l. Workshop on Multimedia Signal Processing (MMSP). IEEE, 1–5.Google ScholarCross Ref
- T. Wiegand, G.J. Sullivan, G. Bjontegaard, and A. Luthra. 2003. Overview of the H.264/AVC video coding standard. IEEE Transactions on Circuits and Systems for Video Technology 13, 7(2003), 560–576. https://doi.org/10.1109/TCSVT.2003.815165Google ScholarDigital Library
- World Wide Web Consortium (W3C). Sept. 2014. Efficient XML Interchange (EXI) Format 1.0 (Second Edition). https://www.w3.org/TR/exi/Google Scholar
- Anatoliy Zabrovskiy, Christian Feldmann, and Christian Timmerer. 2018. A Practical Evaluation of Video Codecs for Large-Scale HTTP Adaptive Streaming Services. In 2018 25th IEEE International Conference on Image Processing (ICIP). 998–1002. https://doi.org/10.1109/ICIP.2018.8451017Google ScholarCross Ref
Index Terms
- MEDUSA: A Dynamic Codec Switching Approach in HTTP Adaptive Streaming
Recommendations
E-WISH: An Energy-aware ABR Algorithm For Green HTTP Adaptive Video Streaming
MHV '24: Proceedings of the 3rd Mile-High Video ConferenceHTTP Adaptive Streaming (HAS) is the de-facto solution for delivering video content over the Internet. The climate crisis has highlighted the environmental impact of information and communication technologies (ICT) solutions and the need for green ...
HTTP/2-Based Methods to Improve the Live Experience of Adaptive Streaming
MM '15: Proceedings of the 23rd ACM international conference on MultimediaHTTP Adaptive Streaming (HAS) is today the number one video technology for over-the-top video distribution. In HAS, video content is temporally divided into multiple segments and encoded at different quality levels. A client selects and retrieves per ...
Performance of Low-Latency HTTP-based Streaming Players
MMSys '21: Proceedings of the 12th ACM Multimedia Systems ConferenceReducing end-to-end streaming latency is critical to HTTP-based live video streaming. There are currently two technologies in this domain: Low-Latency HTTP Live Streaming (LL-HLS) and Low-Latency Dynamic Adaptive Streaming over HTTP (LL-DASH). Many ...
Comments