ALVS: Adaptive Live Video Streaming using deep reinforcement learning

Ozcelik İ. M., Ersoy C.

Journal of Network and Computer Applications, cilt.205, 2022 (SCI-Expanded) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 205
  • Basım Tarihi: 2022
  • Doi Numarası: 10.1016/j.jnca.2022.103451
  • Dergi Adı: Journal of Network and Computer Applications
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, PASCAL, Applied Science & Technology Source, Business Source Elite, Business Source Premier, Compendex, Computer & Applied Sciences, INSPEC
  • Anahtar Kelimeler: Adaptive playback speed, Deep reinforcement learning, Live streaming media and video quality
  • İstanbul Gelişim Üniversitesi Adresli: Hayır

Özet

Achieving a high Quality of Experience (QoE) in live event streaming is a challenging problem given a low-latency requirement and time-varying network conditions. Adaptive video bitrate and adaptive playback speed techniques are two separate control knobs to address this challenge. In this paper, we consider these two control parameters in a joint optimization problem and present a deep reinforcement learning (DRL) framework to maximize QoE for live streaming without any assumption about the environment or fixed rule-based heuristics. With the proposed DRL framework, our approach (ALVS) constructs the inference model to make a joint decision of adaptive playback speed and video quality level for the next video segment. Simulation results through real network traces show that ALVS outperforms both state-of-the-art DRL-based and rule-based algorithms in terms of QoE without sacrificing live latency and skipping any content.