skip to main content
research-article

When latency matters: measurements and lessons learned

Published:03 December 2021Publication History
Skip Abstract Section

Abstract

Several emerging classes of interactive applications are demanding for extremely low-latency to be fully unleashed, with edge computing generally regarded as a key enabler thanks to reduced delays. This paper presents the outcome of a large-scale end-to-end measurement campaign focusing on task-offloading scenarios, showing that moving the computation closer to the end-users, alone, may turn out not to be enough. Indeed, the complexity associated with modern networks, both at the access and in the core, the behavior of the protocols at different levels of the stack, as well as the orchestration platforms used in data-centers hide a set of pitfalls potentially reverting the benefits introduced by low propagation delays. In short, we highlight how ensuring good QoS to latency-sensitive applications is definitely a multi-dimensional problem, requiring to cope with a great deal of customization and cooperation to get the best from the underlying network.

References

  1. N. Abbas, Y. Zhang, A. Taherkordi, and T. Skeie. 2018. Mobile Edge Computing: A Survey. IEEE Internet Things J. 5, 1 (Feb. 2018), 450--465. Google ScholarGoogle ScholarCross RefCross Ref
  2. A. Banks, E. Briggs, K. Borgendale, and R. Gupta. 2019. MQTT Version 5.0. Technical Report. OASIS Open. https://docs.oasis-open.org/mqtt/mqtt/v5.0/mqtt-v5.0.pdf Accessed on: May 31, 2021.Google ScholarGoogle Scholar
  3. N. Cardwell, Y. Cheng, C. S. Gunn, S. H. Yeganeh, and V. Jacobson. 2016. BBR: Congestion-Based Congestion Control: Measuring Bottleneck Bandwidth and Round-Trip Propagation Time. Queue 14, 5 (Oct. 2016), 20--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. B. Charyyev, E. Arslan, and M. H. Gunes. 2020. Latency Comparison of Cloud Datacenters and Edge Servers. In Proc. 2020 IEEE Global Communications Conf. (GLOBECOM). IEEE, New York, NY, USA, 1--6. Google ScholarGoogle ScholarCross RefCross Ref
  5. J. Chen and X. Ran. 2019. Deep Learning With Edge Computing: A Review. Proc. IEEE 107, 8 (Aug. 2019), 1655--1674. Google ScholarGoogle ScholarCross RefCross Ref
  6. Z. Chen et al. 2017. An Empirical Study of Latency in an Emerging Class of Edge Computing Applications for Wearable Cognitive Assistance. In Proc. 2nd ACM/IEEE Symp. on Edge Computing. ACM, New York, NY, USA, 1--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. S. Choy, B. Wong, G. Simon, and C. Rosenberg. 2012. The brewing storm in cloud gaming: A measurement study on cloud to end-user latency. In Proc. 11th Annual Workshop on Network and Systems Support for Games (NetGames). IEEE, New York, NY, USA, 1--6. Google ScholarGoogle ScholarCross RefCross Ref
  8. CNCF Staff. 2020. CNCF Survey 2020. Technical Report. Cloud Native Computing Foundation. https://www.cncf.io/wp-content/uploads/2020/11/CNCF_Survey_Report_2020.pdf Accessed on: May 31, 2021.Google ScholarGoogle Scholar
  9. G. Fairhurst, A. Sathiaseelan, and R. Secchi. 2015. Updating TCP to Support Rate-Limited Traffic. RFC 7661. RFC Editor.Google ScholarGoogle Scholar
  10. I. Fette and A. Melnikov. 2011. The WebSocket Protocol. RFC 6455. RFC Editor.Google ScholarGoogle Scholar
  11. P Garcia Lopez et al. 2015. Edge-Centric Computing: Vision and Challenges. ACM SIGCOMM Comput. Commun. Rev. 45, 5 (Sept. 2015), 37--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. Gettys and K. Nichols. 2011. Bufferbloat: Dark Buffers in the Internet: Networks without Effective AQM May Again Be Vulnerable to Congestion Collapse. ACM Queue 9, 11 (Nov. 2011), 40--54. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. M. Gorlatova, H. Inaltekin, and M. Chiang. 2020. Characterizing task completion latencies in multi-point multi-quality fog computing systems. Comput. Netw. 181 (Nov. 2020), 1--11. Google ScholarGoogle ScholarCross RefCross Ref
  14. M. Handley, J. Padhye, and S. Floyd. 2000. TCP Congestion Window Validation. RFC 2861. RFC Editor.Google ScholarGoogle Scholar
  15. G. Huston. 2003. Measuring IP Network Performance. The Internet Protocol J. 6, 1 (March 2003), 2--19.Google ScholarGoogle Scholar
  16. X. Jiang et al. 2019. Low-Latency Networking: Where Latency Lurks and How to Tame It. Proc. IEEE 107, 2 (Feb. 2019), 280--306. Google ScholarGoogle ScholarCross RefCross Ref
  17. N. Naik. 2017. Choice of effective messaging protocols for IoT systems: MQTT, CoAP, AMQP and HTTP. In Proc. 2017 IEEE Int. Systems Engineering Symp. (ISSE). IEEE, New York, NY, USA, 1--7. Google ScholarGoogle ScholarCross RefCross Ref
  18. C. Nguyen, A. Mehta, C. Klein, and E. Elmroth. 2019. Why Cloud Applications Are Not Ready for the Edge (Yet). In Proc. 4th ACM/IEEE Symp. on Edge Computing. ACM, New York, NY, USA, 250--263. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. E. Rescorla. 2018. The Transport Layer Security (TLS) Protocol Version 1.3. RFC 8446. RFC Editor.Google ScholarGoogle Scholar
  20. W. Shi et al. 2016. Edge Computing: Vision and Challenges. IEEE Internet Things J. 3, 5 (Oct. 2016), 637--646. Google ScholarGoogle ScholarCross RefCross Ref
  21. Z. Wu and H. V. Madhyastha. 2013. Understanding the Latency Benefits of Multi-Cloud Webservice Deployments. ACM SIGCOMM Comput. Commun. Rev. 43, 2 (April 2013), 13--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. D. Xu et al. 2020. Understanding Operational 5G: A First Measurement Study on Its Coverage, Performance and Energy Consumption. In Proc. Annu. Conf. ACM SIGCOMM. ACM, New York, NY, USA, 479--494. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. K. Zhang et al. 2017. Mobile-Edge Computing for Vehicular Networks: A Promising Network Paradigm with Predictive Off-Loading. IEEE Veh. Technol. Mag. 12, 2 (June 2017), 36--44. Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. When latency matters: measurements and lessons learned

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM SIGCOMM Computer Communication Review
        ACM SIGCOMM Computer Communication Review  Volume 51, Issue 4
        October 2021
        49 pages
        ISSN:0146-4833
        DOI:10.1145/3503954
        Issue’s Table of Contents

        Copyright © 2021 Copyright is held by the owner/author(s)

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 3 December 2021

        Check for updates

        Qualifiers

        • research-article

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader