KC Claffy
David Clark
Ellen Zegura
Abstract
In January and April 2021 we held the Workshop on Overcoming Measurement Barriers to Internet Research (WOMBIR) with the goal of understanding challenges in network and security data set collection and sharing. Most workshop attendees provided white papers describing their perspectives, and many participated in short-talks and discussion in two virtual workshops over five days. That discussion produced consensus around several points. First, many aspects of the Internet are characterized by decreasing visibility of important network properties, which is in tension with the Internet's role as critical infrastructure. We discussed three specific research areas that illustrate this tension: security, Internet access; and mobile networking. We discussed visibility challenges at all layers of the networking stack, and the challenge of gathering data and validating inferences. Important data sets require longitudinal (long-term, ongoing) data collection and sharing, support for which is more challenging for Internet research than other fields. We discussed why a combination of technical and policy methods are necessary to safeguard privacy when using or sharing measurement data. Workshop participant proposed several opportunities to accelerate progress, some of which require coordination across government, industry, and academia.
- M. Martonosi, "Request for Information on the specific needs for datasets to conduct research on computer and network systems." NSF Dear Colleague Letter 21-056, at https://www.nsf.gov/pubs/2021/nsf21056/nsf21056.jsp.Google Scholar
- "NSF-sponsored Workshop on Overcoming Measurement Barriers to Internet Research (WOMBIR 2021) -- Parts I and II," 2021. https://www.caida.org/workshops/wombir/2101/.Google Scholar
- "Cyberspace Solarium Commission report," 2020. https://www.solarium.gov/report.Google Scholar
- "A National Cybersecurity Agenda for Resilient Digital Infrastructure," The Aspen Institute, 2020. https://www.aspeninstitute.org/longform/a-national-cybersecurity-agenda-for-resilient-digital-infrastructure/.Google Scholar
- National Academy of Sciences, "Principles and Practices for a Federal Statistical Agency, Edition 7." https://www.nap.edu/resource/25885/P&P%207%20Higlights.pdf.Google Scholar
- "Telecommunications Act of 1996, Section 706(a): Advanced Telecommunications Incentives." (codified as 47 U.S.C. 1302).Google Scholar
- U.S. General Services Administration (GSA), "Broadband Data Resources in data.gov," 2021. https://catalog.data.gov/dataset?q=broadband.Google Scholar
- Zachary S. Bischof and Fabián E. Bustamante and Rade Stanojevic, "Need, Want, Can Afford Broadband Markets and the Behavior of Users," in Proceedings of the ACM Internet Measurement Conference, 2014. Google ScholarDigital Library
- J. P. Rula, Z. S. Bischof, and F. E. Bustamante, "Second chance: Understanding diversity in broadband access network performance," in Proceedings of the 2015 ACM SIGCOMM Workshop on Crowdsourcing and Crowdsharing of Big (Internet) Data, C2B(1)D '15, (New York, NY, USA), p. 914, Association for Computing Machinery, 2015.Google Scholar
- Z. Bischof, F. Bustamante, and R. Stanojevic, "The utility argument making a case for broadband slas," in Passive and Active Measurement - 18th International Conference, PAM 2017, Proceedings (S. Uhlig, J. Amann, and M. Kaafar, eds.), Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), pp. 156--169, Springer Verlag, 2017.Google ScholarCross Ref
- Y. Li, C. Peng, Z. Yuan, J. Li, H. Deng, and T. Wang, "MobileInsight: Extracting and Analyzing Cellular Network Information on Smartphones." http://www.mobileinsight.net, 2016.Google Scholar
- Kenneally, Erin and Dittrich, David, "The Menlo Report: Ethical Principles Guiding Information and Communication Technology Research," 2012. http://ssrn.com/abstract=2445102.Google Scholar
- Dittrich, David and Kenneally, Erin and Bailey, Michael, "Applying Ethical Principles to Information and Communication Technology Research: A Companion to the Menlo Report," 2013. http://ssrn.com/abstract=2342036.Google Scholar
- C. Dwork, F. McSherry, K. Nissim, and A. Smith, "Calibrating noise to sensitivity in private data analysis," in Theory of Cryptography (S. Halevi and T. Rabin, eds.), 2006.Google Scholar
- C. Staff, "Differential privacy: The pursuit of protections by default," Commun. ACM, vol. 64, Jan. 2021.Google Scholar
- D. Evans, V. Kolesnikov, and M. Rosulek, "A pragmatic introduction to secure multi-party computation," Foundations and Trends in Privacy and Security, vol. 2, 2018. free version at http://securecomputation.org/.Google ScholarCross Ref
- Y. Lindell, "Secure multiparty computation," Comm. ACM, Dec. 2020.Google Scholar
- P. Francis, S. Eide, and R. Munz, "Diffix: High-utility database anonymization," in Annual Privacy Forum, pp. 141--158, 06 2017.Google Scholar
- H. Corrigan-Gibbs and D. Boneh, "Prio: Private, robust, and scalable computation of aggregate statistics," in USENIX Conference on Networked Systems Design and Implementation, NSDI'17, 2017.Google Scholar
- J. Polonetsky, O. Tene, and K. Finch, "Shades of gray: Seeing the full spectrum of practical data de-identification," Santa Clara Law Review, p. 593628, 2016. http://digitalcommons.law.scu.edu/lawreview/vol56/iss3/3.Google Scholar
- "CAIDA Data Stewardship Agreements," 2020. https://www.caida.org/about/legal/.Google Scholar
- kc claffy and David Clark, "Comments on the American Research Environment," 2021. in response to Request for Information from the National Science and Technology Council, https://www.caida.org/catalog/papers/2020_comments_rfi_american_research/.Google Scholar
- University Industry Demonstration Partnership, "Uidp website." https://uidp.org/, 2021.Google Scholar
- NSF, NTIA, and FCC, "Memorandum of agreement between the NSF, the NTIA and the FCC regarding the Spectrum Innovation Initiative." https://www.ntia.doc.gov/files/ntia/blogimages/sii_moa_fcc_nsf_ntia.pdf, Jan. 2021.Google Scholar
- FCC, "Electronic comment filing system." https://www.fcc.gov/ecfs, 2021.Google Scholar
- FCC. https://www.fcc.gov/proceedings-actions/daily-digest.Google Scholar
- NFS and FCC, "NSF-FCC workshop on tracking quality of experience in the Internet." Workshop website http://aqualab.cs.northwestern.edu/conference/276, Oct. 2015.Google Scholar
Index Terms
- Workshop on Overcoming Measurement Barriers to Internet Research (WOMBIR 2021) final report
Recommendations
Workshop on Internet Economics (WIE 2019) report
On 9-11 December 2019, CAIDA hosted the 10th interdisciplinary Workshop on Internet Economics (WIE) at UC San Diego's Supercomputer Center. This workshop series provides a forum for researchers, Internet facilities and service providers, technologists, ...
Workshop on Internet Economics (WIE2016) Final Report
On December 8-9 2016, CAIDA hosted the 7th interdisciplinary Workshop on Internet Economics (WIE) at the UC San Diego's Supercomputer Center. This workshop series provides a forum for researchers, Internet facilities and service providers, technologists,...
Workshop on internet economics (WIE2017) final report
On December 13-14 2017, CAIDA hosted the 8th interdisciplinary Workshop on Internet Economics (WIE) at the UC San Diego's Supercomputer Center. This workshop series provides a forum for researchers, Internet facilities and service providers, ...
Comments