skip to main content
10.1145/3400806.3400832acmotherconferencesArticle/Chapter ViewAbstractPublication PagessmsocietyConference Proceedingsconference-collections
research-article

Regulating Digital Harm Across Borders: Exploring a Content Platform Commission

Published: 22 July 2020 Publication History

Abstract

Regulatory systems crafted in and for countries with well-functioning, well-intentioned democratic governments will have unintended effects that spill over to other societies. Looking at the regulation of online content platforms, risks surface that support a regulatory solution that considers the safety and human rights of people in countries whose governments are unwilling or unable to regulate content platforms effectively. This paper explores the strengths and weaknesses of three general approaches to the cross-border regulation of online content platforms – certification, liability, and self-regulation. Ultimately, it offers a co-regulatory approach in which the U.S. and/or EU governments certifies a quasi-governmental Content Platform Commission charged with setting transparency and redress standards and publishing research on risks and mitigation strategies in each market where content platforms operate. The proposed solution seeks to preserve intermediary liability protections and maintain platforms’ freedom to innovate while ensuring that decisions that affect people's interests are made transparently and with avenues for redress.

References

[1]
ABNR Law. Indonesia Issues Important New Regulation on Electronic (Network and Information) Systems. October 30, 2019. https://www.abnrlaw.com/news_detail.php?send_news_id=366&year=2019
[2]
Algorithmic Accountability Act of 2019. H.R. 2231. 116th Congress.
[3]
Allow States and Victims to Fight Online Sex Trafficking Act of 2017. H.R. 1865. https://www.congress.gov/bill/115th-congress/house-bill/1865/text
[4]
Article 19. Self-regulation and ‘hate speech’ on social media platforms. 2018. https://www.article19.org/wp-content/uploads/2018/03/Self-regulation-and-%E2%80%98hate-speech%E2%80%99-on-social-media-platforms_March2018.pdf
[5]
BSR. Human Rights Impact Assessment: Facebook in Myanmar. 2018. https://fbnewsroomus.files.wordpress.com/2018/11/bsr-facebook-myanmar-hria_final.pdf
[6]
BSR. Human Rights Review: Facebook Oversight Board. December 2019. https://www.bsr.org/reports/BSR_Facebook_Oversight_Board.pdf
[7]
Lauren Carasik. The Alien Tort Statute and Human Rights Law. Foreign Affairs. October 25, 2017. https://www.foreignaffairs.com/articles/united-states/2017-10-25/alien-tort-statute-and-human-rights-law
[8]
Diego Casaes and Yasodara Córdova. Weaponised Information in Brazil: Digitising Hate. Toda Peace Institute. Policy Brief No. 63. November 2019. https://toda.org/assets/files/resources/policy-briefs/t-pb-63_casaes-and-cordova_weaponised-information-in-brazil.pdf
[9]
Lura Chamberlain. FOSTA: A Hostile Law with a Human Cost. Fordham Law Review 87(5). 2019. https://ir.lawnet.fordham.edu/cgi/viewcontent.cgi?article=5598&context=flr
[10]
Christchurch Call to Eliminate Terrorist and Violent Extremist Content Online. The Call. 2019. https://www.christchurchcall.com/call.html
[11]
Andrew Christian. Combating Fake News Is Critical, But Nigeria Regulating Social Media May Be A Step in The Wrong Direction. Weetracker. November 11, 2019. https://weetracker.com/2019/11/11/fake-news-regulations-nigeria/
[12]
Danielle Keats Citron. Technological due process. Washington University Law Review 85 (2007): 1249. https://openscholarship.wustl.edu/cgi/viewcontent.cgi?article=1166&context=law_lawreview
[13]
Kate Crawford. Artificial Intelligence's White Guy Problem. The New York Times. June 25, 2016. https://www.nytimes.com/2016/06/26/opinion/sunday/artificial-intelligences-white-guy-problem.html
[14]
Criminal Code Amendment (Sharing of Abhorrent Violent Material) Bill 2019. The Parliament of the Commonwealth of Australia. 2019. https://parlinfo.aph.gov.au/parlInfo/download/legislation/bills/s1201_first-senate/toc_pdf/1908121.pdf;fileType=application%2Fpdf
[15]
Cybersecurity Act 2019 (EU). https://eur-lex.europa.eu/eli/reg/2019/881/oj
[16]
David Dolezilek and Laura Hussey. Requirements or recommendations? Sorting out NERC CIP, NIST, and DOE cybersecurity. In 2011 64th Annual Conference for Protective Relay Engineers, pp. 328-333. IEEE, 2011.
[17]
Evelyn Douek. The Rise of Content Cartels. Knight First Amendment Institute. February 11, 2020. https://knightcolumbia.org/content/the-rise-of-content-cartels
[18]
Draft Intermediaries Guidelines (Amendment) Rules 2018. Information Technology Ministry. http://prsindia.org/billtrack/draft-information-technology-intermediaries-guidelines-amendment-rules-2018
[19]
Ending Support for Internet Censorship Act. S. 1914. 116th Congress.
[20]
Energy Policy Act of 2005 (Public Law 109-58, Aug. 8, 2005, 119 Stat. 594). U.S. Congress. http://www.gpo.gov/fdsys/pkg/PLAW-109publ58
[21]
European Commission. Code of Practice on Disinformation. September 26, 2018. https://ec.europa.eu/digital-single-market/en/news/code-practice-disinformation
[22]
European Commission. Code of Practice on Disinformation one year on: online platforms submit self-assessment reports. October 28, 2019. https://ec.europa.eu/commission/presscorner/detail/en/statement_19_6166
[23]
European Court of Justice. Eva Glawischnig-Piesczek v Facebook Ireland Limited, Case C‑18/18 ECLI:EU:C:2019:821
[24]
Facebook. Removing Myanmar Military Officials From Facebook. August 28, 2018. https://about.fb.com/news/2018/08/removing-myanmar-officials/
[25]
Cristina Forlani. Digital 2019: Global Internet Use Accelerates. We Are Social. January 30, 2019. https://wearesocial.com/au/blog/2019/01/digital-2019-global-internet-use-accelerates
[26]
Freedom House. Freedom on the Net 2019. The Crisis of Social Media. November 2019. https://www.freedomonthenet.org/sites/default/files/2019-11/11042019_Report_FH_FOTN_2019_final_Public_Download.pdf
[27]
Timothy Garton Ash, Robert Gorwa, and Danaë Metaxa. GLASNOST! Nine ways Facebook can make itself a better forum for free speech and democracy. University of Oxford. December 2018. https://reutersinstitute.politics.ox.ac.uk/sites/default/files/2019-01/Garton_Ash_et_al_Facebook_report_FINAL_0.pdf
[28]
Gennie Gebhardt. Who Has Your Back? Censorship Edition 2019. Electronic Frontier Foundation. June 12, 2019. https://www.eff.org/wp/who-has-your-back-2019
[29]
Maryam Gholamrezaei, Jack Stefano, and Nancy Heath. Nonsuicidal self-injury across cultures and ethnic and racial minorities: A review. International Journal of Psychology. (2015). 52.10.1002/ijop.12230.
[30]
Global Network Initiative. The GNI Principles. May 2017. https://globalnetworkinitiative.org/gni-principles/
[31]
Emma Goldberg. “Techlash” Hits College Campuses. The New York Times. January 11, 2020. https://www.nytimes.com/2020/01/11/style/college-tech-recruiting.html
[32]
Karen Hao. Making face recognition less biased doesn't make it less scary. MIT Technology Review. January 29, 2019. https://www.technologyreview.com/s/612846/making-face-recognition-less-biased-doesnt-make-it-less-scary/
[33]
Sanjana Hattotuwa. Digital Blooms: Social Media and Violence in Sri Lanka. Toda Peace Institute. Policy Brief #28. November 2018. https://toda.org/assets/files/resources/policy-briefs/t-pb-28_sanjana-hattotuwa_digital-blooms-social-media-and-violence-in-sri-lanka.pdf
[34]
Brittan Heller. Combating Terrorist-Related Content Through AI and Information Sharing. The Transatlantic High Level Working Group on Content Moderation Online and Freedom of Expression. April 2019. https://www.ivir.nl/publicaties/download/Hash_sharing_Heller_April_2019.pdf
[35]
Anders Henriksen. The end of the road for the UN GGE process: The future regulation of cyberspace. Journal of Cybersecurity 5, no. 1 (2019) https://academic.oup.com/cybersecurity/article/5/1/tyy009/5298865
[36]
International Centre for Missing & Exploited Children (ICMEC) and The United Nations Children's Fund (UNICEF). Online Child Sexual Abuse and Exploitation: Guidelines for the Adoption of National Legislation in Latin America. 2016. https://www.icmec.org/wp-content/uploads/2016/11/ICMEC_UNICEF_EN.pdf
[37]
Nina Jacob, Rhiannon Evans, and Jonathan Scourfield. The influence of online images on self-harm: A qualitative study of young people aged 16—24. Journal of Adolescence 60 (2017): 140-147. https://www-sciencedirect-com.stanford.idm.oclc.org/science/article/pii/S0140197117301264
[38]
Kyle James. Plunging prices bring connectivity to the masses in Myanmar. DeutscheWelle. May 9, 2019. https://p.dw.com/p/3GF8e
[39]
Sajid Javid and Jeremy Wright. Online Harms White Paper. UK Government Department for Digital, Culture, Media & Sport, Home Office (2019). https://www.gov.uk/government/consultations/online-harms-white-paper/online-harms-white-paper
[40]
Quinta Jurecic, Clara Spera, Benjamin Wittes, and Cody Poplin. Sextortion: The problem and solutions. The Brookings Institution. May 11, 2016. https://www.brookings.edu/blog/techtank/2016/05/11/sextortion-the-problem-and-solutions/
[41]
Jacob Mchangama. Something‘s Rotten: How Denmark Is Criminalizing Blasphemy Through Hate Speech Law. Columbia Global Freedom of Expression. February 29, 2016. https://globalfreedomofexpression.columbia.edu/updates/2016/02/somethings-rotten-denmark-criminalizing-blasphemy-hate-speech-law/
[42]
David Kaye. Report of the Special Rapporteur on the promotion and protection of the right to freedom of opinion and expression. UN Human Rights Council. April 6, 2018. https://documents-dds-ny.un.org/doc/UNDOC/GEN/G18/096/72/PDF/G1809672.pdf
[43]
Daphne Keller. Internet Platforms: Observations on Speech, Danger, and Money. Hoover Institution Aegis Series Paper No. 1807. June 2018. https://cyberlaw.stanford.edu/files/publication/files/381732092-internet-platforms-observations-on-speech-danger-and-money.pdf
[44]
Kate Klonick. The New Governors: The People, Rules, and Processes Governing Online Speech. Harvard Law Review.131 (2017): 1598.
[45]
Kate Klonick. Inside the Team at Facebook That Dealt with the Christchurch Shooting. The New Yorker. April 25, 2019. https://www.newyorker.com/news/news-desk/inside-the-team-at-facebook-that-dealt-with-the-christchurch-shooting
[46]
Jeff Kosseff. The Twenty-Six Words That Created the Internet. Ithaca; London: Cornell University Press, 2019.
[47]
Addisu Lashitew. Ethiopia Will Explode if It Doesn't Move Beyond Ethnic-Based Politics. Foreign Policy. November 2019. https://foreignpolicy.com/2019/11/08/ethiopia-will-explode-if-abiy-ahmed-doesnt-move-beyond-ethnic-based-politics/
[48]
The LSE Commission on Truth, Trust, and Technology. Tackling the Information Crisis: A Policy Framework for Media System Resilience. November 2018. http://www.lse.ac.uk/media-and-communications/assets/documents/research/T3-Report-Tackling-the-Information-Crisis-v6.pdf
[49]
Jerry L. Mashaw and David L. Harfst. The Struggle for Auto Safety. Cambridge, MA: Harvard University Press, 1990.
[50]
Sarah McKune and Shazeda Ahmed. The Contestation and Shaping of Cyber Norms Through China's Internet Sovereignty Agenda. International Journal of Communication (19328036) 12 (2018).
[51]
Henry Mihm, Ines Oulamine, and Fiona Singer. The Philippines Deserves More From Facebook. Lawfare. October 27, 2019. https://www.lawfareblog.com/philippines-deserves-more-facebook
[52]
Baroness Morgan of Cotes and Priti Patel. Online Harms White Paper - Initial consultation response. UK Government Department for Digital, Culture, Media & Sport, Home Office. February 12, 2020. https://www.gov.uk/government/consultations/online-harms-white-paper/public-feedback/online-harms-white-paper-initial-consultation-response
[53]
Napoleon Cat. Facebook Users in Myanmar. https://napoleoncat.com/stats/facebook-users-in-myanmar/2019/12
[54]
Siddharth Narrain. Dangerous Speech in Real Time: Social Media, Policing, and Communal Violence. South Asia Journal. August 27, 2019. http://southasiajournal.net/dangerous-speech-in-real-time-social-media-policing-and-communal-violence/
[55]
David Nevius. The History of the North American Electric Reliability Corporation. NERC. 2020. https://www.nerc.com/AboutNERC/Resource%20Documents/NERCHistoryBook.pdf
[56]
Nanjala Nyabola. Platform Governance of Political Speech. Centre for International Governance Innovation. October 28, 2019. https://www.cigionline.org/articles/platform-governance-political-speech
[57]
Daniel Ortner. Government regulation of social media would kill the internet—and free speech. The Hill. August 12, 2019. https://thehill.com/opinion/technology/456900-government-regulation-of-social-media-would-kill-the-internet-and-free
[58]
Rob Pegoraro. Tech Companies Are Quietly Phasing Out a Major Privacy Safeguard. The Atlantic. September 29, 2019. https://www.theatlantic.com/technology/archive/2019/09/what-happened-transparency-reports/599035/
[59]
Eric A. Posner. The Twilight of Human Rights Law. Oxford University Press, USA, 2014. p38.
[60]
Paul Romer. Process, Responsibility, and Myron's Law. IMF Macro Conference. December 2010. https://www.imf.org/external/np/seminars/eng/2011/res/pdf/PMRpresentation.pdf
[61]
Michael L. Rustad, and Thomas H. Koenig. Towards a global data privacy standard. Florida Law Review. 71 (2019): 365.
[62]
Santa Clara Principles. 2018. The Santa Clara Principles: On Transparency and Accountability in Content Moderation. (2018). https://santaclaraprinciples.org/
[63]
Shannon Raj Singh. Digital Accountability Symposium: Weapons of Mass Media—Facebook News and a Call to Accountability. OpinioJuris. December 17, 2019. http://opiniojuris.org/2019/12/17/digital-rights-symposium-weapons-of-mass-media-facebook-news-and-a-call-to-accountability/
[64]
Shannon Raj Singh. Move fast and break societies: the weaponisation of social media and options for accountability under international criminal law. Cambridge International Law Journal 8, no. 2 (2019): 331-342.
[65]
Spandana Singh. The False Information Ecosystem in India. Toda Peace Institute. Policy Brief No. 55. October 2019. https://toda.org/assets/files/resources/policy-briefs/t-pb-55_spandana-singh_the-false-information-ecosystem-in-india.pdf
[66]
Daniel Silver and Benjamin Berringer. Extraterritoriality: The US Perspective. Global Investigations Review. January 15, 2019. https://globalinvestigationsreview.com/benchmarking/the-practitioner%E2%80%99s-guide-to-global-investigations-third-edition/1179176/extraterritoriality-the-us-perspective
[67]
Olivier Sylvain. Discriminatory Designs on User Data. Knight First Amendment Institute at Columbia University. 2018. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3157975#references-widget
[68]
Heidi Tworek and Paddy Leerssen. An Analysis of Germany's NetzDG Law. Transatlantic High Level Working Group on Content Moderation Online and Freedom of Expression. March 2019. https://www.ivir.nl/publicaties/download/TWG-working-papers-Ditchley-1.pdf
[69]
UIGHUR Act of 2019. H.R. 1025. 116th Congress.
[70]
Joris van Hoboken and Daphne Keller. Design Principles for Intermediary Liability Laws. Transatlantic High Level Working Group on Content Moderation Online and Freedom of Expression. October 2019. https://www.ivir.nl/publicaties/download/Intermediary_liability_Oct_2019.pdf
[71]
Jody Westby. EU Cybersecurity Certification Schemes Will Surprise U.S. Businesses. Forbes.October 21, 2019. https://www.forbes.com/sites/jodywestby/2019/10/21/eu-cybersecurity-certification-schemes-will-surprise-us-businesses/#27172c4f3802
[72]
Woodhull Freedom Foundation. Woodhull Files Federal Lawsuit Challenging FOSTA. 2020. https://www.woodhullfoundation.org/our-work/fosta/
[73]
Andrew Keane Woods. Litigating Data Sovereignty. Yale Law Journal 128 (2018): 328.
[74]
Liz Woolery. It's All Downsides: Hybrid FOSTA/SESTA Hinders Law Enforcement, Hurts Victims and Speakers. Center for Democracy and Technology. March 8, 2018. https://cdt.org/insights/its-all-downsides-hybrid-fosta-sesta-hinders-law-enforcement-hurts-victims-and-speakers/
[75]
Jonathan L. Zittrain. Three Eras of Digital Governance. SSRN (2019). https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3458435
[76]
Zhang v. Baidu.com, Inc., 10 F.Supp.3d 433 (S.D.N.Y. 2014).

Cited By

View all
  • (2022)Exploring engagement, well-being, and welfare on engagement platforms: Insight into the personal service sector from the DACH regionElectronic Markets10.1007/s12525-022-00589-132:4(2429-2444)Online publication date: 23-Sep-2022
  1. Regulating Digital Harm Across Borders: Exploring a Content Platform Commission

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    SMSociety'20: International Conference on Social Media and Society
    July 2020
    317 pages
    ISBN:9781450376884
    DOI:10.1145/3400806
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 July 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Digital harm
    2. certification
    3. government regulation
    4. human rights
    5. intermediary liability
    6. self-regulation
    7. social media

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    SMSociety'20

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)29
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Exploring engagement, well-being, and welfare on engagement platforms: Insight into the personal service sector from the DACH regionElectronic Markets10.1007/s12525-022-00589-132:4(2429-2444)Online publication date: 23-Sep-2022

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media