GIFCT’s Hash Sharing Database - Research Collaboration Opportunities

Organised by Erin Saltman (GIFCT) & Scott Johnson (GIFCT)

Abstract:
There remain gaps between the terrorist and violent extremist content (TVEC) that researchers surface through their work, and the technological solutions deployed by platforms to surface and moderate content. This workshop explores how researchers can transform parts of their TVEC databases into actionable signals for tech platforms. GIFCT is looking to collaborate with researchers to enhance its Hash Sharing Database (HSDB), however, feedback from the research community is needed to ensure sensitive partnerships are done with trust, transparency, and reliability.
This workshop will take attendees through an exercise to understand how the GIFCT HSDB taxonomy has expanded to incorporate list based and behavior-based approaches for inclusion parameters. The group will discuss challenges researchers face in describing TVEC that they interact with and GIFCT will guide participants to think through:

• How adversarial shifts might need cross-platform solutions to evolve (e.g. generative AI content),
• What signals beyond content might be valuable for countering terrorism and violent extremism online,
• What kinds of descriptive frameworks or specific elements of descriptions would be useful from the point of view of researchers.

The session will map researchers’ needs for future collaborations to enhance the HSDB, including what training or technical support should be provided to researchers and practitioners involved.

Combatting the adversarial shift: Emerging challenges in tackling terrorist use of the internet

Organised by Archie Macfarlane (Tech Against Terrorism)

Panellists:
Representatives from Tech Against Terrorism

Abstract:
Tech Against Terrorism is a public-private partnership that disrupts terrorist and violent extremist use of the internet. Our panel will closely align with the theme of the conference, covering both challenges and responses to terrorist and violent extremist (TVE) use of online platforms. We will set out the context by outlining the emerging threat picture in terms of exploitation of existing and new technologies by TVE actors based on our open-source monitoring. We will then present on our research mapping far-right terrorist propaganda dissemination online based on Terrorist Content Analytics Platform (TCAP) data. Finally, we will highlight the challenge of responding to incidents where attacker-produced content is circulating online, setting out our new TCAP Incident Response policy and how it reinforces existing multistakeholder crisis mechanisms.

Shaheed: Accounting for linguistic and cultural context at scale while addressing terrorist and illegal content online

Organised by representatives from Meta’s Oversight Board

Abstract:
For years, Meta has grappled with how to moderate the term “Shaheed” on its platforms, admitting that it accounts for more content removals under its “Dangerous Organizations and Individuals” (DOI) policy than any other single word or phrase on Facebook and Instagram. The company translates the Arabic word, which it acknowledges has multiple meanings, as “martyr”. As such, it always considers the use of the word “praise” when linked to Dangerous Individuals or Organizations, even though there are many ways in which the term is used, including to refer to victims of attacks. While all platforms must address the issue of terrorism, this one-size-fits-all approach has had a disproportionately negative impact on freedom of speech in many Arabic-speaking and Muslim majority countries. During its months-long review of the issue, the Board considered how to improve the trade-off between “voice” and “safety,” in line with international human rights law, and went on to make a string of recommendations on how Meta should move forward. This session will feature a deep dive into the Board’s analysis and recommendations, before asking what more can be done.

TikTok Research API Workshop

Organised by Dr. Nayanka Perdigao (TikTok)

Panellists:
Kathryn Grant (TikTok)
Shiva Hullinakatte (TikTok)
Dr. Nikki Soo (TikTok)
Dr. Zhanna Terechshenko (TikTok)

Abstract:
In this workshop, researchers will learn about TikTok’s Research API and transparency commitments. Presenters will demonstrate the tool in real time and participants will have the opportunity to ask questions and provide feedback.

How can researchers best support online safety regulation of terrorist and violent extremist content online?

Organised by Dr Murtaza Shaikh, Ofcom

Panellists:
Prof Stuart Macdonald (Swansea University)
Dr Marc-André Argentino (Public Safety Canada)
Anne Craanen (Swansea University)
Alice Rosa Fiol (Human Digital)

Abstract:
In this workshop, we will host a facilitated discussion with researchers to cover the following:

Current landscape for researchers of terrorism and violent extremism, i.e., research identifying prevalence of specific TVEC, different examples of phenomena, etc.

The kinds of insights and evidence that current and future regulators would benefit from (and can use) from the kind of audience that attends TASM, i.e., where can researchers conduct research that would ideally benefit several regulatory regimes (OSA, DSA, ESafety, etc.)?

What are the current challenges and opportunities for researchers to consider when undertaking this research (e.g., researcher API access, cost of carrying out research etc.)?

What could researchers and differing methodologies tell us about effectiveness of mitigations employed by regulated services?

How could researchers ensure that Ofcom’s or other international regulators’ understanding of which services it should be prioritising for engagement is constantly kept up to date?

What opportunities are there for researchers’ work/activities to be beneficial on a cross-industry basis?

Red Teaming: Emerging Threats in Online Extremism

Organised by Broderick McDonald (University of Oxford) & Dr Simon Copeland (RUSI)

Panellists:
Charley Gleeson (ExTrac)
Kye Allen (University of Oxford)
Petra Regeni (RUSI Europe)

Abstract:
Red and blue teaming have become popular methods to identify risks and develop technical solutions to online harms by industry, government, and international organizations. By leveraging inter-disciplinary subject matter experts, red teaming has significant potential to improve products and practices. However, to be effective and focussed, participants must be trained in how these methods evolved and the best way to contribute to the wider team. Many experts whose knowledge or backgrounds could improve red teaming efforts are often unaware of how the methodology works or how they could contribute to it. Effective red teaming requires a wide diversity of socio-economic, ethnic, religious, and gender perspectives to identify novel risks and solutions. To help address this, our workshop will guide participants through mock red teaming exercises to give them hands-on experience with the method. Using the topic of emerging threats in online extremism, this session will demonstrate how different perspectives and novel thinking can inform new policies and solutions that keep pace with changing digital challenges and environments. Our facilitators will bring in insights from their research or previous red teaming experience to guide participants through the process and answer questions as they arise.

The Swansea Model: Terrorist and Violent Extremist Researcher Safety and Security

Organised by Dr Michael Loadenthal (University of Cincinnati)

Panellists:
Dr Marc-André Argentino (Accelerationism Research Consortium)
Tom Thorley (Global Internet Forum to Counter Terrorism)
Prof Maura Conway (Dublin City University & Swansea University)

Abstract:
How can scholar-practitioners engage with online extremism without endangering themselves, their families, their respondents, or their institutions? These questions have increasing relevance as many threat actors are increasingly aware of researchers’ efforts and routinely target academics, journalists, and activists with threats, harassment, and violence. How do these values, principles, and practices relate to engagement with the public, news media, and academia? How and where does safety intersect with ethical reporting and informing the public without amplifying extremist content? Rather than claiming ownership or authority over the ‘best practices’ in the realm of operational security, this workshop seeks to facilitate an exchange between scholar-practitioners with the aim of collectively authoring a document for researchers on the best safety practices to help guide our field. Building on the group effort to author the Threat Modelling manifesto (see https://www.threatmodelingmanifesto.org/), participants will share experiences and knowledge to identify, elevate, and record these best practices and guiding principles for safe(r) and ethical engagement in violent online spaces. The hope is that this session can draw on our collective knowledge to record and recommend standards for scholar-practitioners tailored specifically to our field and that these standards can be revisited on an ongoing basis as the threat landscape and actors’ abilities change.

Through the Looking Glass: The Methodological and Ethical Implications of Using Visual Material Within Research

Organised by Dr Ashton Kingdon (University of Southampton)

Panellists:
Dr Aaron Winter (Lancaster University)
Katie Passey (Moonshot)
Dr Ashley Mattheis (Dublin City University)
Dr Cori E. Dauber (University of North Carolina – Chapel Hill)
Hirah Azhar (University of Southampton)
Dr Christopher Fuller (University of Southampton)
Meili Criezis (American University)
Dr Lewys Brace (Exeter University)

Abstract:
As the turn to interdisciplinary work becomes greater, it is important to consider that advances in research and development are more likely to happen at the intersections between multiple fields. This workshop is an interactive, interdisciplinary, multi-stakeholder roundtable discussion. It is designed to be deliberately inclusive and conversational, with audience members actively encouraged to ask questions of the panel and to share their own experiences and ideas within a ‘fishbowl’ format that generates honest reflections and healthy debate. The session will shine a light on the realities of undertaking research into extremist and sensitive imagery disseminated on social media. The panel brings together PhD students, early career researchers, academics, and industry professionals from across the world and will allow the opportunity to discuss sensitive issues honestly and openly, as well as for informal networking. During the workshop, the participants will discuss their perspectives on best practices for engaging with visual materials, for utilising mixed methods and interdisciplinary approaches, and for mitigating the real-life day-to-day challenges of what their sectors face when engaging with this material. Focus will also be placed on the ethical components that come from researching sensitive imagery, including access, anonymity, storage, researcher safety, mental health, and cybersecurity. Participants will be asked for their reflections on addressing the trauma that comes from researcher exposure to sensitive images, how researchers can report on and share content on sensitive topics in an ethical way, and the ways in which imagery is used by bad actors, especially to intimidate and traumatise marginalised communities.

An uneasy relationship: the ethics of online data integrity in violent extremism research 

Organised by Lise Waldek (Victoria University & Macquarie University)

Panellists:
Celia Davies (Moonshot)
Antonia Vaughan (Moonshot & University of Bath)

Abstract:
Our initial idea was to focus on the uncomfortable, ethically fraught, and increasingly urgent question for those conducting violent extremism research with datasets published in the absence of consent: hacked/stolen data. However, it soon became clear that as a community of practice, we are grappling with a more fundamental question around the integrity of online data, and consequently, the integrity of the outputs or outcomes it generates, whether research findings, policy briefs, clinical guidance, or court rulings. To understand the different incentives and pressures at play, we will go back to first principles, asking the question of what we, as researchers, practitioners, or law enforcement professionals variously hope to accomplish through our use of online data. The session will explore data transparency, human rights (public/private), legal thresholds, research ethics and ethics boards, data reliability, and practitioner/researcher protections. We aim to bring participants together to build an informal working group, and ultimately a short set of guidelines to share with the broader community focused on data integrity and violent extremism research.

Bringing Old and New Together: Understanding The Evolution of Violent Extremist Strategic Communication Online

Organised by Dr Moign Khawaja (Dublin City University)

Panellists:
Prof Miron Lakomy (University of Silesia)
Dr Ali Fisher (Human Cognition & Università Cattolica del Sacro Cuore)
Federico Borgonovo (Università Cattolica del Sacro Cuore)
Giulia Porrino (Università Cattolica del Sacro Cuore)
Silvano Rizieri Lucini (Università Cattolica del Sacro Cuore)

Abstract:
This panel aims to discuss the latest tactics, strategies and tools employed by violent extremist organisations in their online campaigns. It explores the methods used to spread extremist ideologies, recruit new members, and incite violence through a broad spectrum of mainstream and new online platforms. The panel focuses on several critical aspects of this phenomenon regarding emerging (PMC Wagner and Whitejihad) and existing actors (Salafi-jihadist groups), including their latest set of tactics and strategies employed in disseminating propaganda online, new trends in the broader milieu of digital extremist culture, including the fragmentation of ideology, as well as VEOs’ use of the emergent technologies. To summarise, this panel highlights the latest trends in contemporary digital extremism and discusses how to mitigate its impact more efficiently.

Understanding The Base: Analyses of online interactions, recruiting, networks, and motivations

Organised by Prof Anthony F. Lemieux (Georgia State University)

Panellists:
Dr Michael Loadenthal (University of Cincinnati)
Virginia Massignan (Georgia State University)
Elizabeth Bailey (Georgia State University)

Abstract:
The Base is a North American neo-Nazi accelerationist group focused on survivalism and founded in 2018 by Rinaldo Nazzaro. We will present findings from a collection of 127 recorded recruitment calls (780,000 words; 1,500 pages) and approximately 47,000 screenshots of online communications. Panel topics include: methodological and technical aspects of working with the dataset, and the development of topic and network models; motivations for joining The Base; mundane aspects of conversations and ‘everyday’ interactions; recruiting of individuals with military backgrounds and selection criteria.

Building Qualitative and Quantitative Assessments of Accelerationist Activity

Organised by Accelerationism Research Consortium

Panellists:
Dr Amy Cooter (Middlebury Institute of International Studies at Monterey)
Miro Dittrich (CeMAS)
Erica Barbarossa (Middlebury Institute of International Studies at Monterey)

Abstract:
This workshop will explore the qualitative and quantitative methods to assessing and measuring the contemporary militant accelerationism landscape. It will dig into the methodological challenges, best practices, and preliminary findings from three separate approaches to generating empirical systems associated with researching militant accelerationism. ARC will give a first look at its beta version of the Accelerationism Wiki, a first-of-its-kind Militant Accelerationism Wiki designed to help governments, researchers, and community frontline practitioners better understand the online and offline landscape of accelerationism.

Video-Games and Violent Extremism: Policy, Operational, and Regulatory Considerations

Organised by Dr Suraj Lakhani (University of Sussex)

Panellists:
Dr Erin Saltman (GIFCT)
Simon Monkman (Ofcom)

Abstract:
The video-gaming industry is – above music, film, and TV – the most profitable entertainment sector with revenues estimated to be around 200 billion USD per annum. Around a quarter of the world’s population play video-games, a figure concentrated among 16-24-year-olds. Nearly 50% of players are women. Video-games have numerous pro-social benefits which go beyond entertainment, including providing stress-relief, community building, and enabling people to carve out particular identities. However, and although video-games are not a causal factor of violence, the nexus between video-gaming and violent extremism is becoming an increasing concern around the world. These intersections include: the creation of bespoke games and modifications (mods) by violent extremists; the gamification of violent extremism; communication through online gaming spaces; gaming (and wider) online extremist ecosystems; the use of gaming cultural references to disseminate propaganda and other functions; and, the potential to finance terrorism through the exchange of gaming currencies and cryptocurrencies.

This workshop will discuss the relevant policy, operational, and regulatory considerations of these different intersections from the viewpoint of both academia and those working in the sector.

Assessing the Complexities of Multistakeholder Work in Responding to Extremism and Terrorism Online

Organised by Dr Ashley A. Mattheis (Dublin City University)

Panellists:
Ninian Frenguelli (Swansea University)
Hirah Azhar (University of Southampton)
Connor Rees (Swansea University)
Lea Brost (Institute for Peace Research and Security Policy)

Abstract:
This workshop will present findings from a TASM-funded collaborative research project examining the complexities of conducting multistakeholder research and intervention work related to extremism. The Seeing Eye to Eye: Developing Sustainable Multistakeholder Communities (SE2E) project centres on increasing the efficacy of multi-stakeholder engagement by focusing on shared knowledge amongst academic, practitioner, and industry partners. Our approach foregrounds: (1) the repositioning of “expertise” as a shared, perspectival resource amongst stakeholder groups; (2) engaging in partnerships through trust and equity (shared ownership models); and, (3) more effective audience awareness and dissemination methods.

We convened a 1.5-day workshop with a small group of stakeholders including practitioners, policy and research analysts, and academics to discuss their perspectives on and experiences with conducting multistakeholder work in the field of extremism and terrorism online and P/CVE. The workshop was structured using a unique, collaborative discussion model employing Participatory Action Research (PAR) methodology as its guiding frame. The aim of these discussions was to empirically assess the various mission-driven perspectives of the participants (including the research team as academic participants) to better understand our differing needs, approaches, and limitations in conducting multistakeholder projects.

A Civil (Society) Discussion: How to Better Integrate Civil Society into Multistakeholder Projects

Organised by Dr Katy Vaughan (Swansea University) & Dr Ashley A. Mattheis (Dublin City University)

Panellists:
Representatives from civil society organisations

Abstract:
Multistakeholder research in preventing and countering violent extremism (on- and offline) primarily incorporates academia, industry, policy makers, think tanks, and law enforcement. When civil society partners are included, they are often only included as listeners or audiences. Civil Society, however, is both the foremost stakeholder and beneficiary of this work. Moreover, civil society organizations do much of the work in “on-the-ground" interventions and response to the effects of extremist violence. This results in an impact and knowledge transfer gap between existing multistakeholder work in this area and civil society that reduces our capability to respond to the problem and that leaves out a crucial perspective. This workshop will involve a facilitated, interactive discussion with a cohort of seven members of civil society organizations focused on combatting extremism and terrorism on- and offline. The session is aimed at developing new connections for and with civil society partners and organizations through engagement with other TASM attendees. The goal is to discuss ways to potentially improve engagement with, and integration of, civil society actors and organizations in online (and offline) CT work.

This session is part of an ESRC-funded Impact Accelerator Award, entitled: Co-creating Impact via Integrating Civil Society: Building Inclusive Multistakeholder Networks (CIvICS).