Social Networks Are Exporting Disinformation About Covid Vaccines
(Bloomberg Businessweek) -- One of the earliest people to get Pfizer’s Covid-19 vaccine was a nurse in Tennessee, who fainted after getting the shot on live television in December. The incident sparked rumors that she had died and that the vaccine was a tool of genocide. Five months later the nurse, who is not dead, continues to be bombarded by messages from strangers on social media. They send condolences to her family or demand details about the incident. Oddly, they often do so in German, Italian, or Portuguese.
The international fixation on this case follows what is becoming a common pattern. U.S.-based social media users begin spreading misleading or false information, which then moves to other countries, according to researchers studying the rumors. The U.S. may not yet have figured out an efficient way to distribute shots to other countries, but it has become a major exporter of misinformation.
The U.S. “dominates social media culture the way it dominates pop culture,” and not always to the world’s benefit, says Cameron Hickey, project director for algorithmic transparency at the National Conference on Citizenship, a civic organization based in Washington. He’s been researching misinformation in Spanish-speaking Facebook communities and says most of what circulates is “a carbon copy of rumors that we first see in English.”
Major social media companies are constantly criticized for failing to crack down on misinformation in the U.S., but advocates complain their performance is even worse when dealing with content in languages other than English. The machine learning algorithms that companies such as Facebook Inc. and Alphabet Inc.’s YouTube use for content moderation were built in English first and aren’t as effective in other languages, Hickey says. Advocates have also criticized the tech companies for not sufficiently staffing content moderation teams outside of the U.S.
Facebook has 80 fact-checking partner organizations working in 60 languages, according to Kevin McAlister, a spokesman. “We use machine learning models in more than a dozen languages to send potentially violating content about Covid-19 and vaccines to reviewers—including native speakers—who remove violating ones,” he says. The company doesn’t share the number of content reviewers in a given country, saying it wouldn’t reflect its efforts. Elena Hernandez, a YouTube spokeswoman, says its “approach to addressing misinformation is global and applies across all languages.”
Content often continues to go viral abroad even after it’s removed or fact-checked and deprioritized in the U.S. Videos from anti-vaccination influencers that Facebook has banned, such as Del Bigtree and Sherri Tenpenny, have been translated into Arabic, Dutch, German, and other languages, and continue to circulate among Facebook groups and YouTube channels. The Plandemic video, one of the most prominent pieces of Covid-related disinformation over the past year, spread widely in Italian, Polish, and Spanish for days after Facebook took action on the English version, according to Renée DiResta, the technical research manager at Stanford Internet Observatory.
A review by the Institute for Strategic Dialogue, a London-based anti-extremism group, found that Arabic-speaking communities are influenced by content from the U.S. or Europe, “using Arabic subtitling or voiceovers often unencumbered by moderation and fact-checking efforts.” For instance, Facebook flagged as misleading U.S.-made videos of women who appeared to be shaking in response to the Covid vaccine, but the same content with Arabic subtitles continued to spread without a fact check.
U.S. groups pushing disinformation also provide a “blueprint or how-to guide” for local anti-vaccine groups to follow, according to Ciaran O’Connor, an analyst at the Institute of Strategic Dialogue, a counterextremism group.
People have used data from the U.S. Vaccine Adverse Event Reporting System to undermine public confidence. The government established Vaers in 1990 as an early warning system to detect potential side effects. Patients can report reactions independently, and doctors and vaccine makers also submit reports. Misleading content about side effects and deaths based on Vaers data is spreading on Dutch, German, and Spanish Facebook pages. Conspiracy theorists outside the U.S. have also begun to use Vaers-like programs in their countries as the raw material for their own claims, O’Connor says.
People disseminating disinformation abroad don’t necessarily feel secure in their ability to continue using mainstream social media and are learning from their U.S. peers how to prepare for their potential expulsion, says Kristina Gildejev, a researcher for the fact-checking group Logically.ai. Gildejev has been monitoring anti-vaccine communities in Germany. They were active on Facebook, she says, until recently, when they “followed their English-speaking counterparts and switched to Telegram.”
©2021 Bloomberg L.P.