Imagine seeing a hundred accounts endorse the same product or repeat the same political argument. Before treating that activity as a hundred independent judgments, ask what those accounts represent. Are they separate people? Are they openly organizing together? Are some invented identities, automated accounts or participants with undisclosed connections? Those questions describe different possibilities, not conclusions about any particular crowd.
Astroturfing is the presentation of organized activity as independent grassroots participation. Keller and colleagues’ research on political astroturfing centers precisely on participants pretending to be ordinary citizens acting independently. The central issue is the representation of independence. Whether the work is performed by software, paid people or a mixture requires additional evidence. Keller et al., Abstract.
Separate the machine from the deception
A social bot uses software to carry out social-media activity. Automation itself does not establish a deceptive purpose. Ferrara and colleagues’ foundational review discusses both harmful bots and useful automated services, including news aggregation and customer responses. An account’s automation, the identity it presents and the relationship behind its activity therefore deserve separate questions. Ferrara et al., opening sections.
Consider a clearly labeled automated notice from a transport service. Its automated delivery does not make its stated identity false. Conversely, imagine a person manually operating an invented customer persona. Human authorship does not make that identity truthful. These hypothetical examples show why calling everything suspicious a bot can obscure the actual allegation.
Use a simple description before choosing a label: this action appears automated; this identity is unverified; this relationship was undisclosed; these accounts show repeated coordination. Keep foreign involvement as another question. None of those descriptions, alone, identifies a foreign sponsor.
Real employees can create misleading endorsements
The FTC’s Sunday Riley case concerned people with an undisclosed commercial relationship. The agency alleged that, between November 2015 and August 2017, company managers posted product reviews on Sephora using fake accounts or asked employees to do so. The complaint also alleged a failure to disclose employment connections. These are the FTC’s allegations about that period. FTC complaint, paragraphs 8–15.
The final order announced in November 2020 prohibited misrepresenting reviewers as independent or ordinary users and required disclosure of unexpected material connections. The respondents neither admitted nor denied the complaint’s allegations, apart from jurisdictional facts. The case illustrates why a review investigation should examine the author’s relationship to the seller as well as the words on the page. FTC decision and order, pp.1, 3–4.
Popularity itself can be the product
In its 2019 Devumi complaint, the FTC alleged the sale of fake followers, subscribers, views and likes. That October, a federal court entered a stipulated order restricting the defendants’ sale of social-media influence indicators and deceptive representations. The settlement did not amount to an admission of the complaint’s allegations. FTC complaint, paragraph 9; court order, pp.1–3.
Here the relevant question is what a displayed number represents. A count may look like evidence of attention or support, but its meaning depends on how the interactions were produced. If you are evaluating credibility, ask for evidence beyond the total: identifiable sources, substantiated claims and independently checkable work. A large number should not do all the reasoning for you.
A public-comment record is not a head count
A 2021 New York attorney general investigation found nearly 18 million fabricated comments among more than 22 million submissions in the FCC’s 2017 net-neutrality proceeding. It identified over 8.5 million fake comments from a broadband-industry-funded campaign opposing net neutrality and more than 9.3 million additional fake comments supporting it. The latter used fictitious identities; the industry-linked effort involved identities of real people used without consent. New York report, pp.3–6 and 27.
A critical qualification appears in the same report: investigators said they had not found evidence that the broadband companies funding and organizing the lead generators had direct knowledge of the fraud, and had not found that those companies violated New York law. Keep that limitation with the funding claim. New York report, p.3.
For assessing participation, distinguish a real person consenting to a template submission from someone’s identity being used without permission. Similar wording is a starting observation; identity and consent are the consequential questions. Nor does the existence of fabricated comments establish how much they changed the final regulatory decision.
Look at relationships, then test alternatives
Keller and colleagues studied a South Korean intelligence-service campaign during the 2012 presidential election using participating accounts listed in court proceedings. They reported that coordination traces distinguished those accounts better than the individual-account characteristics commonly used in bot detection. That is a finding about a documented historical case, not a universal test for every online discussion. Keller et al., Abstract.
A wider methods study by Pacheco and colleagues examined shared images, retweets, hashtag sequences and timing to uncover likely coordination. For readers assessing such research, the important question is what combination of evidence supports the proposed relationship. Ask whether a public organizing event, a shared news source or ordinary group participation could also explain the pattern. Pacheco et al., Abstract.
Repeated activity may justify further investigation without justifying a public accusation. Ask the analyst to distinguish coordination from deception, and both from attribution. Preserve dates and original context. Avoid publishing personal information about ordinary participants merely because their accounts appear in a suspicious cluster.
A bot score needs an explanation
In a 2020 evaluation of Botometer v3, Rauchfleisch and Kaiser examined five datasets in English and German over three months. They found classification problems and scores that varied over time, producing both false positives, where people were classified as bots, and false negatives, where bots were classified as people. These results concern the tested version and setting; they are not a current benchmark of every detector. Rauchfleisch and Kaiser, Abstract and Discussion.
Before relying on a score, ask which model and version generated it, which accounts it was tested on, and how errors were checked in the relevant language and setting. Treat a score as one input to review. Do not convert a threshold into a definitive allegation that someone is fake, paid or controlled by a government.
AI-generated prose introduces another distinction. Yang and Menczer’s 2024 case study identified a network of 1,140 accounts through heuristics and manual review; the accounts appeared to use ChatGPT. The authors reported that coordination was useful for identifying the network, while the text classifiers they tested failed to distinguish its accounts from human accounts in the wild. The result is case-specific and historical. Yang and Menczer, published Abstract.
What a careful reader can do
Start with the claim you actually need to assess. For a product recommendation, examine the reviewer’s disclosed connections and supporting evidence. For a purported public movement, ask what is known about organizers and participation. For an alleged account network, request the documented links and the limits of the investigation. These checks are more precise than deciding whether the prose feels human.
Then separate activity from results. Posting, receiving a view, earning a response and changing someone’s decision are different events. Ask which one a report measured. An impressive account total can document scale without demonstrating persuasion. Leave unknowns visible, including how much activity an investigation might have missed.
Manufactured consensus becomes easier to discuss accurately when the allegation is specific: fabricated participation, concealed employment, misrepresented popularity or deceptive coordination. Use the narrowest description the evidence supports. That protects the integrity of the investigation and the people whose genuine participation should remain part of public debate.
Three sourced takeaways
- Useful automation exists; investigate deception separately. Social-bot research review.
- People can have undisclosed relationships that matter to a review’s credibility. Sunday Riley settlement order.
- Bot classifications can produce false positives and false negatives; preserve the study’s scope. 2020 detector evaluation.
Sources & their limits
Source review: 6 October 2026. These are historical materials; source access does not establish a current legal outcome or independently validate every finding.
- Political Astroturfing on Twitter: How to Coordinate a Disinformation Campaign Peer-reviewed original research, author institution abstract
Abstract, sentences 1–5; publication metadata
Review scope & limitations
Institution-hosted abstract and bibliographic record read. Full-text repository URLs failed in this retrieval. No full-text review claimed.
Only abstract-level claims used: operational definition, 2012 South Korea case, court-listed accounts, relative value of coordination traces. No court judgment details or method performance numbers asserted.
- The Rise of Social Bots Research review by the authors
PDF pp.1–2, The rise of the machines and Engineered social tampering
Review scope & limitations
Author-manuscript PDF opened; opening definitions and benign/malicious uses read.
Foundational definitions and conceptual risks only; historical examples and prevalence estimates in the review are not reused.
- In the Matter of Sunday Riley Modern Skincare, LLC: Complaint Primary administrative complaint
Paragraphs 8–15, PDF pp.2–5
Review scope & limitations
Five-page PDF opened; factual allegations and disclosure counts read.
Allegations concerning November 2015–August 2017 activity. Not a criminal conviction or trial finding.
- Sunday Riley Modern Skincare, LLC: Decision and Order Primary administrative settlement order
Opening consent recital, p.1; Provisions I–II, pp.3–4
Review scope & limitations
Eight-page PDF opened; consent recital, defined terms and Provisions I–II read.
Respondents neither admitted nor denied allegations except jurisdictional facts. No assertion of current noncompliance.
- FTC v. Devumi, LLC: Complaint for Permanent Injunction and Other Equitable Relief Primary civil complaint
Paragraphs 9–10, 18–19; PDF pp.3,5
Review scope & limitations
Six-page PDF text opened; factual allegations and cause of action read.
Allegations, not adjudicated factual findings. No claim that every purchaser knew the provenance of every interaction.
- FTC v. Devumi, LLC: Stipulated Order for Permanent Injunction and Monetary Judgment Primary court settlement order
Findings 2–3, pp.1–2; Order §§I–II, pp.2–3
Review scope & limitations
Eleven-page PDF opened; findings and relevant injunctive terms read.
Neither-admit-nor-deny settlement. Described as a dated order, not a trial finding or a claim about current compliance.
- Fake Comments: How U.S. Companies & Partisans Hack Democracy to Undermine Your Voice Primary regulator investigation report
Executive Summary, pp.3–6; Background §4, p.10; Findings §2, pp.27–28
Review scope & limitations
39-page PDF text opened; cited sections read. Announcement date independently checked on official release.
Report findings remain attributed. Source explicitly says no evidence of direct knowledge of fraud by broadband funding/organizing companies and no finding that they violated New York law. No claim that fabricated comments determined the rulemaking.
- Uncovering Coordinated Networks on Social Media: Methods and Case Studies Peer-reviewed original conference research
Abstract; DOI 10.1609/icwsm.v15i1.18075
Review scope & limitations
Publisher-hosted abstract and metadata read; no independent replication or full-method validation.
Supports behavioral-trace approach only. Detection of coordination is not automatically attribution, deception or proof of intent.
- The False positive problem of automatic bot detection in social science research Peer-reviewed original methods evaluation
Abstract; Discussion, opening five paragraphs; study identifies Botometer v3
Review scope & limitations
Full HTML accessible; Abstract, temporal-classification results and Discussion read. Data not independently reanalyzed.
Historical test of a particular version, datasets and languages. Not a benchmark of current systems or evidence that all detection is useless.
- Anatomy of an AI-powered malicious social botnet Peer-reviewed original case study
Published Abstract; related author preprint §§3–5 at https://arxiv.org/html/2307.16336v1
Review scope & limitations
Published abstract and metadata read. Journal PDF viewer did not expose full text. Full 2023 author-preprint HTML available; identification, characterizations and detection sections read. Final-publication claims limited to its abstract.
One identified network, heuristic selection and manual review; apparent ChatGPT use. Historical detector performance, no universal detector verdict or foreign-state attribution.