What is Shill Detection?
Shill detection flags promotion that hides a financial incentive, or fakes grassroots support through coordinated activity. We check for it in three places: store reviews, social accounts, and YouTube video descriptions.
- Store reviews
- Social signals
- Paid promotion
- Editorial impact
Overview
A shill is an undisclosed promoter, paid or coordinated to make a game or token look more popular than it is.
We run three independent checks against every game we cover: an automated pass over store reviews, a behavior score on official social accounts, and a scan of YouTube video descriptions for financial ties. Each produces its own output, and none depends on the other two.
Store review authenticity
For games listed on a store like Steam, we run every available user review through an automated pass that flags inauthentic positive reviews. The output is a shill rate (the share of reviews flagged) and a one-line summary of the pattern we found.
The check looks for five patterns common to coordinated or paid reviews:
- Generic praise: enthusiasm that could describe any game, with no specific detail.
- Copy-paste phrasing: near-identical wording repeated across multiple reviews.
- Short five-star reviews: the highest rating with no supporting detail.
- Hype without substance: promotional language that never mentions gameplay mechanics.
- Mass-rating patterns: reviews posted in a tight, suspicious burst.
Affiliate & sponsored content
We scan the YouTube video descriptions we pull for a game, checking for signs the creator had a financial relationship with the product covered. Four signal categories flag a likely paid or sponsored placement:
- Affiliate shorteners: link services such as amzn.to, geni.us, and bit.ly, used to mask commission links.
- Affiliate networks: domains belonging to Commission Junction, ShareASale, Awin, Impact, Rakuten, and similar commission platforms.
- Platform parameters: store-specific tracking parameters for Amazon, Steam, Epic Games, Humble Bundle, GOG, and G2A.
- Referral parameters: generic tracking parameters, such as ref, aff, affiliate, and referral, that can appear on any domain.
How this shapes our coverage
We use each of the three checks differently:
- Store review shill rates go to our writers as context, so quotes pulled from player reviews come from the authentic share of the pool.
- Affiliate flags discount a video's weight in our community-sentiment calculation.
- Social shill tags (bot_spam, promotional_only) factor into a game's legitimacy score alongside website quality and on-chain data.
Caveats
We treat these signals as evidence, not verdicts. Each one adds a data point to a broader legitimacy read, and none of them decides a game's standing alone.
- Coverage is conditional: review analysis runs only for games listed on a store like Steam, social scoring only for accounts we can find, and affiliate scanning only for videos we already pull for a game. We don't extend a clean result on one channel to a channel we never checked.
- The review check is conservative: it flags a review only when several signals line up together. A low shill rate means we found no strong pattern in the reviews we checked.
- promotional_only is a narrow tag: it applies only to accounts with no content beyond promotion, such as retweets, giveaways, and buy prompts. Marketing next to real development updates doesn't trigger it.
- An affiliate flag discloses an incentive: the creator had a financial interest in the product. We don't treat the flag as a verdict on the video's accuracy.