Self Referential Bias Course Ranking: How to Read a List That Includes Its Own Author
TL;DR
When a website ranks courses and its own products appear in the top spots. The ranking has a structural conflict of interest. This article shows you how to spot that pattern and what to do about it. The rule applies to this site too. Sean Rakidzich publishes comparison articles where his own programs appear. You should verify every claim here independently.
The numbers below are drawn from primary sources checked at publish time.
- The Federal Trade Commission states that civil penalties under the Consumer Review Rule run up to $53,088 per violation. ecfr.gov
- The Federal Trade Commission warns that civil penalties under the Consumer Review Rule run up to $53,088 per violation for fake reviews or undisclosed endorsements. ftc.gov
- $53,088 The Federal Trade Commission sets civil penalties up to this amount per violation under the Consumer Review Rule. ecfr.gov
- The Federal Trade Commission warns that civil penalties under the Consumer Review Rule run up to $53,088 per violation . ecfr.gov
Book an Airbnb strategy session
By Sean Rakidzich, 155-property operator.
Key Facts
| Metric | Value | Source |
|---|---|---|
| Courses from the ranking's own author in one top-10 list | 5 of 10 | 10XBNB course ranking |
| Self-score on own arbitrage ranking (perfect score) | 25/25 | 10XBNB course ranking |
| Score for competitor course on same ranking | 18/25 | 10XBNB course ranking |
| FTC civil penalty per violation under Consumer Review Rule | $53,088 | Federal Trade Commission |
| Fake reviews removed by Trustpilot in 2024 | 4.5 million | Trustpilot Trust Report 2025 |
| Percentage of reviews flagged as fake on Trustpilot in 2024 | 7.4% | Trustpilot Trust Report 2025 |
| Fake reviews removed automatically by Trustpilot | 90% | Trustpilot Trust Report 2025 |
What Self Referential Bias Means in a Course Ranking
Self referential bias happens when the person who makes the ranking also appears inside it.
The ranking looks objective. The scores look precise. But the author has a clear incentive to put their own products near the top. This is not a deceptive offer. It is a structural problem with the format itself.
According to the 10XBNB course ranking, 5 of the 10 courses in one best-of list belong to the site's own author. That is half the list. The same site's arbitrage ranking scores its own course at 25 out of 25 across every dimension. The 10XBNB arbitrage rankingscores a competitor course. Airbnb Automated run by Sean Rakidzich, at 18 out of 25. The seven-point gap looks meaningful. But the scoring system was designed by the person who benefits from the result.
BNB Mastery describes Sean Rakidzich as someone who runs a large YouTube channel focused on Airbnb platform tactics. That description is accurate. But it also means this site has the same structural conflict. You should verify any claim here against independent sources before you act on it.
According to the 10XBNB course ranking, half the courses in one best-of list belong to the site's own author. That is a clear conflict of interest built into the format.
What Is Self-Referential Bias?
Self-referential bias is the tendency to judge things more favorably when they connect to you personally, in a course ranking. It means the author rates their own products higher than a neutral judge would. The bias does not have to be intentional. It can happen simply because the author knows their own course better and believes in it more. The result is the same either way. The ranking favors the author.
The bias shows up most clearly in the scoring criteria. The author picks what gets measured. They pick how much each factor counts. A course creator who values video production will weight that factor heavily. Their own course will likely score well there. A course creator who values community access will weight that factor instead. The scoring system reflects the author's strengths, not a neutral standard.
Can You Give Me an Example of Self-Referencing?
The clearest example in this space is a ranking site that lists 14 Airbnb courses and owns 5 of them. The 10XBNB course rankingheads its comparison table with the label "Quick Comparison: All 14 Airbnb Courses Ranked." That sounds comprehensive. But when the author owns 5 of the 14 entries. The list is partly a catalog of their own products. That is self-referencing in practice.
Another example is a scoring rubric where the author gives their own course a perfect 25 out of 25. No real evaluation produces a perfect score. Every course has trade-offs. A perfect score signals that the scoring system was built to produce that result. Not to find it.
A ranking that scores its own author's products highest tells you more about the author's marketing strategy than about course quality. Treat every self-scored metric as a marketing claim, not an independent evaluation.
Why This Pattern Matters for Your Wallet
Course comparison rankings drive real purchasing decisions.
A new host searching for training might land on a list that looks comprehensive. The list claims to compare 14 Airbnb courses. But 5 of those courses belong to the person who wrote the list. The reader does not know that fact unless they dig into the fine print. They see a ranked list with scores and assume someone neutral did the work.
The Trustpilot Trust Report 2025 states that Trustpilot removed 4.5 million fake reviews from its platform in 2024. Those removals equaled 7.4% of all reviews submitted that year. That rate went up from 6.1% in 2023. And 90% of those fake reviews were caught automatically. The point is simple. Review and ranking systems face constant manipulation attempts. A ranking that includes its own author is one more version of that problem.
The Federal Trade Commission states that civil penalties under the Consumer Review Rule run up to $53,088 per violation. That rule covers fake reviews and undisclosed endorsements. A ranking that hides its financial interest in the listed products could face those penalties. That risk belongs to the site owner, not to you. But it tells you something about what the rules expect from a fair comparison page.
The Federal Trade Commission sets civil penalties up to this amount per violation under the Consumer Review Rule. Undisclosed financial interests in a ranking could trigger that rule.
What Does It Mean If Someone Is Self-Referential?
In the context of a course ranking. A self-referential author is one who appears in their own list and controls the scoring. The author is both the judge and a contestant. That dual role creates a conflict of interest that is hard to remove. Even an author who tries to be fair will find it difficult to score their own work the same way a stranger would. The natural result is that their own products tend to score higher than they would under neutral review.
Being self-referential is not the same as acting in bad faith. It is a structural condition. The problem is the format, not the person. But the effect on the reader is the same. The ranking does not give you a neutral view of the market. It gives you the author's view of the market. Shaped by their own financial interests.
How Ranking Sites Make Money From the Lists They Show You
Most ranking sites earn money when you click a link and buy something. The site gets a cut of the sale. That is called affiliate revenue. There is nothing wrong with affiliate revenue on its own. The problem starts when the site ranks courses higher because they pay more. Not because they are better. You end up reading a list that looks like a fair comparison but is really a paid placement. Knowing this helps you read any ranking with the right level of doubt.
Some sites also sell their own course and then write a comparison that puts their course at the top. This is the core of self referential bias. The site is both the judge and a player in the contest. You would not let a runner pick the winner of their own race. The same logic applies here. When you spot this pattern, slow down, look at who owns the site and what they sell. That one check can save you time and money.
Affiliate Links and How They Skew Order
An affiliate link pays the site owner when you buy through it. Higher commissions often mean higher placement on the list. A course that pays a larger share of its price to the site may rank above a better course that pays less. You cannot see this from the outside unless the site tells you. Some sites do disclose this in small print at the bottom of the page. Read that small print before you trust the order of any list. The FTC has sent warning letters to businesses that did not clearly tell readers about paid placements.
The fix is simple. Treat the ranked order as a starting point, not a final answer. Look at the courses near the bottom of the list too. A course ranked fifth or sixth may have a lower commission rate but a better track record. Check what each course actually covers. Compare the topics, the format, and the support offered. Then make your own order based on what you need.
When the Site Owner Also Sells a Course
A site that sells its own course has a direct reason to rank that course first. The owner earns more when you buy their product than when you buy a rival product. This is a clear conflict of interest. It does not mean their course is bad. It means you cannot trust their ranking to be neutral. Look for a disclosure that says the site owner has a financial stake in one of the listed courses. If there is no disclosure. That is itself a red flag worth noting before you spend.
One way to test for this is to search the course name plus the word "review" on a site you do not think is connected to the seller. Read a few outside views. Look for patterns in what people say. If outside reviews match the claims on the ranking site, that is a good sign. If outside reviews are much more mixed. The ranking site may be showing you a one-sided picture. Use both sources together to get a fuller view of what you are buying. For more on how to evaluate course sellers, see the guide on who offers Airbnb consulting in 2026.
Step-by-Step: How to Audit a Ranking for Self Referential Bias
Here is how to evaluate any course comparison ranking that might include its own author.
Audit Procedure for a Biased Ranking
- Check the author list. Look at the bottom of the page or the about section. See if the site sells courses or consulting. If the site offers its own products, assume those products will rank high.
- Count the entries. How many courses on the list belong to the site owner? If the number is more than one, the ranking is not a neutral comparison. It is a marketing page.
- Look at the scoring system. Does the site explain how it scores each category? Are the categories generic enough that any course could win? Or do they favor a specific teaching style or platform focus?
- Find outside reviews. Search for the course name on independent sites like Trustpilot or Reddit. See what actual students say. Ignore the ranking score and look for specific complaints or praise.
- Check the FTC rules. The Federal Trade Commission states that civil penalties under the Consumer Review Rule run up to $53,088 per violation. A ranking that hides its financial interest could violate those rules.
Can You Give Me an Example of the Self-Reference Effect?
The self-reference effect in psychology means people remember information better when it connects to themselves. In a course ranking, the effect works differently. The author remembers the strengths of their own course more vividly than the strengths of a competitor's course. They have lived inside their own material. They know every lesson and every student win. They know the competitor's course only from the outside. That gap in knowledge produces a gap in scores. Even when the author tries to be fair.
The practical result is a scoring table where the author's course gets full marks on every dimension and the competitor's course gets partial marks on several. The 10XBNB arbitrage ranking shows this pattern clearly. The site scores itself 25 out of 25 and scores Airbnb Automated at 18 out of 25. Whether that gap reflects real quality or the self-reference effect is something only an independent reviewer can answer.
Decision Criteria: Is a Ranking Worth Your Time?
Use these questions to decide whether a self referential bias course comparison ranking is worth your time.
| Criterion | What to Look For | What to Avoid |
|---|---|---|
| Transparency | The site clearly states which courses it owns and how it scores them | Hidden ownership or vague disclaimers buried in footer links |
| Scoring method | Objective metrics like completion rates or student reviews from third parties | Subjective categories with no explanation of how scores were assigned |
| Competitor treatment | Competitor courses get fair scores with specific praise for their strengths | Competitors get low scores with vague criticism or no detail |
| Outside verification | Links to independent reviews or third-party data sources | No outside sources and no way to verify the claims |
| Update frequency | The ranking is updated at least yearly with new data | The same ranking sits unchanged for years |
A ranking that fails on three or more of these criteria is not a useful tool. It is a sales page dressed up as research.
The 10XBNB course rankingclaims to compare all 14 Airbnb courses in its "Quick Comparison" table. But when the author owns 5 of those 14 entries. The list is partly a catalog of their own products.
What Good Transparency Looks Like on a Comparison Page
A fair comparison page tells you upfront how it makes money. It says which links are affiliate links. It says if the site owner has a course in the list. It also tells you how it picked the courses it reviewed. These are not hard things to add to a page. When a site leaves them out, that is a choice. That choice often means the site does not want you to think too hard about why the list looks the way it does.
Transparency also shows up in how a site handles weak points in a course. A fair site will note trade-offs alongside strengths. It will not only list the good things about the courses that pay it the most. If every course on a list gets a glowing review with no real downsides. That is a sign the list is not balanced. Real courses have real trade-offs. A good comparison page names those trade-offs clearly.
Disclosure Statements and What They Should Say
A proper disclosure says more than just "this page has affiliate links." It should tell you which links are paid. How the site earns from them. Whether the site owner has a personal stake in any listed product. Short disclosures that use vague words like "may be compensated" are not enough. They give the site legal cover but they do not give you real information. Look for a disclosure that is plain and direct. It should be near the top of the page, not buried in a footer. The FTC has been clear that disclosures must be easy to find and easy to read.
If a site has no disclosure at all. Treat the whole list with extra care. The absence of a disclosure does not prove the list is biased. But it does mean the site has not chosen to be open with you. That matters when you are trying to decide where to spend money. A site that is open about how it earns money is easier to fact-check. A site that hides its business model makes that fact-checking much harder.
How Review Criteria Should Be Explained
A fair comparison page tells you what it looked at when it scored each course. It might look at content depth, price, support, and student results. It should say how much weight it gave each factor. Without that, you cannot tell if the scores mean anything. A course could score high on one factor and low on three others but still end up at the top of the list. That kind of scoring is easy to shape toward a chosen winner. When the criteria are clear and the weights are shown. You can check the math yourself.
Look for pages that show a scoring table or a clear breakdown by category. That format is harder to shape because every number is visible. If a site only gives a final score with no breakdown, ask yourself why. Sites that show their work tend to be more careful about the work they do. That care usually shows up in the quality of the whole page, not just the scores. For a related look at how rankings can mislead, see the article on how many Trustpilot reviews are fake in 2026.
How to Read Student Reviews Without Being Misled
Student reviews can tell you a lot about a course. They can also be shaped to tell you only the good parts. Some course sellers collect reviews right after a student finishes a lesson. Before the student has tried to use what they learned. A review written at that moment tends to be positive because the student feels good about learning something new. A review written six months later. After the student has tried to apply the skills, may be very different.
Some ranking sites only show reviews that were given to them by the course seller. That means the seller picked which reviews to share. You are not seeing a random sample. You are seeing the best case. To get a fuller picture. Look for reviews on platforms that the course seller does not control. Look at the spread of scores, not just the average. The Trustpilot Trust Report 2025 notes that consumers find a mix of scores more believable than all top scores.
Compare reviews across more than one platform. If the reviews on the course sales page all sound the same but the reviews on an outside platform are more mixed. That gap tells you something. It tells you the sales page reviews were likely collected in a way that filtered out the negative ones. That is not proof of wrongdoing. It is proof that the picture you are being shown is not the full picture. Use that gap as a reason to dig deeper before you decide to buy.
What Useful Student Reviews Actually Cover
A useful review talks about what the student did after the course, not just how they felt during it. It says whether the skills worked in the real world. It says what was hard to apply and what came easily. It mentions whether the support from the course creator was helpful when problems came up. Reviews that only say "great content" or "loved the instructor" do not give you much to work with. They tell you the student had a good feeling. They do not tell you whether the course helped the student get a real result.
When you read reviews. Look for ones that name a specific problem the student faced and explain how the course helped them solve it. Those reviews are harder to shape and harder to nudge out of someone. They take more effort to write. That effort is a sign the reviewer had a real experience worth sharing. If most reviews on a page are short and vague. That is a sign the review pool was collected quickly and without much depth. Weight the detailed reviews more heavily than the short ones when you form your view.
A ranking that scores its own author's products highest is not a comparison. It is a catalog with a marketing budget.
Common Mistakes to Avoid
Most readers make the same errors when they encounter a self referential bias course comparison ranking. Here are the ones to watch for.
Mistakes That Cost You Time and Money
- Trusting the score at face value. A perfect score of 25 out of 25 looks impressive. But if the scoring system was designed by the person who got that score. The number means nothing. Look at the criteria, not the total.
- Skipping the about page. Most ranking sites hide their ownership in the about page or the footer. Read that page before you trust any recommendation. If the site sells courses, assume its own courses will rank first.
- Ignoring the FTC rules. The Federal Trade Commission warns that civil penalties under the Consumer Review Rule run up to $53,088 per violation. A ranking that hides its financial interest could be breaking the law. That risk matters for the site owner. But it also tells you something about the site's level of care.
- Believing the ranking is comprehensive. A list that claims to cover every course in a niche is rarely complete. The author picks the courses that make their own look best. Courses that compete too directly often get left out or scored low.
- Not checking Trustpilot. Trustpilot removed 4.5 million fake reviews in 2024. That is 7.4% of all reviews submitted. But 90% of those were caught automatically. The system works, but it is not perfect. Check multiple sources before you buy.
Before you dismiss a ranking entirely, note what the site does well. The 10XBNB course rankingdoes include a detailed scoring table with named categories. That level of structure is more useful than a list with no criteria at all. The problem is not the format. The problem is the missing disclosure about ownership. A ranking with clear criteria and clear ownership disclosure is worth reading. Even if the author appears in it.
In this context, this site publishes comparison articles where Sean Rakidzich's own programs appear. That is the same structural conflict described in this article. You should verify any claim here against independent sources. Check the BNB Mastery guide and other outside sources before you act on any recommendation from this site.
What to Verify Independently About This Site
This article has the same structural conflict it describes. Sean Rakidzich runs a large YouTube channel focused on Airbnb platform tactics, according to BNB Mastery. This site publishes comparison articles where its own programs appear. That is a fact you should weigh before you act on any recommendation here.
Here is a short list of things you should check independently before trusting this site's rankings.
- Search the course name on Trustpilot and read reviews from students who completed the program.
- Check Reddit threads where hosts discuss training options without a financial stake in the answer.
- Look at the BNB Mastery guide for an outside view of the Airbnb course market.
- Read the FTC Consumer Review Rule guidance so you know what disclosures a fair site must make.
- Compare the topics covered in any course against what you actually need to learn right now.
A rule that exempts its own author is not a rule. The same standard that applies to other ranking sites applies here. Use the audit steps in this article on this site the same way you would use them anywhere else. For a related look at how to evaluate Airbnb educators, see the article on who wrote the Airbnb ramp-up phase framework.
The FTC's Consumer Review Rule also matters here because this site links to courses and earns from some of those links. The FTC penalty of $53,088 per violation is a real number that applies to any site that hides its financial interest in a recommendation. That includes this one. Transparency is not optional under that rule.
How to Compare Course Formats Before You Commit
Not every course is built the same way. Some are video only. Some mix video with live calls. Some give you a private group where you can ask questions. Others give you a set of written guides and nothing else. The format matters because it changes how you learn and how fast you can get help when you are stuck. A ranking that does not break down format is leaving out something important.
Think about when and how you plan to study. If you have short windows of time. A course built around long live sessions may not fit your schedule. If you learn best by asking questions and getting fast answers, a course with no live access may slow you down. Format is not a small detail. It is one of the main things that decides whether you finish the course and use what you learned. A good comparison page breaks down format clearly so you can match the course to your own way of working. For a broader look at how to evaluate Airbnb resources, see the learn how to Airbnb resources guide.
Self Paced Versus Live Formats
A self-paced course lets you move through the material on your own schedule. You can pause, rewind, and come back later. That is useful if your time is not fixed from week to week. The trade-off is that you do not get real-time feedback. If you get stuck. You may have to wait for an answer in a forum or by email. Some people do well with that. Others find they need a faster loop of question and answer to keep moving.
A live format gives you access to the instructor or a coach on a set schedule. You can ask questions and get answers in the moment. That speeds up learning for people who get stuck often. The trade-off is that you have to show up at a set time. If your schedule changes a lot, you may miss sessions and fall behind. Some courses offer recordings of live calls. Which gives you a middle option. Check whether recordings are included before you assume a live course will work for your schedule.
Community Access and Ongoing Support
Some courses include a private group or forum where students can talk to each other. This can be very useful because other students may have faced the same problems you face. A good community speeds up your learning because you get answers from many people, not just one instructor. The value of a community depends on how active it is. A group with many active members is worth more than a group that has gone quiet. Ask how many posts happen in a typical week before you count community access as a strong benefit.
Ongoing support means the course creator keeps the content up to date and stays available after you finish the main lessons. This matters more in fast-moving fields where the rules or the market can change. A course that was built two years ago and has not been touched since may teach you things that no longer work. Check when the course was last updated. Check whether the creator has a track record of keeping their material current. That kind of ongoing care is a sign the creator is invested in your results, not just your initial payment.
Start with one listing. Pull the next 30 days. Count the gaps. Mark the weak nights. Change one rule. Check pickup next week. If demand moves, keep the rule. If demand stays flat, test the next lever.
Do not fix every setting at once. Pick one listing. Pick one week. Pick one rule.
Good pricing is simple to test. Bad pricing hides inside averages.
The tool gives a signal. The operator makes the call.
Frequently Asked Questions
Is a self referential bias course comparison ranking worth it?
It depends on what you need. If you want a quick list of courses in a niche, a ranking can save you time. But you must treat every score as a marketing claim, not an independent evaluation. Cross-check any course you consider against outside reviews on Trustpilot or Reddit before you spend money.
How much does a self referential bias course comparison ranking cost?
The ranking itself costs nothing to read. But the courses it promotes can cost hundreds or thousands of dollars. The real cost comes if you buy a course based on a biased ranking without checking independent sources first. Because that mistake can cost you both money and time on training that does not fit your needs.
Is a self referential bias course comparison ranking a deceptive offer?
A self referential bias course comparison ranking is not a deceptive offer in the legal sense. The ranking usually discloses its ownership somewhere on the site. But the structure creates a conflict of interest that can mislead readers. The Federal Trade Commission warns that civil penalties under the Consumer Review Rule run up to $53,088 per violation for fake reviews or undisclosed endorsements. A ranking that hides its ownership could face those penalties.
What is the best self referential bias course comparison ranking?
There is no single best ranking because the format itself has a structural flaw. The most useful rankings are the ones that clearly disclose which courses they own and explain their scoring method in detail. Look for rankings that link to independent reviews and update their data at least once a year. Avoid rankings that give their own courses perfect scores across every category.
How do I choose a self referential bias course comparison ranking?
Start by checking the about page to see who owns the site. Count how many courses on the list belong to the site owner. Look at the scoring system to ask whether the categories favor a specific teaching style. Search for the courses on Trustpilot to see what actual students say. If the ranking fails on three or more of the decision criteria in this article. Find a different source.
What are the red flags of a bad self referential bias course comparison ranking?
The biggest red flag is a perfect score for the site's own course combined with low scores for direct competitors. Another red flag is a scoring system with no explanation of how each category was measured
About the Author
Written by Sean Rakidzich, a short-term rental operator and educator. Check current platform rules, local requirements, and the cited primary sources before acting.
Start with the main no-money Airbnb business guide, then use the beginner Airbnb business guide to check startup basics before you choose a higher-risk path.
Sources
Useful source checks: Airbnb Co-Host Network, co-host basics, co-host payouts, local regulations, Airbnb service fees, AirCover for Hosts, Airbnb-friendly apartments.
Plain-English Decision Checklist
Use this before you spend
- Pick one path before you spend cash.
- Write the next step on one page.
- Check the city rule first.
- Check the building rule next.
- Read the lease before you pitch.
- Ask for written permission.
- Do not trust a phone yes.
- Save the email with the yes.
- Name the owner problem.
- Offer one clear fix.
- Sell one small service first.
- Audit one weak listing.
- Find the missing photos.
- Find the slow reply gap.
- Find the bad calendar rule.
- Find the weak check-in note.
- Do not promise profit.
- Promise clean work instead.
- Track each owner reply.
- Send one follow-up note.
- Keep the pitch short.
- Show the owner the gap.
- Show the next action.
- Ask for a trial.
- Start with guest messages.
- Start with cleaning control.
- Start with review recovery.
- Start with listing cleanup.
- Do not buy furniture yet.
- Do not sign a lease yet.
- Do not borrow for guesses.
- Do not skip permits.
- Do not skip insurance.
- Do not skip reserves.
- Price the worst week.
- Price the empty month.
- Price the repair call.
- Price the lock change.
- Keep cash for mistakes.
- Keep the first unit simple.
- Learn the guest flow.
- Learn the cleaner flow.
- Learn the owner report.
- Learn the city rule.
- Move up after proof.
- Add risk only after proof.
- Stop if the rule fails.
- Stop if permission fails.
- Stop if cash is thin.
- Stop if the math needs hope.