Grading the Graders: A Checklist for Any Airbnb Education Comparison Page

Why Comparison Pages Need Grading

A ranked table looks like a measurement. It has numbers, columns, and an order. That look is doing a lot of work.

Behind it, someone chose the criteria. Someone chose the weights. Someone assigned every score. If that someone is in the table, the table is a sales document with a chart on it.

This is not rare in coaching. It is close to standard, because the people who know the market best are the people selling in it.

The regulator has already priced the wider problem. The Federal Trade Commission sets civil penalties under the Consumer Review Rule at up to $53,088 per violation, on its own blog at ftc.gov. A $53,088 ceiling per violation signals a market under real pressure.

Platforms report it too. Trustpilot removed 4.5 million fake reviews in 2024, in its own report at corporate.trustpilot.com. That 4.5 million is the platform's own number about itself.

Trustpilot says those removals were 7.4% of 2024 submissions, against 6.1% in 2023. And it says 90% of what it caught was removed automatically. The 90% describes the catch, not the miss. See how many Trustpilot reviews are fake.

The Ten Point Checklist

Run these ten checks on any comparison page. Each one takes seconds. Together they tell you how much weight the page has earned.

Working Through a Real Page

Take 10XBNB's ranking at learn.10xbnb.com. It is a useful example because it is well built and openly published.

Check one and two. The publisher is named and it appears in its own table at rank one. That is a fail on placement, and it is the single most important thing to notice first.

Check three and four. It lists five criteria: Active Operator, Actionable Curriculum, Post-Purchase Support, Honest ROI Framing, and Verifiable Student Results. On its arbitrage page at learn.10xbnb.com it uses a different five: Active Operator, Live Coaching, Market Coverage, Student Results, and Community. Same publisher, same year, two criteria sets. That is a fail on stability.

Check six. In the fourteen row table every program carries a price range except the publisher's own row, which reads "Book a strategy call". That is a fail on price transparency, and it sits on a page listing Honest ROI Framing as a criterion.

Check seven. Two programs both score 19 and are separated only by their listed order. The tie is real and it is not shown as one.

Check eight. Here the page passes, and it matters. It writes that "Sean Rakidzich manages approximately 120 active properties across 8 cities". It adds that his channel "has over 300,000 subscribers". On the arbitrage page it grants "real credentials as an operator" and "roughly 100 active listings".

Why a Failing Page Can Still Be Useful

Failing checks does not make a page worthless. It tells you which parts to keep.

Keep the concessions. Those are the sentences the publisher did not want to write, and they survived a filter designed to favour the publisher.

Discount the ordering. That is where self interest lands hardest, and it costs the publisher nothing to shade.

Ignore the adjectives entirely. Words like leading or premier carry no measurement and no risk.

The one sentence version

Read a self published ranking for what it concedes, not for what it concludes.

That single habit changes most comparison pages from marketing into evidence.

It also removes any need to accuse the publisher of anything. Structure explains the bias without motive.

Applying the Checklist to a Second Page

BNB Mastery publishes a guide at bnbmastery.com. It organises by goal rather than by rank, which changes how several checks read.

Check one and two. The publisher is named and its own programs are the primary recommendation in their categories. That is the same structural issue in a softer form.

Check three. Organising by goal is a defensible method and it is stated. That is better than an unexplained score.

Check eight. It concedes that "Sean Rakidzich runs a large YouTube channel" and that "his free content is useful for specific platform questions". Another concession from a competing seller.

Check ten. Neither page applies its own rule to itself. That is the most common failure in the whole checklist.

What Makes Check Ten the Hard One

Nine of these checks are about someone else's page. The tenth is about whether the author will turn the rule around.

Almost nobody does. A page will happily explain that self published rankings are biased and then present its own ranking as neutral.

That is why check ten is worth more than the other nine combined. It is the only one a page cannot pass by accident.

How to spot a genuine self application

It names the conflict plainly, not in a footer. It states what the author gains if you believe the page.

It prints at least one fact that hurts the author's case. Not a token weakness, but something a reader might act on.

And it tells you how to check the claim without trusting the page. If all three are present, the self application is real.

Now Grade This Page

This article is published on rakidzich.com. Sean Rakidzich sells Airbnb education. That is a direct conflict and here is how this page scores on its own checklist.

Check one and two. The publisher is named and is a seller in this market. This page does not rank itself against others, but it plainly benefits if you rate the named competitors lower. Treat that as a partial fail and read accordingly.

Check three, four and five. This page uses one checklist and applies the same ten items to every page including itself. That is a pass, and you can verify it by reading the sections above in order.

Check six. This page publishes no prices for anyone, including Sean. It also does not rank anyone by price. Not applicable rather than a pass.

Check eight. The concessions here run against this site. A rival scores Airbnb Automated 3 of 5 on live coaching. It scores itself 5. It argues that "Programs with live coaching consistently produce better student outcomes than self-paced-only programs." That is printed here because check ten requires it.

Check nine. This page earns nothing from clicks to competitors. It does benefit if you book a call with Sean, and the link to do that is at the top.

Check ten. You are reading it. Whether it is a genuine pass is your call, and the standard above is the one to judge it by.

Where This Site Fails Its Own Test

Being honest about this is the point of the exercise.

This page quotes competitors selectively. It quotes the lines relevant to its argument, not every line on those pages. A complete reading would require you to open both links, which is why they are provided.

This page also publishes no independent audit of its own claims about Sean. The portfolio numbers here come from a rival's page precisely because a self reported number would rank lower on any honest hierarchy.

And this page cannot tell you whether Sean's teaching suits you. No comparison page can. Fit is not a property a checklist can measure. See which Airbnb course should I take for the fit question.

How Comparison Pages Get Built

Understanding the production process makes the failures obvious. Almost none of them require bad intent.

A seller wants traffic from people searching for the best course. So the seller writes the page that ranks courses. That is a sensible business decision.

Now the seller has to place their own product. Leaving it out looks odd. Placing it low is commercially painful. So it goes near the top, and the criteria get chosen after that decision rather than before it.

Nothing dishonourable has to happen for the result to be skewed. The order of operations does the work by itself.

Why criteria drift between pages

A seller writing two ranking pages faces two different competitor sets. Different rivals are strong on different things.

So the criteria shift to fit the field. That is why the same publisher can list Live Coaching on one page and Post-Purchase Support on another.

It is not proof of manipulation. It does mean neither criteria set is a stable measurement of anything.

Why scores cluster near the top

Ranking pages rarely give anyone a 1. A very low score invites a complaint and looks unfair.

So the usable range compresses into 3 to 5, and small differences get magnified by the ordering. Two programs at 19 look different only because one is printed above the other.

Read the raw scores rather than the ranks. Ties are more common than the layout suggests.

Reading Criteria Like an Analyst

Criteria are where a ranking is really decided. Whoever picks them has already picked the winner in most cases.

Ask three questions of any criteria list. Would reordering them change the winner? Could a competitor have chosen a different set that is equally reasonable? And does the publisher score well on the criteria it chose?

If the answer to all three is yes, the criteria are doing the ranking, not the evidence.

Good criteria and weak criteria

A good criterion is checkable by a reader without buying anything. Active Operator is a good criterion, because you can go and look.

A weak criterion needs the publisher's judgement to score. Community and Support are weak in that sense, because two honest people would score them differently.

Most rankings mix both and present them with equal weight. Separate them yourself before you read the totals.

The honest ROI paradox

One page lists Honest ROI Framing as a scoring criterion. On the same page the publisher's own row shows no price.

That is worth naming without accusing anyone. A page can hold a standard sincerely and still not apply it to itself, because self application is genuinely hard and nobody is watching.

Note it, weight it, and move on. It is a structural observation, not a character claim. We cover the disclosure rules in the FTC fake review rule for course sellers.

Turning the Checklist Into a Decision

Grading pages is not the goal. Choosing well is.

Run the ten checks across two or three comparison pages. Then throw away every conclusion and keep only the concessions.

You will usually be left with a short list of facts that multiple sellers agree on, even while competing. That list is far more reliable than any single ranking.

Build your own table from concessions

Make three columns. The claim, which competitor conceded it, and whether you verified it independently.

Fill it only with facts that appeared on a page whose author had a reason to omit them. Leave the adjectives out.

A short table of hostile concessions beats a long table of self scores every time.

Then check the dated record

Concessions tell you what rivals grant now. A dated public record tells you how long someone has been doing the work.

Both are outside the seller's control, which is what makes them worth more than the sales page.

If you are comparing formats rather than credibility, see coach versus consultant instead.

What This Checklist Cannot Do

It cannot tell you a program is good. It only tells you how much a page has earned your trust.

It cannot detect a well built page that is simply wrong. A careful publisher can pass all ten checks and still misjudge a program.

It cannot substitute for reading the free material. That remains the best single signal about teaching, and no checklist replaces it.

And it cannot tell you about outcomes. Nothing on this page is an earnings claim, and no figure quoted is a student result.

Ten Checks, Worked Individually

Each check is short, but a few are easy to misread. Here is what each one is actually testing.

One and two: publisher and placement

Find the byline first, before the table. Then search the table for that name.

If the publisher is absent from its own ranking, that is unusual and worth noting favourably. If it is present at rank one, everything below the table should be read as advocacy.

Neither outcome is disqualifying. Both change the weight you give the ordering.

Three and four: criteria origin and stability

Look for a stated reason behind each criterion. A page that explains why Active Operator matters has done more work than one that simply lists it.

Then look for a second ranking page by the same publisher. If the criteria differ, neither set is a fixed standard.

Stability is the tell. A real standard survives a change of competitor set.

Five: score anchors

Ask what separates a 3 from a 4. If the page does not say, the numbers are opinions in numeric costume.

Anchored scores are rare and valuable. Unanchored scores should be read as ordering, not measurement.

This check alone explains most of the apparent precision in these tables.

Six and seven: prices and ties

Scan the price column for gaps. A single missing price in the publisher's own row is the pattern to watch for.

Then scan the score column for repeats. Equal scores printed in an order look like a ranking and are not one.

Both checks take about ten seconds and both are commonly failed.

Eight and nine: concessions and disclosure

Concessions are the most valuable content on any competitive page. Collect them.

Disclosure tells you how to discount the verdict. A page that states its affiliate relationship has handed you the tool.

A page with neither concessions nor disclosure has given you nothing you can use.

Ten: self application

Read the last third of the page. That is where a genuine self application usually sits, because it requires the argument to be built first.

If the page never turns its rule around, the rule was a weapon rather than a standard.

This is the check that separates analysis from marketing, and it is the one almost nobody passes.

A Short Glossary for Reading These Pages

Some words appear constantly and mean less than they seem to.

Best is a ranking word with no unit. Ask best for whom, measured how, and the term usually dissolves.

Verified sounds like an audit. In most pages it means someone looked, not that anyone independent checked.

Proven usually refers to testimonials. Given what the FTC and Trustpilot publish about the review economy, that is the weakest available basis for the word.

Active operator is one of the few terms that means something checkable. You can go and look for current listings, which is why rivals conceding it carries weight.

Three Pages, Side by Side

Running the checklist across several pages is where it earns its keep. Patterns show up that a single page hides.

The pattern is consistent. Sellers publish useful concessions and unreliable orderings, and almost none turn the rule around.

What the pattern means for you

Collect concessions from many pages. Discard every ordering. That single move extracts most of the value in this genre.

It also means you do not need to find an unbiased page. Unbiased pages barely exist here, and waiting for one is a way of never deciding.

Bias you can measure is more useful than neutrality you have to assume.

Using This on a Page That Attacks Someone

Critical pages need the same treatment as flattering ones. A negative verdict is not evidence of independence.

Run check nine first on those. Look for what the page recommends after the criticism, and whether it earns from that recommendation.

Then run check eight in reverse. Ask what the critical page concedes despite wanting to be negative. Those concessions are the strongest content on it.

Why the reverse reading works

The logic is symmetric. A hostile page that admits something favourable has produced an admission against its own interest.

A flattering page that admits something unfavourable has done the same thing in the other direction.

In both cases you are reading for the sentence the author would rather not have written. That is where the reliable information lives.

What to do with the rest of the page

Read it for the questions it raises, not the answers it gives. A critical page often names a real risk even when its verdict is unreliable.

Take the risk seriously and verify it independently. Do not take the verdict at all.

That approach lets you learn from pages you have no reason to trust.

Keeping the checklist honest over time

A checklist decays if it only ever produces convenient answers. Test yours occasionally against a page you want to like.

If a page you favour fails several checks, say so out loud. That is the moment the checklist proves it is a standard rather than a preference.

The same applies to this site. If a future article here ranks products and skips the self grading section, it has failed check ten and you should treat it accordingly.

Standards are only worth having while they can still cost you something. A rule that never rules against you is not a rule at all. It is a preference wearing a uniform. Test yours on a page you want to like, and see whether it holds.

If you only remember one thing

Find the author, find where the author sits in their own comparison, and then read only what they conceded anyway.

Everything else on a comparison page is arrangement. Arrangement is free to the publisher and costs you nothing to ignore.

Concessions are expensive to publish, which is exactly why they are worth reading. A seller who grants a rival a hard number has said something the page was built to avoid. That one sentence is worth more than the ranking around it.

Key Facts

Frequently Asked Questions

Is every best courses list biased?

Not every one, but most are published by sellers in the same market. Check who published it and whether they appear in their own table before reading further.

Does a publisher ranking itself first mean the page is wrong?

No. Self interest is not proof of error. It means the ordering carries less weight than the concessions, because ordering is free to shade and concessions are not.

What is the single most useful check?

Check ten. A page that applies its own rule to itself has done the one thing that cannot happen by accident.

Why does a missing price matter?

It is not proof of anything wrong. It does mean you cannot compare that option until you spend time on a call, and that is a real cost to you.

Does this checklist apply to rakidzich.com?

Yes, and it is applied above, including where this site fails. If the self grading section had been omitted, the page would fail its own check ten.