Why a 'Worse' Website Outranks a Better One (and Why It Isn't Luck)

Here’s a confession that anyone who’s looked closely at SEO has thought, even people who do this for a living: sometimes it feels like 60% of it is luck.

You find a website with rubbish Core Web Vitals, built on ancient technology, with messy code, almost no internal linking and thin content — and it ranks beautifully. Then you find a site that ticks every single best-practice box — fast, clean, well-structured, genuinely useful — and it languishes on page three. Look at enough of these and you start to wonder whether anyone really knows how Google decides at all.

It’s a fair thing to wonder. So let’s be honest about it — because the truth is more useful (and more reassuring) than “it’s random.”

You’re judging the visible 20% and can’t see the dominant 80%

When you look at a competitor’s website, you can see the things that are on the page: the code quality, the page speed, the structure, the internal links, the content. So those are the things you judge it on. The problem is that those are the minor factors — and the things that actually decide competitive rankings are mostly invisible from the outside.

What you can’t see by looking at a site:

• Its backlinks — how many other websites link to it, and how authoritative they are. This is still one of the most powerful ranking forces there is, and a “rubbish” old site has often been quietly accumulating links for fifteen years.
• Its brand strength and age — how established and trusted Google considers the domain.
• How real users behave with it — and this is the big one. Google watches whether people search for a brand by name, click its result, stay, and don’t bounce straight back to the search page to pick something else. That behaviour is an enormous signal, and it’s completely invisible in the code.

So the “terrible” site beating the “perfect” one usually isn’t a mystery — it has an off-page moat (links, brand, age, user trust) that you simply can’t see from the outside. We diagnose the visible half and assume it’s the whole game. It’s the smaller half.

Best practice is the entry fee, not the win

Here’s the second piece. The technical best practices everyone obsesses over — Core Web Vitals, clean markup, perfect internal linking — are real, but Google itself has described things like Core Web Vitals as a tiebreaker between pages that are otherwise similarly relevant. They help at the margin. They are nowhere near powerful enough to overcome a big gap in authority or relevance.

And relevance matters more than polish. A thin, ugly page that answers the exact thing someone searched will often beat a beautiful page that’s slightly off-intent. Google is trying to satisfy the searcher, not grade your website. Sometimes it even decides a particular search wants a forum thread, a video, or a local map result — in which case your immaculate article is simply the wrong shape for that query, no matter how well built it is.

In other words: doing everything right is the price of entry to compete. It is not, on its own, the thing that wins.

The uncomfortable part: it genuinely isn’t fully knowable

Now the bit the industry doesn’t love admitting. Since Google introduced machine learning into ranking (RankBrain, back in 2015, and far more since), Google doesn’t rank by a fixed rulebook. It uses learned systems that weigh hundreds of signals — and weigh them differently for different queries. There is no spreadsheet of “do these ten things and you’ll rank”. Even Google’s own engineers couldn’t hand you one.

That means SEO is genuinely not fully reverse-engineerable. It’s a complex, adaptive system, and a degree of uncertainty is baked in. That’s not a failure of your understanding — it’s the nature of the thing.

And it’s exactly why paid algorithms behave the same way. Google Ads’ Performance Max can perform brilliantly for weeks and then tank and never quite recover — because it’s the same family of black-box machine learning. It finds a pocket that works, the conditions shift, and it loses the thread. Anyone who’s run it has felt that lurch. It’s not that the system is broken; it’s that these systems are powerful and opaque and volatile, all at once.

So can you actually trust SEO rankings?

This is the real question, and here’s the honest answer: you can’t trust any single ranking to be permanent or fully explicable — but you can trust the trend and the process.

Think of it like a share portfolio. Watching one stock on one day tells you nothing; it’s noise. The aggregate, over time, tells you whether your strategy is sound. SEO is the same. Any individual keyword on any individual day is noisy — it’ll bounce around for reasons you can’t always see. But the direction over months, across all your important searches, is real and trustworthy. That’s what we manage, and that’s what we report on: the trend, not the daily lottery of one term.

And here’s the part that turns all of this from frustrating into clarifying:

Because the system can’t be reliably gamed, being genuinely the best, most-trusted answer is the only strategy that holds up.

If ranking were a simple checklist, everyone would tick the boxes and it’d come down to who games it hardest. The fact that it’s unknowable is precisely the argument for the fundamentals — authority, genuine helpfulness, brand, reputation, real user satisfaction — because those are the things the system is ultimately trying to reward, and the things no competitor can fake their way past. The unpredictability isn’t a reason to distrust SEO. It’s the reason the shortcuts don’t work and the real thing does.

What this means for you

• Don’t despair at the “worse” site that’s beating you. It almost certainly has an advantage you can’t see — usually links, brand and age. The answer is to build your own version of those over time, not to add one more best-practice tweak.
• Don’t judge SEO by one keyword on one day. Judge it by the trend over a quarter, across the searches that matter.
• Be suspicious of anyone who claims certainty. “Do these things and you’ll rank #1” is a promise no honest person can make. What we can promise is to consistently do the things that, over time, move the odds heavily in your favour.
• Invest in what’s robust to an unknowable system: genuinely helpful content, real authority and links, a strong brand, great reviews, and a technically sound site. Not because they’re a magic formula — because they’re the things that keep working no matter how the algorithm shifts.

So is it 60% luck? No. But it is a complex, partly-hidden, partly-unknowable system where the biggest factors are the ones you can’t see by looking at a website. Once you accept that, it stops feeling like luck and starts feeling like what it is: a long game, played on the fundamentals, where consistency beats cleverness.

If you’ve been staring at a competitor wondering how on earth they outrank you, let us take a look — we’ll show you the invisible factors that are actually in play, and what it would take to close the gap.