Real Tech Progress vs Hype: A Checklist Before You Invest

Here is the thing almost nobody says out loud: hype and readiness are two completely separate dials. One measures how loud the conversation is. The other measures whether the thing works where it has to earn money.
Most bad technology bets come from reading the loud dial and assuming it was the other one.
You have probably felt this. A robot does a backflip on your feed, a chatbot writes a decent email, and somewhere between the headline and your banking app a little voice says "this changes everything, get in now". That voice is reading sentiment. It is not reading capability.
This article gives you a repeatable way to read both dials, then a seven-question test you can run in an afternoon on any technology that keeps turning up in your news feed.
Hype and readiness are two different dials
The two best-known tools for thinking about new technology measure completely different things, and that is the whole trick.
The Gartner Hype Cycle tracks perception - the hype, expectations and sentiment around a technology's perceived value over time (Gartner hype cycle, Wikipedia). It is a map of the conversation.
NASA's Technology Readiness Levels measure something else entirely: demonstrated capability, from a scribble on a whiteboard up to a system proven in a real operational environment (NASA, Technology Readiness Levels). It is a map of the machine.
Read only the first and you buy noise. Read only the second and you may be technically right and financially early by a decade. You want both, side by side.
The one-paragraph version: seven questions to ask before you invest
If you read nothing else, read this. Before you put money, time or a business process behind a hyped technology, ask: what exactly does it do in one adjective-free sentence; where is it on the readiness ladder; who pays for it repeatedly at full price today; what does it cost per unit of useful output; what has to be true for it to work at scale and is that physics or engineering; who says it works and do they profit if you believe them; and if the loud story is wrong, what do you lose? The full version is further down with worked examples.
A quick note on what this article is and is not
This is general information only. It is not personal financial advice.
Nothing here considers your objectives, your financial situation or your needs, because I do not know them. No specific security, fund, product or model version is being recommended anywhere in this piece. Consider your own circumstances and get advice from a licensed adviser before you invest.
What this article is: a thinking tool. A way to slow down between the headline and the buy button.
Dial one: the Gartner Hype Cycle measures the talk, not the technology
The Hype Cycle is a graphical model of how expectations around a technology rise and fall over time. Crucially, it plots perceived value, not proven value (source).
That makes it brilliant for one job: working out how loud the room is right now. It is useless as a prediction of dates, and it has been criticised as a model - it is not a law of nature and it does not come with a timetable. Treat it as a volume meter, not a crystal ball.
What is the Gartner Hype Cycle, and what are its five phases?
Five phases, in order, in plain English (source):
- Innovation Trigger - something new gets demonstrated and a handful of people start paying attention.
- Peak of Inflated Expectations - the stories run ahead of the evidence, and everyone is suddenly an expert on it.
- Trough of Disillusionment - the early attempts disappoint, the coverage turns sour, and plenty of players quit.
- Slope of Enlightenment - the people still working on it figure out what it is genuinely good for.
- Plateau of Productivity - it becomes boring, useful and widely paid for.
Notice that the money stories cluster around phase two. The actual businesses cluster around phase five.
Why the trough of disillusionment is often the honest part of the story
The trough gets a bad name. It is usually the first point where anybody publishes what the technology cannot do.
During the peak, failure is embarrassing and nobody writes it up. In the trough, failures are everywhere and people start naming them - integration problems, costs that did not shrink, edge cases that never got solved. That is information you could not buy at the peak.
Which is why, as a reader, the trough is often the most useful time to study something. Not necessarily the time to buy it. Just the time it starts telling the truth.
What the Hype Cycle cannot tell you
It cannot tell you whether the technology works. It cannot tell you when anything will happen. It cannot tell you whether a company has a business or just a story.
A technology can sit at the Peak of Inflated Expectations while the underlying kit is barely out of the lab. It can also sit in the trough while the engineering quietly gets finished. Volume and capability move independently, and that is exactly why you need the second dial.
Dial two: NASA's Technology Readiness Levels measure the thing itself
NASA needed a way to answer a blunt question: is this ready to fly, or is it still a science project? The answer was a nine-rung ladder (NASA, Technology Readiness Levels).
It is the most useful borrowed tool a non-engineer can carry, because it forces one specific question: proven where?
How Technology Readiness Levels (TRL 1-9) work
Roughly, and in everyday terms (source):
- TRL 1 - basic principles observed. Research is just beginning. Papers, not products.
- TRL 2-3 - a concept and some early proof that the idea holds up in a lab.
- TRL 4-5 - components tested together, in a lab and then in a more realistic setting.
- TRL 6 - a fully functional prototype, demonstrated in a relevant environment.
- TRL 7-8 - a real system demonstrated and then qualified in the actual operating environment.
- TRL 9 - the system is proven in an operational or mission environment. It works, for real, where it has to.
Nine rungs. Not three. The gap between a thing that works and a thing that works reliably, in the mess of the real world is where fortunes go missing.
The TRL 6 trap: a working prototype is not a product
Here is the trap. Nearly all the footage that goes viral, and a huge share of what appears in investor decks, is showing something around prototype stage. That is roughly the middle of the ladder, not the end.
A prototype does the job once, on a good day, with its creators standing nearby. A product does the job ten thousand times, in the rain, operated by someone who did not read the manual, at a price a customer will pay.
So carry this question everywhere: has this been proven in the environment where it has to earn money, or only in a controlled one?
A warehouse floor at 2am with a casual crew is an operational environment. A demo stage is not.
Translating TRL into questions a non-engineer can ask
You do not need the formal definitions. You need the translations:
- Has anyone outside the company run this, unsupervised, for months?
- Does it work when the inputs are messy, incomplete or weird?
- What happens when it fails - who notices, and what does it cost?
- Is the hard part solved, or is the hard part "scaling", which is doing all the solving later?
Reading the two dials together: four combinations and what each one means
Put hype on one axis and readiness on the other and you get four situations. Each one calls for a different response.
- High hype, low readiness - story-stock territory. The narrative is finished; the technology is not. This is where timing risk eats people alive, because you can be completely right about the destination and still lose money for years.
- High hype, high readiness - crowded. It works, everybody knows it works, and that knowledge is probably already in the price. Not a trap, just not a secret.
- Low hype, high readiness - the quiet one worth studying. Something that genuinely works in the real world while the news cycle has moved on. Rare, boring, and the most interesting box on the grid.
- Low hype, low readiness - research. Follow it if you enjoy it. It is not an investment yet, and pretending otherwise is how a hobby gets expensive.
Signals that look like evidence but are not
Most of what gets reported as proof is marketing with a press release attached. Here is how to spot it.
Does large venture funding mean a technology is mature?
No. Funding size measures investor conviction and competitive positioning. That is all.
Money raised is an input, not a result. It tells you some smart, interested and financially motivated people formed a view - often under pressure to deploy capital before a rival does. Nothing in the Hype Cycle and nothing in the TRL ladder treats capital as evidence of readiness, because it is not.
A huge round can mean "this is nearly ready and needs scaling" or "this is nowhere near ready and needs years of runway". The headline number cannot tell those apart.
Can you trust published AI benchmark results?
Carefully, and less than you would like. An interdisciplinary review of AI evaluation practice documents systemic problems in benchmarking - misaligned incentives, construct-validity issues, and gaming of results (arXiv, 2502.06559).
Construct validity is the posh term for a simple worry: does the test measure the thing you care about? A leaderboard number tells you how a system performed on one test set. It does not tell you how it will perform on your work.
The fix is unglamorous. Run your own real tasks through it - your invoices, your emails, your awkward edge cases. Twenty minutes of that beats any chart.
Why 'enterprise partnerships' and pilot announcements prove very little
A "partnership" with no disclosed contract value is a logo on a slide. A memorandum of understanding is a polite intention. A pilot is a budget line somebody approved to find out whether it works - the whole point is that nobody knows yet.
Ask the follow-up: what is it worth, who pays, and is it still running next financial year?
Demos, waitlists and roadmaps
A demo is a performance with retakes available. A waitlist measures curiosity, which is free. A roadmap date is a plan made by people whose job depends on sounding confident.
None of these are lies. They are just not evidence of readiness, and they get reported as though they were.
Signals that are worth something
Paid, repeated, boring usage
Customers paying again, at full price, without a discount or a free credit, after the novelty wore off. Usage that survives the end of the pilot budget.
That is the strongest signal available to an outsider, and it is almost never the headline.
Adoption data instead of adoption anecdotes: what the US Census BTOS numbers show
Anecdotes inflate. Surveys of actual firms are sobering.
Drawing on the US Census Bureau's Business Trends and Outlook Survey, firm-level AI use rose from 4.6% in early 2024 to about 10% by September 2025 under the original question wording - and the measured national rate came in at 17.3% after the question was reworded in November 2025 to cover AI use in any business function (Agglomerations, "How many businesses are using AI?").
Sit with that jump for a second. The number went from about 10% to 17.3% because the question changed, not because the world changed overnight.
That is a transferable skill worth more than the statistic itself: when a number leaps, check whether the question was reworded, the population changed, or the definition widened. Do it before you believe the trend.
Unit economics you can describe in one sentence
If a company cannot state what one unit of useful output costs them, in a sentence a neighbour would understand, the economics are not settled. Cost per useful output is the number that decides whether a working technology becomes a business.
Independent replication and named sources
Someone with no stake in the outcome reproduced the result. The company publishes what its technology fails at. Every headline claim traces back to a named, checkable document.
And prefer documents an organisation is legally accountable for over blog posts and keynote slides. The accountability changes the writing.
Why most enterprise AI pilots fail, and what that tells an investor
The MIT report "The GenAI Divide: State of AI in Business 2025" found that 95% of enterprise generative-AI pilots delivered no measurable profit-and-loss impact. The work drew on 52 executive interviews, surveys of 153 leaders and analysis of 300 public AI deployments (Healthcare IT News).
Now the part that usually gets chopped off when that 95% goes viral.
The same work attributes the failures largely to organisational causes - poor integration and misaligned priorities - rather than to flawed models. More than 80% of organisations had piloted tools such as ChatGPT or Copilot, mostly gaining individual productivity rather than enterprise-level outcomes (Legal.io summary).
Those are two very different investment conclusions. "The technology does not work" and "deployment is hard" point in opposite directions. The evidence here leans towards the second.
Also notice the gap between an 80%-plus pilot figure and a measured firm-use figure in the teens. Those are different surveys asking different questions of different populations - one counts organisations that have tried something, the other counts firms using it in their operations. Conflating them is how "everyone is using AI" gets manufactured.
The seven-question hype test, step by step
- What exactly does it do, in one sentence with no adjectives? If you cannot write that sentence, you do not understand it yet.
- Where is it on the readiness ladder? Lab, prototype, or proven in the real operating environment?
- Who pays for it today, repeatedly, at full price? Name them. Pilots and free tiers do not count.
- What does it cost per unit of useful output? And is that cost falling for a reason you can explain?
- What has to be true for this to work at scale - and is that a physics problem or an engineering problem? Engineering problems get solved on a schedule. Physics problems may not get solved at all.
- Who says it works, and do they profit if you believe them? Follow the incentive before you follow the claim.
- If the loud story is wrong, what do I lose? Answer in dollars and years, not in feelings.
Simple rule: if a technology fails questions 3 and 4, it belongs on a watchlist, not in a portfolio. No exceptions for how exciting the demo was.
Worked example: how to run the test on a technology you keep hearing about
Take warehouse robotics as a category - not any particular company.
Question one, no adjectives: machines that move goods around a storage facility with less human handling. Fine. That is checkable.
Question two, readiness: this splits hard. Fixed-path systems in purpose-built facilities are genuinely operational - high on the ladder. General-purpose humanoids wandering a mixed, cluttered, legacy warehouse are around prototype stage. Same headline, two very different rungs.
Question three, who pays repeatedly: large logistics operators do pay, at scale, for the mature systems. For the newer general-purpose kit, most deployments you will read about are pilots with supplier support on site. That is a flag, not a verdict.
Question four, cost per unit: for established systems you can reason about cost per pick or per pallet move. For the newer category, the honest answer is usually "nobody will tell you". Second flag.
Question five, physics or engineering: battery energy density and manipulation of soft, odd-shaped objects are closer to hard constraints. Scheduling software is engineering. Knowing which one you are betting on changes your patience.
Question six, sources: footage from the manufacturer is marketing. An independent operator reporting a year of uptime is evidence.
Question seven, downside: if general-purpose robots take ten years instead of three, what happens to your money in the meantime?
The honest conclusion for the newer end of that category is "promising but early". Not "buy". Notice the checklist did not tell you the technology was rubbish - it told you where it sits, which is the actual job.
Three questions that end most hype conversations fast
When someone is mid-pitch and you want to get to the bottom of it quickly:
- Who is paying full price for this right now?
- What does it cost you to produce one unit of the useful thing?
- What does it still fail at?
People who have built something real answer all three without flinching. The third one is the tell - builders enjoy talking about failure modes, because they have spent years staring at them.
How to do basic technical due diligence without an engineering degree
You do not need to read the maths. You need to read the right documents, in the right order.
Start with the primary source behind the headline, not the article about it. Most news stories are a summary of a summary, and the detail that matters got cut for space.
Then hunt for the failure modes the company discloses about itself. Every serious technical organisation publishes limitations somewhere. Absence of any stated limitation is itself a finding.
Find one independent party with no financial stake who has used the thing. Then check whether the claim describes a demo or a deployment - that single distinction resolves more arguments than anything else on this list.
And weight your sources by accountability. A regulatory filing, an audited statement or a published methodology carries more weight than a blog post, because the consequences of being wrong are different.
Common mistakes curious readers make (and how to avoid them)
- Mistaking a fast-improving demo for a fast-improving business. Capability curves and revenue curves are not the same line.
- Confusing being right about the technology with being right about the timing. Plenty of people called the internet correctly in 1999 and still got wiped out.
- Treating a confident expert as evidence. Confidence is a personality trait. Ask for the data.
- Assuming the first mover captures the value. Often the value lands with whoever shows up third with better distribution and lower costs.
- Buying at the Peak of Inflated Expectations because the story feels obvious. When a thesis feels obvious to you, it has probably been obvious to the market for a while.
FAQ: real progress versus hype
What are the five phases of the Gartner Hype Cycle?
Innovation Trigger, Peak of Inflated Expectations, Trough of Disillusionment, Slope of Enlightenment, and Plateau of Productivity. The model plots expectations and perceived value over time rather than demonstrated capability (source). It is a model of sentiment, and it has been criticised as a model - use it to gauge the volume of the conversation, not to predict dates.
How do Technology Readiness Levels (TRL 1-9) measure readiness?
TRL is a nine-level ladder running from TRL 1, where basic principles have been observed and research is just beginning, to TRL 9, where an actual system is proven in an operational or mission environment. TRL 6 is a fully functional prototype demonstrated in a relevant environment (NASA). The useful question it gives you is simply: proven where?
Does large venture funding signal technical maturity?
No. Funding size reflects investor conviction and competitive positioning, and money raised is an input rather than a result. Neither the Hype Cycle nor the TRL framework treats capital as evidence of readiness.
Why do enterprise AI pilots fail to deliver ROI?
The MIT report "The GenAI Divide: State of AI in Business 2025" found 95% of enterprise generative-AI pilots produced no measurable profit-and-loss impact, based on 52 executive interviews, surveys of 153 leaders and analysis of 300 public AI deployments (Healthcare IT News). The failures are attributed mainly to organisational causes such as poor integration and misaligned priorities rather than flawed models (Legal.io). So the finding is closer to "deployment is hard" than "the technology does not work".
Can AI benchmarks be trusted?
Only as narrow evidence. An interdisciplinary review of AI evaluation documents systemic flaws in benchmarking practice, including misaligned incentives, construct-validity problems and gaming of results (arXiv). A leaderboard number describes performance on one test set, not on your actual work - so test on your own tasks.
How many businesses use AI, versus talk about it?
Drawing on US Census Bureau BTOS data, firm AI use rose from 4.6% in early 2024 to about 10% in September 2025 under the original question wording, and the measured rate was 17.3% after the question was reworded in November 2025 to cover any business function (Agglomerations). Compare that with the more than 80% of organisations reported to have piloted tools such as ChatGPT or Copilot (Legal.io). Different surveys, different questions, different populations - which is exactly why the two numbers look so far apart.
Keep a watchlist, not a wishlist
A wishlist is a list of things you hope will happen. A watchlist is a list of things you are tracking against conditions you wrote down in advance.
The difference is the conditions. Write the trigger down: "I will take this seriously when a customer with no equity stake pays full price for two years running." Then let the news come to you instead of chasing it.
That habit alone will keep you out of more trouble than any forecast.
Save the seven-question test somewhere you will find it, and run it the next time a technology headline makes you reach for your wallet. It takes an afternoon. It has saved people a great deal more than that.
And if you would like the stories to arrive with the homework already done, join the free daily newsletter using the sign-up form on this page. Every story links to its source, and a person approves every post before it goes out. For more plain-English explainers, have a look through the blog.
One last time, plainly: this is general information only, not personal financial advice. It does not take account of your objectives, situation or needs. Consider your own circumstances and seek licensed advice before you invest.