Polymarket Is Not an All-Powerful "Truth Machine"

marsbitPublished on 2026-04-15Last updated on 2026-04-15

Abstract

Polymarket, a crypto-based betting platform, is often hailed as a "truth machine" for its ability to aggregate crowd wisdom through financial stakes. While it has demonstrated remarkable accuracy in predicting major events like the 2024 U.S. presidential election—outperforming traditional polls—its overall reliability is highly inconsistent. Analysis using the Brier score reveals that its predictive power excels in high-liquidity domains like politics and economics but falls to near-random or worse in categories like sports, culture, and tech. The platform’s growing influence is concerning as its odds are increasingly cited by major media outlets like The Wall Street Journal and CNN, lending them an air of authority. This visibility creates a feedback loop where the odds themselves can influence the outcomes they are meant to predict—a phenomenon known as endogeneity. Moreover, the market is vulnerable to manipulation by well-resourced "whales" with access to exclusive information, such as private polls or even military intelligence, as seen in cases involving bets on geopolitical events. While useful for short-term, high-stakes events, Polymarket’s predictions are often unreliable for the vast majority of its contracts due to low liquidity and wide bid-ask spreads. The danger lies not in its occasional failures, but in the unchecked trust it receives—risking a future where a handful of traders can shape perceived reality through a platform masquerading as an oracle of tr...

Written by: Vaidik Mandloi, thetokendispatch

Compiled by: Plain Talk Blockchain

In January 2026, an anonymous trader placed a series of bets on the cryptocurrency trading platform Polymarket, wagering that Venezuelan President Nicolás Maduro would be captured. The total bet amounted to approximately $34,000. A few days later, U.S. special forces executed the capture operation, and the trader cashed out over $400,000. The Secretary of State later confirmed that the operation was too sensitive to require congressional notification. Think about it: the U.S. Congress, responsible for authorizing military actions, was completely unaware. The American public was also kept in the dark. Yet, someone sitting behind a screen on a cryptocurrency betting platform had enough information to bet real money on it. And their prediction came true.

This has become a common narrative in the prediction market industry today. As Polymarket CEO Shayne Copeland puts it, it's called a "truth machine." The argument is that because traders have skin in the game, their collective betting reflects the future trajectory of the world more accurately than any poll, expert, or commentator (who faces no consequences for being wrong). Arguably, Polymarket's odds are the closest thing you can find to the truth.

This narrative seems to be working. Prediction markets are no longer a niche corner of the internet where a few gamblers place bets for thrills. A recent analysis of a dataset of 364 TikTok videos mentioning prediction markets found that 68% of the videos were not about trading. People aren't gambling; they are citing the odds on these platforms in political debates, much like they used to cite polls. Polymarket appeared in about 70% of these videos. A 22-year-old TikTok user posts political videos, using the odds from a cryptocurrency betting platform to predict real-world outcomes, and a significant number of people agree.

This is incredible. Two years ago, you simply couldn't have believed this would happen. But a question no one is seriously considering is: Are these probabilities really worthy of such trust?

So I ask: How accurate are these markets really? What happens when the odds begin to influence the very events they are supposed to predict? And what does the future look like when the whole world treats betting odds as truth?

How to Grade a Prediction Market?

Before analyzing the data, we first need to understand how to measure the effectiveness of a prediction market. Because most people have never considered this, and ignoring it means all the hype around Polymarket and Kalshi is just marketing fluff.

There's a scoring method called the Brier score. Meteorologist Glenn Brier proposed this method in 1950 to evaluate the quality of weather forecasts, as forecasters were (and still are) among the first professionals who had to take probabilistic predictions seriously and make a living from them. It's very simple. Suppose you predict a 90% chance of rain tomorrow, and it does rain. That's a good prediction, and your Brier score is low. Now suppose you predict a 90% chance of rain tomorrow, but it turns out to be a clear sky. That's a bad prediction, and your Brier score is high. A Brier score of 0 means your prediction was perfectly accurate. A score of 0.25 means your prediction was as good as a coin toss. Any score above 0.25 means you might as well have guessed randomly.

Why is this important? Because when Polymarket tells you their market predicts a 60% chance of Trump winning, and he eventually wins, it sounds amazing in a headline, but statistically, one correct prediction says almost nothing. You need to evaluate the complete history of the market across thousands of questions. This is where the Brier score comes in. It's the only honest way to assess whether these markets are truly good at predicting election outcomes.

A website called Brier.fyi does exactly that. They analyzed over 84,000 questions on platforms like Polymarket, Kalshi, Manifold, and Metaculus. Polymarket's overall Brier score is 0.047. This is indeed a very good score. Simply put, imagine a predictor saying, "I am 90% sure this will happen," and succeeding with that accuracy every time.

Source: Brier.fyi

But here's where it gets interesting, and the "truth machine" narrative begins to unravel.

The score of 0.044 is the average for all listed markets on Polymarket. And in this case, the average is crucial. If you break down the score based on what people are actually betting on, the ratings fluctuate wildly.

Science & Economics? Polymarket gets an A. The markets are based on CPI data, Fed rate decisions, and GDP figures. These markets perform well because traders tend to be financially literate, the data is verifiable, and there are institutional investors with real knowledge putting real money in.

Politics? B+. Decent, largely propped up by the massive presidential election markets, where billions of dollars flow. Culture & Tech? Worse. Much worse.

Then there's Sports. The overall score for sports prediction markets across all platforms is a mere 0.325, a D-. Remember, a coin toss is 0.25. Sports prediction markets, overall, perform worse than just flipping a coin for every question. Let that sink in.

The category that attracts the most casual bettors, and the one Kalshi has been expanding into aggressively (at one point, about 90% of Kalshi's volume was in sports betting), is the category where the markets have been proven unreliable.

Now, looking at individual markets is where the story gets even more fascinating.

Polymarket had a market on whether Bitcoin would reach $100,000 by January 2025. Bitcoin did eventually hit $100,000. The market predicted the correct outcome, but it misjudged the probability for most of the time, lingering with low confidence for months before skyrocketing to near certainty at the very end. Its Brier score was 0.4909, an F. Remember, after 0.25 (coin toss), you might as well guess randomly. This market's Brier score is almost double that.

The market on Kamala Harris winning the 2024 Democratic presidential nomination was even crazier. She did eventually win the nomination, and the market predicted the correct outcome, ironically. But the Brier score was 0.9098. This number is so bad it can't be overstated. The market was confidently wrong for so long that even being right at the end couldn't save it. If you had relied on this market for decision-making, you would have been misled throughout the entire campaign cycle until the very moment the result was final.

Now for the other side of the story, because it's not a simple one. The 2024 US Presidential election was a genuine win for prediction markets. While all mainstream polls suggested a tight race, Polymarket predicted Trump's chances at around 60%. Research from Vanderbilt University, using a Bayesian time-series model, compared Polymarket's prediction prices with national poll results from seven swing states. The results showed Polymarket was more accurate across the board.

So, what does this tell us? Prediction markets are excellent at forecasting elections. Especially in the largest, most liquid elections, where billions of dollars, tens of thousands of traders, and widespread public attention converge on a single question, they often outperform polls.

But the catch is that election predictions might only account for about 2% of the trading volume on these platforms. The 2024 Presidential election market on Polymarket alone generated over $3.6 billion in volume, with 63,000 unique monthly traders. If you look at congressional elections, state-level referendums, or any cultural, tech, or sports topics, the bid-ask spreads on contracts skyrocket to 20% to 100% of the mid-price. Markets for legislation and crises have spreads approaching 100%. Such wide spreads mean the market knows almost nothing. It's just two people making wildly different guesses on the same question, with barely any money behind either side.

When Fate Starts Writing the Story

If the accuracy problem were confined within the prediction market ecosystem, it might be manageable. Traders betting on bad markets lose money, learn their lesson, and the system improves over time. This is how all financial markets have operated for a century. But the problem is that the odds are no longer just a signal for traders; they have become public information for everyone.

Over the past 18 months, major US news outlets have integrated prediction market data into their political coverage. The Wall Street Journal signed a formal agreement with Polymarket to include its betting data in its news reports. CNN began displaying Kalshi's odds on-screen during its election night coverage. CNBC did the same. In December 2024, even Substack announced a direct partnership with Polymarket, allowing newsletter writers to embed live market data directly into their articles.

This is why the odds eventually appear on TikTok. The numbers travel from Polymarket to The Wall Street Journal, to cable news, then to Twitter, and finally to TikTok. By the time the average user sees these odds, they have been circulated through enough authoritative channels that they feel like facts. What people are accepting are numbers that have been pre-"laundered" by mainstream media.

This is the crux of the prediction market problem: once odds are disseminated as news, they begin to influence the very things they are supposed to predict. There's a specific name for this phenomenon; economists call it endogeneity. Simply put, the act of measuring changes the thing being measured.

Let me give a concrete example. Coinbase CEO Brian Armstrong is on an earnings call. He learns that Polymarket is running a contract on whether he will mention certain specific phrases during the call. So, he alters the wording he was going to use. The market was supposed to predict what he would say. But his knowledge of the market's movement changed what he ultimately said.

Now, let's scale this dynamic up to an election level. In the 2024 US Presidential election, a French trader using the pseudonym "Theo" (whom the media called the "Polymarket whale") bet on Trump winning and ultimately profited over $85 million. This wasn't some lucky gambler. He commissioned a private poll, independent of all public national polls, which showed Trump was performing far better than public polls indicated.

Because of this, his bets drove up trading prices across platforms, which were then reported by the media outlets I mentioned, including The Wall Street Journal, CNN, and political commentators across platforms. Despite polls showing a tight race, the market prediction leaned towards Trump. This single narrative influenced how millions of people viewed the race in the final weeks. Commentators debated whether the "smart money" knew something the polls didn't. Voters absorbed this narrative, and Trump ultimately won.

I am not claiming Theo changed the election outcome. That would be a stretch I cannot prove. What I am saying is that anyone paying attention should be concerned: a trader with access to private poll data unavailable to others was able to move Polymarket's prices, which The Wall Street Journal and CNN then repackaged and disseminated as the collective wisdom of the market. A good prediction market should aggregate a vast amount of information from numerous participants into a clear signal. What happened in 2024 was that one person's exclusive poll data was laundered through Polymarket and re-broadcast as if it represented the consensus of thousands of traders.

If one trader can do this with $85 million, imagine what someone with real money and power could do?

In February 2026, Israeli authorities charged at least two individuals, accusing them of using classified military intelligence to gamble on the Polymarket platform. They placed bets on contracts related to Israeli military actions before those actions became public, with potential profits around $100,000. These individuals had security clearances and used information the public wouldn't have for days to bet on war. This is the first global case of its kind, confirming that prediction markets are fast enough, liquid enough, and anonymous enough to be used to monetize classified information in real-time.

The Maduro trade mentioned at the beginning of this article? The pattern is identical. Someone placed a bet before a secret military operation occurred and won over $400,000. Whoever it was either had insider information or was the luckiest guesser in the history of political gambling. We will never know.

What Happens When Everyone Believes the Odds?

The median question on the Polymarket platform is resolved within four days. The average resolution time is 19 days, but a few long-term markets pull the average up. Most questions on the platform are about what will happen *this week*.

This shows these markets aren't making any meaningful long-term predictions about the future. They are just pricing the near term. Will the vote pass on Friday? Will this person say this thing tomorrow? Will the number released on Wednesday be above or below expectations? This information is useful. But it's a far cry from what people mean when they call prediction markets "truth machines." That phrase usually implies the market can tell you what the world will look like in six months, a year, or even five years. But the data shows it simply can't. Not even close.

99% of the trading volume in prediction markets concentrates in the final few hours before an event is settled. Money pours in during the last hours when the outcome is almost certain. Also, these markets have massive liquidity gaps. By the end of 2025, the combined weekly volume of the two major platforms, Polymarket and Kalshi, is projected to be around $2.5 billion. Sounds impressive, right? But the U.S. options market alone clears about $760 billion *per day*.

Prediction markets represent just 0.05% of that. The entire prediction market industry, across any platform, any contract, any category, is minuscule compared to the markets institutions actually use for decision-making.

Here's the situation: Prediction markets only work for a very specific type of question: binary, high-profile, short-term events involving millions of dollars. But that's a tiny fraction of the questions these platforms actually offer. For the other 98% of questions, the prices are unreliable, liquidity is almost non-existent, and their outcomes are more like Twitter polls than financial instruments.

They are building the default probability source for everything. Just like you open a Bloomberg terminal to check a stock price, their vision is that you open Polymarket to check a probability. Their strategy is that once enough media outlets, newsrooms, financial analysts, and government researchers rely on this data source, regardless of its accuracy, the product becomes irreplaceable.

I think it will work. And I think that should worry everyone.

Because the issue isn't whether prediction markets are useful. The answer is yes. For elections, major economic data, and a handful of high-profile events, they consistently outperform alternatives. That's a fact, and it's crucial. The problem is, what happens when the entire information ecosystem starts treating the output of these markets as truth, even for the 98% of questions the markets are completely incapable of predicting?

Economist Robin Hanson, a decades-long advocate for prediction markets, describes them as a system that forces people to put money behind their beliefs. In his model, the final price will be the best available estimate of the truth at that moment. But that model assumes liquid markets, diverse participants, and resistance to manipulation. The markets we have are dominated by a few "whales," concentrated in two areas (elections and sports), accounting for roughly 80% of the volume. The remaining 20% of volume is spread across thousands of contracts, where a few thousand dollars can move the price by double digits.

These are tools for manufacturing attention. They work when the world is watching; they fail when no one is. The more people believe they are truth-making tools, the more power those who can move prices wield. And those who can move prices aren't a crowd of informed ordinary people; they are a small group of well-funded traders with access to private polls and, in at least two confirmed cases, classified intelligence.

The most dangerous thing about prediction markets isn't that they are wrong; it's that they are right just often enough on critical questions to earn a trust they don't inherently possess. And that trust is slowly being baked into the world's information processing machinery. The Wall Street Journal prints the prediction data, CNN broadcasts it, TikTok shares it. Eventually, some trader with enough capital gets to decide what that number means.

This is the reality of the truth machine. A system that produces numbers the world has decided to call truth.

Related Questions

QWhat is the Brier score and how is it used to evaluate prediction markets like Polymarket?

AThe Brier score is a metric developed by meteorologist Glenn Brier in 1950 to evaluate the accuracy of probabilistic forecasts. A score of 0 means a perfect forecast, 0.25 is equivalent to a coin flip, and anything above 0.25 is worse than random guessing. It is used to assess the overall performance of prediction markets by analyzing their complete history across thousands of questions, providing a more honest statistical evaluation than a single correct prediction.

QAccording to the article, in which categories do prediction markets perform well and poorly?

APrediction markets perform well in Science & Economics (score of A) and Politics (score of B+), particularly in large, high-liquidity events like presidential elections. They perform very poorly in Sports (score of D, 0.325), where their accuracy is worse than a coin flip, and also in Culture & Tech.

QWhat is the phenomenon called when the odds from a prediction market influence the event they are supposed to predict?

AThe phenomenon is called endogeneity. It occurs when the measurement (the market odds) changes the object being measured (the event itself). An example given is the CEO of Coinbase altering his speech because he was aware of a Polymarket contract betting on his specific phrasing.

QWhat concern does the article raise about the relationship between major media outlets and prediction markets?

AThe article raises the concern that major media outlets (like The Wall Street Journal, CNN, CNBC) integrating prediction market odds into their reporting legitimizes and 'launders' these numbers, making them appear as factual information to the public. This widespread trust can be problematic because the markets are often illiquid and manipulable for the majority of questions they cover.

QWhat is the core danger of prediction markets becoming a 'default source of probability' according to the author?

AThe core danger is that prediction markets will win trust for being right on a few key, high-profile issues, but this trust will then be applied to the 98% of questions for which the markets are illiquid, unreliable, and easily manipulated. This allows a small number of wealthy traders with private information (like polls or classified intelligence) to effectively set the 'truth' that is then disseminated by the media and believed by the public.

Related Reads

Blocked Its Own Treasure, WeChat AI Steps Up

Tencent's stock surged over 10% on June 2nd amid reports that WeChat, with 1.43 billion monthly users, is finalizing tests for a native AI Agent. The reported feature, accessible by swiping right from the main interface, allows users to issue commands in natural language. The AI then decomposes tasks and automatically calls upon relevant Mini Programs within WeChat to complete actions like ordering food, booking tickets, or making payments, creating a closed-loop service execution system. This strategic shift follows the internal conflict and subsequent "blocking" of Tencent's standalone AI app, Yuanbao, by WeChat for violating sharing rules during a 2026 Spring Festival promotion. The incident highlighted a lack of internal consensus and exposed the weakness of competing in the standalone AI assistant arena against rivals like ByteDance's Doubao (345M MAU) and Alibaba's Qianwen. The new WeChat AI Agent aims to leverage WeChat's unique assets—its massive user base, standardized Mini Program APIs, WeChat Pay, and identity system—to move from simple content generation to actual task execution. Analysts note this changes the competitive landscape from model benchmarks to which AI can connect to more real-world services. However, success depends on key variables: the capability of Tencent's underlying Hunyuan model, managing massive inference costs, and redesigning incentives for Mini Program developers whose traffic might be bypassed. The move is seen as an attempt to keep user service intent within WeChat's ecosystem as AI begins to redefine how users access services.

marsbit52m ago

Blocked Its Own Treasure, WeChat AI Steps Up

marsbit52m ago

ByteDance Adopts Arm CPUs, Jensen Huang: So Sad I Didn't Buy Arm

**Summary:** At Computex 2026, Arm CEO Rene Haas announced that ByteDance and Oracle have adopted Arm's self-designed Arm AGI data center CPU. The company expects significant revenue growth from this product, projecting $20 billion in demand for the 2027/2028 fiscal years. Haas noted that restricting AI-capable CPUs from the US to China is nearly impossible due to their widespread applications. Arm's stock has surged dramatically this year, notably rising 16% after NVIDIA's Arm-based Vera CPU and RTX Spark announcements. A highlight was the informal, humorous on-stage conversation between Haas and NVIDIA CEO Jensen Huang. Huang joked about NVIDIA's failed attempt to acquire Arm and playfully lamented selling his Arm shares. Both executives showed a clear sense of camaraderie and shared regret over the missed merger. Key technical topics were discussed: 1. **AI PC Design:** Huang explained NVIDIA's RTX Spark superchip (with a 20-core Arm CPU) is designed for future AI agents that will autonomously run and use tools on PCs, blending local and cloud processing. 2. **Agent vs. OS:** Huang emphasized the operating system remains crucial, as AI agents rely on its APIs and tools to function. 3. **Growth Constraints:** He identified the shift to "useful AI" that generates profitable tokens as a primary driver for immense, almost limitless, computational demand. Haas outlined Arm's strategy across PC and data centers. For PCs, Arm collaborates with partners like NVIDIA and MediaTek, offering its compute subsystem (CSS) for custom SoCs. In data centers, its Arm AGI CPU (built on TSMC's 3nm process) has gained major partners including OpenAI, Meta, and now ByteDance and Oracle. Arm presented a multi-year roadmap for its in-house CPU line. The article concludes that while GPUs dominated the AI training race, the explosion of AI agents is shifting significant focus to CPUs for inference, state management, and tool orchestration. The industry is trending towards vertical integration, with companies like cloud providers designing chips and chip/IP firms offering full solutions, all competing to deliver more efficient computing per watt.

marsbit1h ago

ByteDance Adopts Arm CPUs, Jensen Huang: So Sad I Didn't Buy Arm

marsbit1h ago

New Wall Street Play: Yen Shorts Still Adding, But Japan Stocks Don't Rely on Carry Trade Unwinding

On June 3rd, USD/JPY hit 160.44, its highest level since July 2024, while the Nikkei 225 surged past 68,000 points. Contrary to popular narratives of an imminent "carry trade unwind" akin to August 2024, data reveals a more complex picture. Speculative net short positions in yen futures have actually increased, reaching -114,667 contracts by late May, suggesting traders are doubling down rather than retreating. Meanwhile, Japan's Finance Ministry conducted its largest-ever single-round FX intervention (11.73 trillion yen) in April-May but failed to hold the 160 yen line. The Nikkei's rally is not driven by carry trade dynamics. Foreign investors are aggressively buying Japanese stocks, with net purchases in 2026 running nearly 16 times higher than 2025 levels. This inflow is concentrated in AI and semiconductor-related stocks like SoftBank and Socionext, fueled by positive sector outlooks, rather than being a flight from unwinding yen shorts. Furthermore, the Nikkei has continued climbing despite the Bank of Japan's (BOJ) rate hikes to 0.75%. This disconnect exists because the current equity boom is fueled by AI-driven foreign investment, not reliant on cheap yen funding. However, this relationship remains fragile. Should the BOJ hike rates further (e.g., to 1.0%) while dollar weakness increases carry trade costs, the trajectories of the yen and Japanese stocks could reconverge, potentially triggering volatility.

marsbit1h ago

New Wall Street Play: Yen Shorts Still Adding, But Japan Stocks Don't Rely on Carry Trade Unwinding

marsbit1h ago

Broadcom's Q3 Guidance Misses Expectations by $12 Billion, After-Hours Trading Plummets Over 13%, AI Narrative "Cooling"?

On June 3, Broadcom released record Q2 FY26 results with revenue of $22.19B, up 48% YoY, and AI chip sales of $10.8B, up 143%. Adjusted EPS of $2.44 beat estimates. However, its Q3 AI semiconductor revenue guidance of $16B, while up over 200% YoY, fell roughly $1.2B (7%) short of analyst consensus expectations of $17.2B. This miss, coupled with slightly weaker-than-expected software revenue, triggered a severe market reaction. CEO Hock Tan maintained the FY26 AI revenue outlook of over $100B but did not raise it, disappointing investors who had priced in more robust growth. The stock plummeted over 13% in after-hours trading, erasing roughly $270B in market cap. The sell-off extended to peers like Marvell. A key concern for markets, particularly for Chinese optical module suppliers, was Tan's comment that the contribution of AI networking (e.g., Ethernet switches, optical interconnect chips) to AI revenue, currently near 40%, is expected to normalize to around 30% over time, signaling a potential peak in growth for that segment. Despite the guidance shortfall, Tan reiterated that AI demand remains "insatiable" and reaffirmed the long-term target of exceeding $100B in AI revenue by FY27. The reaction highlights the heightened sensitivity and premium valuation placed on AI-exposed stocks, where anything less than stellar guidance can prompt significant profit-taking. The broader question is whether this represents a cooling AI narrative or a correction in overstretched valuations.

marsbit1h ago

Broadcom's Q3 Guidance Misses Expectations by $12 Billion, After-Hours Trading Plummets Over 13%, AI Narrative "Cooling"?

marsbit1h ago

Trading

Spot
Futures
活动图片