Your Backtest Is Lying: Why You Must Use Point-in-Time Data

insights.glassnode2026-03-13 tarihinde yayınlandı2026-03-13 tarihinde güncellendi

Özet

This article warns against a common pitfall in backtesting trading strategies: look-ahead bias caused by using revised historical data. It illustrates this with a hypothetical Bitcoin strategy based on exchange outflows from Binance. The strategy is built on the premise that sustained outflows (when the 5-day moving average of BTC balance falls below the 14-day average) are bullish, while inflows signal a sell-off. An initial backtest using standard, revised data shows the strategy performing comparably to a simple buy-and-hold approach. However, the author argues these results are misleading because the data has been updated with information that wasn't available in real-time. This data mutation creates an unfair advantage in the backtest. To demonstrate, the test is rerun using Point-in-Time (PiT) data—an immutable, append-only record that reflects only what was known on any given day. The results are significantly worse, as the PiT-based strategy misses key profitable moves. The key takeaway is that accurate backtesting requires immutable Point-in-Time data to avoid look-ahead bias and replay history honestly.

Let's build a simple, hypothetical trading strategy. The premise is straightforward and rooted in a widely discussed narrative: when coins leave exchanges, it tends to be bullish. The reasoning is intuitive: coins moving off exchanges typically signal that holders are withdrawing to self-custody, reducing the available supply for selling. Conversely, coins flowing onto exchanges may indicate that holders are preparing to sell.

A single day of outflows, however, is just noise. To identify a genuine trend, we would apply a moving average crossover on the exchange balance. When the short-term average falls below the long-term average, it confirms that coins have been leaving exchanges consistently, as a sustained pattern, rather than isolated events.

Using Glassnode's exchange balance for Binance, we define the following:

  • Enter the market when the 5-day moving average of Binance's BTC balance falls below its 14-day moving average, signaling a sustained outflow trend.
  • Exit the market when the 5-day average rises back above the 14-day average, signaling that the outflow trend has reversed and coins are returning to the exchange.

We then benchmark this strategy against simply holding BTC over the same period, starting January 1, 2024 through March 9, 2026, with an initial capital of $1,000 and 0.1% trading fees applied to each trade.

This is a simplified trading strategy, designed primarily for illustrative purposes. It is not investment advice, nor is it meant to suggest that exchange balances are a robust foundation for a trading system.
Access live chart

Here's how to read this chart:

🟫 The brown line at the bottom is the binary trading signal, toggling between in the market (1) and out of the market (0).

🟦 The blue line tracks the strategy's portfolio value over time.

🟩 The green line is the buy-and-hold portfolio benchmark.

We can observe that the exchange balance strategy performed reasonably well, although at times the buy-and-hold strategy outperformed it. In the final days of the research period, however, the exchange balance strategy caught up. While some investors may find the combination of reduced volatility and an ultimately comparable performance to buy-and-hold appealing, the final numbers are misleading – and here’s why.

The Problem: Data Mutation and Look-Ahead Bias

Metrics are not static. Many are retroactively revised as new information becomes available. This is particularly true for metrics that depend on address clustering or entity labeling, such as on-chain exchange balances. However, it is also the case for metrics such as trading volume or price, as individual exchanges can occasionally submit their data with slight delays.

This means that a value you see today for, say, January 15, 2024, may not be the same value that was published on January 15, 2024. The data has been revised with hindsight. When you backtest a strategy on this revised data, you are implicitly using information that was not available at the time the trading decisions would have been made. This introduces a look-ahead bias.

The Honest Backtest: Using Point-in-Time Data

Let's therefore repeat the exact same backtest – same signal logic, same parameters, same dates, same fees – but this time using the Point-in-Time (PiT) variant of the Exchange Balance metric, available in Glassnode Studio.

PiT metrics are strictly append-only and immutable. Each historical data point reflects only the information that was known at the time it was first computed. No retroactive revisions, no look-ahead bias.

While we are using the same metric, the strategy now produces significantly different results, as illustrated by the purple line in the new chart below. The overall performance is notably worse.

Although both strategies behave similarly for much of 2024, we observe that the PiT-based version fails to capture the strong upticks in November 2024 and March 2025 as effectively. As a result, the cumulative performance diverges meaningfully and ends up considerably lower.

Access live chart

Key Takeaway

In this example, the purple strategy, which only has access to information as it was available at the time, performs noticeably worse. ► Backtests will lie if fed with wrong or revised data. Only immutable, Point-in-Time metrics ensure you’re replaying history as it actually happened.

İlgili Sorular

QWhat is the main problem with using revised data for backtesting a trading strategy?

AThe main problem is that it introduces look-ahead bias, as the revised data includes information that was not available at the time the trading decisions would have been made.

QHow does the Point-in-Time (PiT) data differ from the standard exchange balance metric?

APoint-in-Time data is strictly append-only and immutable, meaning each historical data point reflects only the information known at the time it was first computed, with no retroactive revisions.

QWhat was the trading signal used in the hypothetical strategy based on exchange balances?

AThe strategy entered the market when the 5-day moving average of Binance's BTC balance fell below its 14-day moving average, and exited when the 5-day average rose back above the 14-day average.

QWhy did the backtest using Point-in-Time data perform worse than the one using revised data?

AThe PiT-based strategy failed to capture strong market upticks as effectively because it only had access to information available in real-time, without the benefit of hindsight revisions.

QWhat is the key takeaway from the article regarding backtesting and data quality?

ABacktests will produce misleading results if fed with revised data; only immutable, Point-in-Time metrics ensure an accurate replay of history as it actually happened.

İlgili Okumalar

Raising Interest Rates Is Not a Tech Killer, EPS Is: A Strategy for Discarding the Weak and Retaining the Strong After the AI Theme's Sharp Decline

**Summary: Rising Interest Rates Are Not the Killer of Tech; EPS Is: The "Keep the Strong, Ditch the Weak" Strategy After the AI Theme Plunge** The author argues that the sharp sell-off in tech and AI-related stocks, triggered by a strong US jobs report that heightened Fed rate hike fears, represents a "pullback to pick up passengers" rather than a "car crash." The true end of a tech bull market is not determined by an extra 25 basis point hike, but by industry overcapacity and the disproval of earnings per share (EPS) expectations. Historical analysis shows that during past rate hike cycles, the Nasdaq-100 often outperformed, provided EPS growth remained strong. The current phase is seen as a shift from a "broad narrative-driven rally" to a "focused verification stage" for AI. The investment strategy should be to "keep the strong, ditch the weak." * **Retain exposure** to high-conviction AI infrastructure leaders with clear order visibility, stable margins, strong cash flow, and upward EPS revisions (e.g., AI servers, advanced packaging, optical modules, key cloud suppliers). * **Reduce exposure** to high-beta, narrative-driven stocks with unclear profit paths (e.g., some quantum computing, space, or speculative chip stocks), especially on rebounds. Valuation concerns should focus on whether earnings can catch up to high multiples, not on high P/E alone. Crowded positioning signals a concentration into quality assets, not necessarily a market top. The upcoming Q2 earnings season will be a key validation point. The core principle is to hold stocks with proven EPS, while using macro events (CPI data, central bank meetings) to manage timing and risk.

marsbit36 dk önce

Raising Interest Rates Is Not a Tech Killer, EPS Is: A Strategy for Discarding the Weak and Retaining the Strong After the AI Theme's Sharp Decline

marsbit36 dk önce

The Largest IPO in History Ignites Heated Debate: Is SpaceX Worth $1.77 Trillion?

SpaceX's potential IPO is priced at $135 per share, aiming to raise $75 billion and valuing the company at approximately $1.77 trillion, which would make it the largest IPO in history. This valuation has sparked intense debate among investors. Bullish analysts, including major underwriters Goldman Sachs and Morgan Stanley, argue the valuation is justified by SpaceX's long-term potential. They see it not just as a rocket company but as a future leader in space infrastructure, with key growth drivers being Starlink satellite internet, low-cost rocket launches, and future AI-related ventures. They project revenues reaching hundreds of billions to trillions of dollars by 2030-2040. ARK Invest's model suggests a 2030 enterprise value could reach $2.5 trillion. Bearish analysts from independent research firms like Morningstar, PitchBook, and New Constructs contend the IPO price is excessively high, already pricing in unrealistic future growth. Using DCF and sum-of-the-parts models, they estimate fair value between $780 billion and $1.7 trillion, significantly below the IPO target. They highlight risks such as the speculative nature of AI projections, over-dependence on Elon Musk, high growth expectations, and corporate governance concerns. Trefis set a target price of just $79 per share. While both sides acknowledge SpaceX's unique position in commercial space, the core disagreement centers on whether the $135 share price offers a reasonable margin of safety or is overly optimistic. Despite the valuation controversy, reported strong demand for the IPO indicates significant market interest.

marsbit2 saat önce

The Largest IPO in History Ignites Heated Debate: Is SpaceX Worth $1.77 Trillion?

marsbit2 saat önce

After the Passage of the GENIUS Act and the CLARITY Act, What Is the Correct Architecture for On-Chain Yield?

The article discusses the evolution of on-chain credit, distinguishing three markets: overcollateralized crypto lending, unsecured lending (largely unsuccessful), and asset-backed credit (ABC). ABC, backed by identifiable real-world collateral with legal recourse, is identified as the fastest-growing category and the only one credibly addressing adverse selection—the core problem in credit where the riskiest borrowers self-select. Current growth in on-chain Real World Assets (RWAs), particularly tokenized private credit funds (e.g., Maple Finance, Centrifuge), is substantial but often merely "wraps" existing fund structures, inheriting their risks rather than solving adverse selection at the protocol level. The regulatory landscape is a key driver, with the US GENIUS Act (prohibiting stablecoin issuers from paying yield) and the proposed CLARITY Act (closing loopholes on indirect yield) set to redefine permissible yield-bearing products. This makes vaults (like ERC-4626) the critical architecture—they become the primary compliant vehicle for delivering yield, functioning as issuance, disclosure, distribution, and recovery mechanisms. The author's thesis is that the correct post-GENIUS/CLARITY architecture involves building ABC solutions where credit assessment, structure, and recovery are encoded directly into the smart contract vault layer, moving beyond mere tokenized fund wrappers to solve adverse selection fundamentally and ensure regulatory compliance.

Foresight News3 saat önce

After the Passage of the GENIUS Act and the CLARITY Act, What Is the Correct Architecture for On-Chain Yield?

Foresight News3 saat önce

İşlemler

Spot
Futures
活动图片