A Year Consumes a Solid-State Drive: Codex Log Bug Slammed as 'Slopware'

marsbitPublished on 2026-07-02Last updated on 2026-07-02

Abstract

OpenAI's flagship AI coding tool, Codex, was found to have a critical bug causing its feedback logging system to silently and rapidly wear out users' SSDs. A developer reported that Codex was writing approximately 640 TB of data per year to a local SQLite database (`logs_2.sqlite`) through a constant cycle of inserting and immediately deleting log entries, primarily at the verbose TRACE level. While the database file itself remained around 1 GB, the underlying write-amplification from SQLite's WAL mechanism meant the physical SSD endured the full write load. This was enough to exceed the typical 600 TBW endurance rating of a consumer SSD within a year. The root cause was a hardcoded default logging level (`Level::TRACE`) in the configuration, which overrode any user attempts to reduce logging via environment variables. Analysis showed that over 96% of the logged data—including noisy WebSocket packet dumps and repeated system file events—was useless debug information. The issue, which had at least nine related bug reports in the Codex repository, remained latent because it didn't visibly consume disk space, only silently accumulated write cycles. After the report gained traction on Hacker News, OpenAI merged fixes estimated to reduce writes by about 85%. However, even post-fix, the tool would still write an estimated 96 TB annually. The incident sparked broader criticism of "slopware" in AI-assisted development tools, highlighting a lack of resource budgeting for disk, CPU, ...

A year 'eats' a 1TB SSD?

OpenAI's flagship programming tool, Codex, is burning through your solid-state drive with 640TB of writes per year.

Not long ago, a developer submitted an issue on GitHub. This now-closed GitHub issue, #28224, bears the title:

Codex's SQLite feedback log writes 640TB/year, rapidly depleting SSD lifespan.

According to the reporter's actual measurements, his primary SSD lost 37TB of write endurance after 21 days of continuous operation. At this rate, it's about 640TB per year—enough to wear out a consumer-grade drive with a 600 TBW (Total Bytes Written) rating.

As evidence, he posted two tables.

In evidence 1, the log database always appears to be only 1.2GB, seemingly like nothing happened; yet its auto-incrementing row ID has surged to 5.5 billion, while the actual retained rows are just over 500,000, a difference of ten thousand times.

The key is that SSD wear counts the total amount written, not what remains now: all those 5.5 billion rows were written to disk, and deleting them doesn't undo the writes already incurred. So you only ever see those 500,000 rows when checking the file, but the drive has already endured the write load of 5.5 billion rows.

Evidence 2 reveals the distribution of these 5.5 billion rows: over 90% are debug noise that even the developers themselves wouldn't look back at. Simply copying down each entire WebSocket data packet accounted for half of it.

The culprit is a default configuration of Level::TRACE, treating your drive's write endurance as free scratch paper.

A highly upvoted comment on Hacker News directly defined the nature of this issue:

This is one of the most egregious examples of "slopware."

This netizen also helplessly added:

This is a tragedy. The world needs someone to compete with Anthropic.

What's even more awkward is that this problem wasn't unreported.

Sporadic feedback has existed since April this year, dragging on for over two months. Only after users calculated it themselves, wrote reports, and pushed it to the top of Hacker News did it receive serious attention. Even then, this round only cut about 85% of the log writes.

Some tried to fix it themselves but found they couldn't: the desktop versions of these tools are closed-source.

There was also a classic comment in the thread: How did the review process not catch such an obvious bug? Oh right... @codex, review this.

How exactly did the 640TB get written?

What does 640TB mean?

Mainstream consumer SSDs have a rated write endurance of roughly 150 to 600 TBW, enough for the average user for over a decade or two.

Yet Codex's "record what I did" logging feature can write that much in a year.

The story begins when this user checked his drive usage. His machine, running continuously for 21 days, saw his primary SSD endure 37TB of writes.

At this speed, it's about 640TB per year.

What's more absurd is the write pattern.

Codex maintains a local SQLite database, logs_2.sqlite, specifically for feedback logs. This user monitored it for 15 seconds—36,211 rows were inserted, while the total retained row count remained 681,774 from start to finish, not a single one more.

For every row inserted, one was deleted. The row count stayed constant, but the disk was being rewritten tens of thousands of times.

This mechanism has a nickname: insert-and-prune.

Even more ridiculous is what it records: a bunch of filesystem inotify events.

ld.so.cache was logged 128,764 times, locale.alias 37,982 times, passwd 23,843 times.

The same file, by the same program, logged hundreds of thousands of times repeatedly.

The auto-incrementing ID in the logs had exceeded 5.5 billion, while only about 500,000 rows were retained.

A difference of ten thousand times.

This isn't a bug; it's more like an AI programming tool chanting to its own hard drive.

The file is only 1GB, but writes amount to 640TB

If it writes and deletes simultaneously, how big can logs_2.sqlite remain? About 1GB.

This leads to the most counterintuitive point of the whole affair: SSD lifespan depends on "write amount," not "file size." A 1GB file rewritten 640 times equals 640TB of writes for the drive.

SQLite uses a WAL (Write-Ahead Logging) mechanism. Changes are first written to a -wal file, then checkpointed back to the main database in batches. Codex performs over thirty thousand inserts and deletions every 15 seconds. Each one goes through WAL, index updates, and checkpoints—the same storage area, erased over and over.

An analogy: a 1GB notebook, where you erase and rewrite it 1,750 times a day for a year. The notebook is the same, but the paper is worn through.

This is also why this bug could remain hidden for so long: it doesn't take up space, only burns through lifespan.

Checking available disk space shows nothing unusual; the file size stays quiet. Only by reading the drive's own SMART health counters can you see the write amount silently accumulating.

Root cause: an ignored RUST_LOG line

Why were so many logs recorded?

The answer lies in a single line of configuration in the Codex source code: the SQLite feedback log sink is initialized with Targets::new().with_default(Level::TRACE).

In short, the log is set to TRACE level by default—the highest, most verbose, record-everything level.

Codex's logging framework is Rust's `tracing` ecosystem. The standard practice is to read the RUST_LOG environment variable. Users certainly tried setting RUST_LOG to info, warn, or even turning it off entirely.

No use.

with_default(Level::TRACE) hard-locks the global default to TRACE. RUST_LOG simply doesn't take effect on this path. You think you turned off logging, but it writes regardless.

The most deceptive part of this bug isn't that "you forgot to configure," but that "you configured, and it pretended not to hear."

Even more glaring is a proportion.

Breaking down the retained logs by category, TRACE accounts for 70.7%, about 732.5 MB. Adding the two mirrored telemetry logs from codex_otel (log_only and trace_safe) takes up another 25.3%.

70% of writes are TRACE noise. Combined with mirrored telemetry, 96% is pure nonsense nobody would read.

Only 4% is actually meaningful content.

This isn't the first one; at least the ninth

The reporter checked the Codex repository and found at least 9 issues of this "unbounded log growth" type.

#17320: WAL writes wildly during streaming responses, root cause identical to this one—TRACE ignoring RUST_LOG.

#24275: Desktop version logs_2.sqlite explodes.

#22444: WAL grows infinitely and doesn't free up space.

#26374: Writes 0.75GB per day, no rotation.

#27911: A 4KB goals_1.sqlite gets written at 11MB/s.

#20563: Disk writes wildly even when process is idle.

#27020: Disk at 100% activity on Windows.

The earliest trace leads back to #12969, the very PR that connected the SQLite feedback log sink at the TRACE level.

A 4KB database being written at 11MB/s is enough for a standalone article. Yet, both it and the 640TB issue are symptoms of the same product, the same telemetry system.

This shows that from the beginning, Codex's logging and telemetry systems lacked the concept of a "resource budget."

The entire field is competing over token budgets, context lengths, and model capabilities.

But almost no one asks: who manages the disk, memory, and CPU budget for an Agent that resides on a user's machine, running 24/7?

Fixed, but in a very OpenAI way

Reported on GitHub on June 14th. On June 23rd, the reporter updated: three PRs merged. According to his own Codex feedback, they reduced logs by about 85%, so he closed the issue.

First, about that 85%—it's not 100%, and it's not fully deployed yet.

Of the three fixes, #29432 and #29457 were released with version 0.142.0, cutting out per-WebSocket logging and noisy targets. The third, #29599, stops another type of bridged redundant log and will be in version 0.143.0.

Even with all three in place, the remaining ~15% still amounts to ~96TB of writes per year, merely reducing it from "burning out a drive in a year" to "burning it out in six years."

Some defended it: trace logs are stored by design for debugging, not a bug, and indeed help OpenAI track down edge cases.

But that's precisely the issue: using paying users' SSD endurance as free storage for the vendor's debugging—did the users ever agree to this?

In the programming battlefield, more than just SSDs are being burned through

Interestingly, Codex wasn't the only one singled out.

Comments quickly added: Claude Code also writes debug logs heavily to local storage. Some had to symlink the log directory to a RAM disk (tmpfs) to extend their SSD's life.

Both flagship products suffer from the same type of flaw.

Community discussion soon expanded from one bug to the broader quality issues of AI programming tools.

Some complained these agents keep the GPU maxed out and memory usage at 70GB+. Others simply coined a name for this generation of software: slopware.

The original developer's suggestion was simple: set a limit for the app, don't exceed 3GB. Just this one line took Codex 9 issues and several months to finally consider drawing.

The question is: why would a company that constantly talks about "AGI" stumble on a problem even an intern could spot?

Why could this flaw hide for so long? One comment also hit the nail on the head.

A decade ago, setting logs to TRACE would cause the program to freeze instantly, fixed the same day. Today, CPUs are fast enough, memory large enough, disks robust enough that such flaws are quietly absorbed by hardware performance. The program runs, the interface works, users feel nothing—until the SSD dies prematurely one day.

In recent years, software has been stuffed with AI-generated code. Features pile up, abstraction layers thicken, and resource consumption skyrockets, all barely propped up by hardware makers releasing faster chips every year.

Thus, an absurd cycle emerged: software gets worse, hardware gets more powerful. Users pay for new machines under the illusion that "it doesn't seem slower," when in reality, the new hardware is just barely supporting worse software.

A single small bug can't crush OpenAI, of course. But competition between Codex and Claude Code has already spread from model capabilities to the entry point of developers' workflows.

On this front, making quick changes and responding to developer needs was never a bonus—it's just the entry ticket.

References:

https://github.com/openai/codex/issues/28224

https://news.ycombinator.com/item?id=48626930

This article is from the WeChat public account "New Zhiyuan," author: ASI Revelation

Trending Cryptos

Related Questions

QWhat is the core issue reported regarding OpenAI's Codex programming tool in the article?

AThe core issue is that Codex's SQLite feedback logging mechanism is set to TRACE level by default, causing it to perform an excessive number of database insert and delete operations. This results in an estimated 640TB of write operations to a user's solid-state drive (SSD) per year, which can quickly deplete or exceed the drive's total write endurance (TBW), potentially leading to premature drive failure.

QHow does the article describe the 'insert-and-prune' mechanism causing the excessive disk writes?

AThe 'insert-and-prune' mechanism described in the article involves Codex continuously inserting new log entries into a SQLite database (logs_2.sqlite) and immediately deleting old ones to keep the file size constant (around 1GB). However, each insert and delete operation contributes to the total data written to the SSD. Even though the file size remains small, the constant churn of data within the file leads to massive cumulative write volumes on the physical disk over time.

QAccording to the article, why was this logging bug difficult for users to detect initially?

AThe bug was difficult to detect initially because it did not consume significant disk space. The logs_2.sqlite file maintained a relatively constant size (~1GB). The massive write volume was only observable by monitoring the drive's SMART health data (which tracks total bytes written), not by checking typical metrics like available disk space or file size.

QWhat was the community's reaction on platforms like Hacker News, as mentioned in the article?

AThe community reaction on platforms like Hacker News was highly critical. A high-rated comment labeled the issue as one of the most notorious examples of 'slopware' (slop software). There was frustration over the delayed response from OpenAI and criticism that such a fundamental resource management flaw could persist in a flagship product, with some comments calling for more competition in the AI coding assistant space.

QWhat broader software development trend does the article suggest this Codex bug exemplifies?

AThe article suggests this bug exemplifies a broader trend of declining software efficiency, often referred to as 'slopware.' Modern software, increasingly bloated with AI-generated code and complex abstractions, consumes excessive system resources (CPU, memory, disk I/O). This inefficiency is often masked by the rapid performance improvements in hardware, creating a cycle where users upgrade their hardware to compensate for poorly optimized software rather than demanding better code quality.

Related Reads

MSTR Discloses Sale of 3,588 Bitcoins, Stock Price Drops Over 5% at One Point During Trading

MicroStrategy, the world's largest corporate holder of Bitcoin, has significantly shifted its business model. Between June 29 and July 5, the company sold 3,588 bitcoins for approximately $216 million to fund quarterly dividends for its preferred stock. This marks its largest-ever Bitcoin sale and signals a strategic pivot: Bitcoin is transitioning from a "buy-and-hold" reserve asset to a liquidity management tool for the company. This move follows a recent authorization allowing Bitcoin sales when equity fundraising is less attractive. The announcement contributed to a more than 5% intraday drop in MicroStrategy's stock price, while Bitcoin fell to around $61,800—below the company's average holding cost of roughly $75,700. The sale represents a major departure from MicroStrategy's long-standing "never sell" commitment, which saw its first minor breach in May with a $2.5 million sale. The latest, hundred-times-larger transaction underscores growing financial pressures. Analysts note the company faces about $1.5 billion in annual preferred dividend obligations, far exceeding cash flow from its software business. As of July 5, MicroStrategy holds 843,775 bitcoins. Its current operational logic involves buying Bitcoin during favorable financing conditions and selling portions to cover dividends when needed, creating a flexible capital management cycle amidst a challenging market environment.

华尔街日报3h ago

MSTR Discloses Sale of 3,588 Bitcoins, Stock Price Drops Over 5% at One Point During Trading

华尔街日报3h ago

Q-Day Countdown: Will Quantum Computing End Cryptocurrencies?

Quantum Computing's Threat to Cryptocurrency: A Countdown to Q-Day Quantum computing, specifically Shor's algorithm, poses a fundamental threat to the public-key cryptography (e.g., ECDSA, RSA) that secures blockchain networks like Bitcoin and Ethereum. This critical juncture, known as Q-Day, is estimated to occur potentially within the next 5-15 years. The core vulnerability stems from the public and immutable nature of blockchains. Assets in addresses where the public key is already exposed on-chain (e.g., spent outputs) are at direct risk, as a sufficiently powerful quantum computer could derive the private key. This threatens the very trust model of cryptocurrencies. The response lies in Post-Quantum Cryptography (PQC)—algorithms like lattice-based ML-DSA and hash-based SLH-DSA, which are resistant to quantum attacks. NIST has standardized key PQC algorithms (FIPS 203, 204, 205), providing a migration path. However, the primary challenge is not technical but socio-economic and involves complex governance: * **Bitcoin's** path is constrained by its conservative ethos. Migrating requires a soft-fork to new address types, facing hurdles like significantly larger signature sizes and, most critically, the divisive governance question of how to handle at-risk legacy UTXOs without violating core principles. * **Ethereum** is pursuing a "cryptographic agility" strategy, with a multi-layered roadmap. It leverages account abstraction for user accounts and is developing compressed hash-based signatures (e.g., leanXMSS) for its consensus layer, aiming for a full-stack upgrade over time. In conclusion, quantum computing does not spell an instant end for cryptocurrency but initiates a critical countdown. The industry has a limited "engineering comfort window" to orchestrate a coordinated, ecosystem-wide migration to PQC. The ultimate bottlenecks are the immense coordination efforts and governance decisions required for this foundational transition.

marsbit4h ago

Q-Day Countdown: Will Quantum Computing End Cryptocurrencies?

marsbit4h ago

Trump, the President Who Knows Best How to 'Trade Stocks'

Former US President Donald Trump reported a record-breaking $2.2 billion in personal income for 2025, the highest annual income ever disclosed by a sitting president. This figure, from a 927-page government ethics filing, represented a 3.5-fold increase from his $600 million income in 2024 and boosted his net worth to $6.5 billion. The primary drivers were cryptocurrency (64% of income, approximately $1.4 billion) and real estate (26%, approximately $575 million). His crypto earnings stemmed largely from the launch of his personal meme coin, $TRUMP, generating over $600 million in licensing fees, and substantial profits from the WLFI token and its parent company. Despite a sluggish property market, his Mar-a-Lago resort and associated golf clubs saw revenue surges of 50% and 27%, respectively, attributed to their use as venues for presidential events. Trump's financial disclosure also revealed an unprecedented level of stock market activity, with over 22,000 trades executed in 2025, averaging 87 trades per market day. Media analyses noted several instances where significant trading coincided with major policy announcements, such as proposed tariffs, raising questions about potential conflicts of interest. While the White House stated these trades were handled by a family-managed trust fund and not Trump directly, critics highlighted this as a departure from the blind trusts traditionally used by presidents post-Watergate. The report has intensified debate over the commercialization of the presidency. Supporters view it as a success story of a businessman-president, while critics argue it demonstrates an unprecedented conversion of public influence into private wealth, with policy decisions potentially linked to personal financial gains. The controversy centers on whether Trump's earnings represent innovative entrepreneurship or a fundamental conflict of interest, sparking renewed calls for stricter ethics reforms in US governance.

marsbit4h ago

Trump, the President Who Knows Best How to 'Trade Stocks'

marsbit4h ago

Countdown to Q-Day: Will Quantum Computing End Cryptocurrencies?

The article explores the existential threat quantum computing poses to cryptocurrencies and the urgent need for "post-quantum" migration. It outlines that quantum computers, through Shor's algorithm, could break the elliptic-curve cryptography (ECC) underlying blockchain security, potentially allowing private keys to be derived from public keys. The core challenge is not a lack of post-quantum cryptography (PQC) standards—like NIST's ML-KEM and ML-DSA—but the immense complexity of upgrading entire ecosystems before "Q-Day" (when quantum computers become capable of such attacks, estimated around 2035-2045). Key points include: * **Bitcoin's** risk is concentrated in legacy UTXOs with exposed public keys (e.g., early P2PK outputs). Migration faces massive hurdles: PQC signatures are much larger, increasing transaction size and cost, and the governance dilemma of handling un-migrated assets threatens its "code is law" ethos. * **Ethereum's** strategy focuses on "cryptographic agility," using Account Abstraction for user accounts and developing compressed hash-based signatures (like leanXMSS with SNARK aggregation) for consensus. Its migration is a complex, full-stack overhaul of execution, consensus, and data layers. * The "security debt" is enormous. The comfortable engineering window for a coordinated, ecosystem-wide upgrade is only 5-8 years. High-value infrastructure (exchanges, bridges) may face pressure before mainnet protocols. In conclusion, quantum computing is not an instant "doomsday" event but a forcing function for systemic change. Bitcoin's ultimate test is social consensus and property rights governance, while Ethereum's is technical complexity. Failure to migrate in time could lead to a fundamental re-pricing of crypto assets.

链捕手4h ago

Countdown to Q-Day: Will Quantum Computing End Cryptocurrencies?

链捕手4h ago

Trading

Spot

Hot Articles

How to Buy T

Welcome to HTX.com! We've made purchasing Threshold Network Token (T) simple and convenient. Follow our step-by-step guide to embark on your crypto journey.Step 1: Create Your HTX AccountUse your email or phone number to sign up for a free account on HTX. Experience a hassle-free registration journey and unlock all features.Get My AccountStep 2: Go to Buy Crypto and Choose Your Payment MethodCredit/Debit Card: Use your Visa or Mastercard to buy Threshold Network Token (T) instantly.Balance: Use funds from your HTX account balance to trade seamlessly.Third Parties: We've added popular payment methods such as Google Pay and Apple Pay to enhance convenience.P2P: Trade directly with other users on HTX.Over-the-Counter (OTC): We offer tailor-made services and competitive exchange rates for traders.Step 3: Store Your Threshold Network Token (T)After purchasing your Threshold Network Token (T), store it in your HTX account. Alternatively, you can send it elsewhere via blockchain transfer or use it to trade other cryptocurrencies.Step 4: Trade Threshold Network Token (T)Easily trade Threshold Network Token (T) on HTX's spot market. Simply access your account, select your trading pair, execute your trades, and monitor in real-time. We offer a user-friendly experience for both beginners and seasoned traders.

12.3k Total ViewsPublished 2024.03.29Updated 2026.06.02

How to Buy T

Discussions

Welcome to the HTX Community. Here, you can stay informed about the latest platform developments and gain access to professional market insights. Users' opinions on the price of T (T) are presented below.

活动图片