返回文章列表
EthereumBlobsData AvailabilityRollupsArchives
🗄️

Who Keeps Ethereum Blob Data After the Retrieval Window?

A custody specification for rollup operators separates temporary data availability, permanent commitments, retained payloads, and independently tested historical reconstruction.

iBuidl Research2026-10-1517 min 阅读

TL;DR: Ethereum blob availability and a rollup's historical archive solve different problems. A commitment helps authenticate recovered data; it does not recreate missing bytes. Operators who promise long-term reconstruction need an explicit collection, verification, retention, and recovery service. Its specification must identify the relevant Ethereum fork, rollup derivation rules, and archive coverage. An ordinary node's recent-data service should never silently become the sole historical backup.

A rollup operator can answer every recent request and still be unable to rebuild an old interval. The healthy dashboard may show a current chain head, successful transactions, and ample disk space. None of those measurements establishes that an independent machine can obtain the inputs needed to derive blocks from a particular historical starting point.

This article addresses that narrower operational question. It does not estimate Ethereum's current blob fees or argue about which scaling architecture captures the most value. It develops an archive custody specification: what an operator should promise, what the retained objects must establish, and what a recovery exercise should actually demonstrate.

The examples below describe a fictional archive called Harbor. They are design exercises, not measurements of a deployed rollup. Protocol references were checked for this article's October 15, 2026 cutoff; historical Deneb parameters are identified as a baseline rather than presented as an unqualified description of every current client.

Begin with the promise the archive makes

“Full history available” is too broad to accept as an operating requirement. It might mean that a website displays old transactions, that a database contains decoded batches, or that a new rollup node can reconstruct the chain independently. Those services can share infrastructure while requiring different retained information.

Harbor's proposed promise is more precise: given an identified canonical starting checkpoint and a supported software configuration, a separate operator can retrieve the published inputs for a stated block interval and reproduce the expected derived result. The promise includes coverage boundaries and known omissions. It does not claim that an archive alone establishes which checkpoint a user should trust.

This wording forces several decisions before storage is purchased. Is the service preserving raw publication objects, transformed application data, or both? Does it cover every blob in a block or only blobs attributed to a particular rollup? Does its index survive independently of its primary database? How will a consumer distinguish an interval containing no relevant publications from an interval that the collector never inspected?

The last question matters because absence has two meanings. An empty search result could correctly report that nothing was published. It could also hide an interrupted collector. A useful archive returns a coverage statement alongside its objects. Harbor therefore records examined ranges even when those ranges produce zero relevant batches.

The product description should also identify unsupported uses. A transaction search interface may be excellent for customer support while insufficient for independent derivation. Calling the interface an archive without specifying its reconstruction capability transfers an unresolved engineering question to the person who discovers the gap years later.

Keep availability, authentication, and retrievability separate

Ethereum's documentation distinguishes data availability from longer-term retrievability. The former concerns whether data can be obtained when participants need to verify the chain; the latter concerns obtaining that data later. A historical service should make its own retention commitment rather than inherit a perpetual-storage assumption from the phrase “on Ethereum.” Ethereum: Data availability.

EIP-4844 introduced blob transactions with commitments and versioned hashes connected to blob data. The payload is not simply ordinary execution calldata that a contract can read in full. The distinction between a compact reference and the underlying data is central to understanding what an archive must preserve. EIP-4844: Shard Blob Transactions.

For Harbor, authentication and retrieval have separate acceptance tests. A retained payload may be retrievable but wrong, perhaps because its index points at a neighboring object. A valid commitment may be retained while its payload is gone. Neither state fulfills the service promise. The archive needs bytes that can be retrieved and evidence that connects those bytes to the expected publication.

A checksum maintained by the storage service adds another useful but different layer. It can detect a change relative to the archive's own recorded object. It does not, on its own, establish that the original ingestion selected the correct Ethereum publication. Harbor therefore avoids treating “checksum passed” as a synonym for “chain provenance verified.”

This separation also clarifies incident reports. “Object missing,” “object corrupted,” “publication reference inconsistent,” and “decoder rejected verified input” are different failures. Each suggests a different repair. Combining them into a single archive-error count makes the system appear simpler while removing the information an operator needs to recover it.

A retrieval window is a floor, not a deletion appointment

The Deneb networking specification requires support for blob-sidecar requests over a recent epoch range, using a minimum window of 4,096 epochs. With the familiar 32 slots per epoch and 12 seconds per slot, that duration is about 18.2 days. This is a versioned historical specification, not a promise that every node deletes every object at the same instant. Deneb networking specification.

Later protocol designs change the objects and networking responsibilities involved. For example, the Fulu networking specification describes data-column sidecars and its own request-window configuration. An archive implementation must follow the fork and client interfaces applicable to its actual collection interval. Copying a Deneb endpoint assumption into an indefinite runbook is inadequate. Fulu networking specification.

Harbor treats the available retrieval period as a recovery opportunity, not its preferred collection delay. If ingestion stops for a weekend, the remaining recent-data service may allow backfill. That does not justify routinely waiting until the end of the window. Provider outages, rate limits, indexing mistakes, and unsuccessful retries can consume the same margin.

A sensible operational deadline is therefore earlier than the protocol boundary and explicitly chosen by the archive owner. Suppose Harbor decides that every expected publication must have a verified durable copy within two hours, with unresolved gaps escalated the same day. Those are Harbor's service objectives. They are not Ethereum guarantees and should be presented as such.

The owner also needs a response to changes in protocol parameters. A configuration review should compare the collector's assumptions with the specified fork transition before the transition affects the service. The relevant question is whether the archive still collects enough information to fulfill its reconstruction promise, not whether a monitoring graph still increments.

Define the custody package before defining the database

Harbor's custody package has four conceptual parts: publication identity, raw retained material, verification evidence, and interpretation context. They may live in different storage systems, but the export format should reconnect them without relying on a private web interface.

Publication identity locates the relevant Ethereum material. A useful record distinguishes network, block identity, transaction position where relevant, and the particular blob reference. Heights alone are insufficient labels for an archive that may ingest competing branches. The record should make it possible to ask which block the archive believes became canonical and why that judgment changed.

Raw retained material is the actual object needed by the supported recovery process. Harbor does not discard its source object merely because a decoder produced a convenient byte stream. A later investigation may need to repeat verification or inspect an encoding assumption that the first decoder handled incorrectly.

Verification evidence describes the checks performed and the software responsible. A boolean marked “verified” is easy to store and difficult to audit. Recording the verification version, object identity, result, and time makes the assertion more informative. It also allows an operator to identify which objects need rechecking after a verifier defect is discovered.

Interpretation context identifies the rollup configuration and decoder rules used to transform publication data into derivation inputs. The OP Stack's Ecotone specification, for example, describes retrieving a blob against its versioned hash, verifying untrusted data, and applying the specified encoding rules. That is a concrete derivation contract, not a universal decoder for every rollup. OP Stack: Ecotone derivation.

An archive export should identify those dependencies without embedding credentials or machine-specific paths. A consumer who possesses the data but cannot identify its encoding version has received an incomplete handover. Good custody preserves the conditions under which bytes become meaningful, while keeping the original bytes available for another interpretation.

Collect first, classify second, and record both decisions

A rollup-specific archive naturally wants to avoid storing unrelated blobs. Filtering is reasonable, but a filter is also a place where history can disappear. An incorrect address list, configuration boundary, or transaction classifier can silently exclude relevant publications while the storage system remains healthy.

Harbor therefore separates the observation that a block was inspected from the decision that particular material belonged to the rollup. The first record supports coverage. The second supports selection. When the classifier changes, the archive can identify which already-inspected ranges need reconsideration instead of pretending the previous classification was an immutable fact.

The collection process should make partial success visible. Imagine a block with three relevant objects. Two have durable copies and one retrieval timed out. A block-level “processed” flag would conceal the missing third object. Harbor's manifest records expected identities and per-object outcomes, then marks the block complete only when its stated completion rule holds.

Retries should target an identified absence. They should not overwrite a correct object with whatever response happens to arrive last. The ingestion path can compare the recovered material with the expected reference and preserve failed attempts as diagnostic events without promoting them into the authoritative archive.

A recovered gap also needs closure evidence. “Retry succeeded” might mean that an HTTP request returned a body. Harbor's gap closes only after the expected object has been authenticated, stored according to policy, and added to the coverage manifest. The distinction prevents a transient network success from becoming a false historical guarantee.

Canonical history requires a branch policy

An archive may receive material from a block that later stops belonging to the canonical chain. Deleting every such object immediately saves storage but removes evidence useful for diagnosing ingestion behavior. Retaining everything without labels creates the opposite problem: consumers can accidentally assemble inputs from incompatible histories.

Harbor separates retention from promotion. A newly observed object can be stored before its branch status is settled. Its manifest records that provisional state. The canonical export contains the branch chosen under Harbor's documented chain-selection and finality assumptions, while retained alternative material remains explicitly outside that export.

This is a service design, not a replacement consensus algorithm. The archive depends on a correctly configured view of the relevant network. It should record the source of its branch decisions and explain how conflicting observations are investigated. Two endpoints returning the same height are not enough information if they disagree about the block at that height.

A branch change must update the index without destroying the previous mapping's audit trail. Otherwise a future operator may find an object on disk that appears unrelated to any known publication and delete it as waste. Keeping the identity and status history allows storage maintenance to distinguish obsolete data from unexplained data.

The recovery tool should refuse ambiguous requests. If a user asks for a height range without specifying the network or canonical reference, Harbor can require clarification in the machine-readable request. Guessing becomes especially dangerous when test networks, private deployments, and production environments share similar software and numbering.

Give consumers an answer that can be checked

Harbor's retrieval response should distinguish the requested interval from the returned interval. Suppose a consumer requests blocks A through Z and receives complete material for A through M, with one unresolved gap at N. Returning the successful objects is useful. Labeling the response complete is not. The manifest should let the consumer recognize the missing interval without comparing against a private production dashboard.

A compact export index can list object identities, relative locations, verification records, and coverage status. Its own version should be explicit. Harbor also retains a human-readable explanation of the fields so that a future migration does not depend entirely on a library that nobody maintains. Machine readability and understandable meaning are complementary requirements.

Object naming should support transfer between storage systems. A path that encodes only the current provider's internal identifier makes a portable export harder to inspect. Harbor can maintain its provider-specific locations behind a stable logical identity, then regenerate the physical mapping during migration. Consumers ask for publication objects, not a particular vendor's bucket layout.

The response also needs a clear treatment of inaccessible material. Permission denied, object absent, incomplete coverage, and unsupported format should be distinguishable outcomes. This is especially important for automated consumers that might otherwise retry a permanent gap indefinitely. An actionable failure explains which part of the requested promise could not be met and preserves enough context for an operator to investigate it.

Price the retention promise with explicit assumptions

Storage planning becomes useful once the promised unit is clear. Consider an illustrative service retaining 600 MiB of selected source material per day. Thirty days require about 17.6 GiB; 365 days require about 213.9 GiB. These figures count the selected source material only. They exclude indexes, metadata, alternative branches, redundant copies, and storage-system overhead.

If Harbor maintains three complete independent copies, the source-material subtotal becomes approximately 641.6 GiB for a year. Independence is an architectural property, not a multiplier in a spreadsheet. Three replicas under one deletion policy and one compromised administrator can share a failure mode even when the storage bill charges for three copies.

Recovery traffic deserves a separate estimate. Reconstructing a year from an off-site copy might require downloading the whole retained interval. A service with inexpensive storage and expensive retrieval can have an acceptable monthly bill but an unaffordable incident. The budget should include the expected recovery exercise, not only the nominal cost of keeping objects untouched.

Growth assumptions also need a revision trigger. Harbor's 600 MiB figure is invented for the example; it says nothing about a particular live chain. An operator should measure its own selected input volume and track changes in publication frequency, encoding, and coverage scope. A wider promise can increase storage without any increase in user-facing transaction counts.

Retention duration should match the claim made to consumers. If a product promises five years of independent reconstruction, deleting raw inputs after one year while preserving a transaction index does not satisfy that promise. A shorter, explicit service may be entirely reasonable. An undocumented mismatch between sales language and recoverable material is the expensive option.

Restore on a machine that cannot borrow the answer

Harbor's recovery exercise starts with a clean environment that cannot read the production index or local caches. It receives an export, a documented starting point, and the supported software configuration. The operator then retrieves and verifies the archived inputs and attempts the stated reconstruction task.

This isolation is essential. A replay that silently falls back to the live provider may pass because the provider still has the data. A replay that reads an already derived database may demonstrate database backup quality while never exercising blob recovery. The test must expose which sources the tool actually used.

One exercise should select an interval older than the ordinary recent-data service is expected to cover under the applicable versioned rules. Another should target a known prior ingestion interruption. A third can cross a rollup software or encoding transition. The choice of interval should challenge the archive's actual assumptions rather than repeatedly selecting its easiest recent day.

The expected result must be defined before the exercise. Depending on the supported process, that could be a particular derived block identity or another documented deterministic output. A successfully completed command is not itself the scientific or operational result. Harbor compares the result with the agreed reference and investigates every unexplained difference.

The report should include elapsed recovery time, required manual steps, unavailable dependencies, and any external service contacted. These observations reveal practical recoverability. A technically complete archive that only its original author can restore is still a fragile service, especially when the promise extends beyond that person's employment.

Preserve a reference result through software changes

A new decoder release creates two different questions: whether it can process old retained inputs, and whether its output agrees with the previously accepted result. Harbor should keep a small reference collection that crosses meaningful historical boundaries, along with the software and configuration that produced the original outputs. The collection is a regression aid, not a substitute for retaining full coverage.

If a result changes, the archive team should avoid immediately rewriting every stored interpretation. First establish whether the old decoder was wrong, the new decoder is wrong, or the comparison used different starting assumptions. Raw material allows that investigation to remain grounded in the original publication rather than in two opaque databases.

Some migrations can preserve both interpretations while the discrepancy is examined. Harbor can mark one as the supported current export and retain the earlier result for explanation. This is preferable to silently replacing an answer that downstream consumers may already have used. The change record should identify affected ranges and the reason for revision.

The same discipline applies to verification libraries and index rebuilds. A maintenance operation that changes the archive's account of what it possesses is a material event even if no payload file was intentionally edited. A before-and-after coverage comparison can reveal an omitted range, a duplicate identity, or a branch mapping that the migration handled incorrectly. Maintenance is complete when the custody promise still holds under the new tooling, not merely when the deployment finishes.

Inject faults that distinguish the layers

A useful fault exercise removes one index entry while leaving its object intact. Can the manifest detect the missing mapping, and can the operator rebuild it? This tests discoverability rather than payload durability. Losing a search record should not require republishing or recreating data that is already safely retained.

A second exercise corrupts a stored copy while preserving its expected identity. Verification should reject the copy and obtain an authenticated replacement from another retained source. The exercise should also confirm that the repair does not copy the same corrupted material back across every replica before anyone notices.

A third removes a required payload from all test replicas but leaves its commitment and publication metadata. The desired outcome is an explicit unrecoverable-gap report. A system that announces success because the commitment is present has confused authentication evidence with content. Honest failure is the only acceptable result when the required bytes are actually missing.

A fourth supplies valid material with an unsupported interpretation version. Harbor should retain the object and report the unsupported decoder state. Treating this as storage corruption would send responders toward the wrong repair. Treating it as an empty batch could quietly change the derived history.

These exercises are not an argument for elaborate chaos tooling. They are small, controlled tests of the distinctions already present in the custody promise. Each can run against a disposable copy of the archive. The valuable output is a demonstrated response and an understandable recovery procedure, rather than a large count of injected errors.

Transfer the service without transferring private knowledge

Long retention makes organizational handover unavoidable. Harbor's successor needs to know how to enumerate coverage, interpret unresolved gaps, find retained branch material, select a decoder, and reproduce a previous recovery result. Those facts should not require access to a departed employee's messages.

The handover package should identify who can authorize deletion and how retention changes are approved. It should also explain what happens when the service ends. Consumers may need a portable export and a reasonable migration period. A retention promise that depends on an unnamed company's indefinite existence is weaker than a documented exit procedure.

For procurement, the most revealing demonstration is a recovery performed by someone outside the archive team using only the delivered material and instructions. Ask them to choose a historical interval, explain its coverage, authenticate the inputs, and produce the promised output. Their difficulties identify hidden dependencies more clearly than a polished architecture diagram.

Blob history remains available in the long run when someone accepts and fulfills that custody obligation. Ethereum supplies important publication and verification machinery. An archive turns the resulting material into a durable service by preserving the bytes, their provenance, and the practical ability to use them again.

Sources

更多文章