ByAUJay
title: "From Blockchain APIs to Verifiable Data Feeds: Building Trustworthy Data Pipelines" description: "A 2025 field guide for decision-makers: how to evolve from brittle API calls to cryptographically verifiable, low-latency, multi-source data pipelines—spanning Chainlink Data Streams and State Pricing, Pyth OIS and Entropy v2, API3’s OEV Network, UMA’s Optimistic Oracle, TLS-based web proofs, EAS attestations, and ZK co-processors."
Modern onchain products live or die on data quality. In 2025, “using an API” is table stakes; the differentiator is end‑to‑end verifiability, latency tuned to your market, and an operational model that survives volatility and exploits value recapture. This practical guide shows how startups and enterprises can graduate from centralized API glue to verifiable, resilient data pipelines—what to use, when, and why.
TL;DR (for busy decision-makers)
- Low-latency markets (perps, HFT DeFi) should evaluate pull-model oracles (e.g., Pyth Core pull, Chainlink Data Streams) with onchain signature verification and circuit breakers. Sub‑second update paths and signed reports are now production patterns. (docs.pyth.network)
- Tokenized assets (RWAs) need provenance and audit-grade attestations (NAV, PoR) plus identity gating. In 2025, Securitize named RedStone its primary oracle partner for funds like BlackRock BUIDL and Apollo ACRED; pair such feeds with verifiable attestations (EAS, VCs 2.0) and cross-chain movement via an interoperability layer. (cointelegraph.com)
- Lending and liquidation-heavy apps can claw back oracle-driven MEV via API3’s OEV Network (and watch current transition notices), turning cost centers into protocol revenue. (blog.api3.org)
The rest of this post dives into concrete architectures, emerging best practices, and decision frameworks you can adopt this quarter.
What changed in 2024–2025: the new primitives you can use now
- Chainlink Data Streams went from niche to broadly available across more chains in 2025 (Ethereum, HashKey, Ronin, BNB Chain, Hedera, and more), delivering low-latency signed reports you can verify onchain. Chainlink also introduced State Pricing for DEX‑traded and long-tail assets, and a beta OHLC Candlestick API; Streams now supports hundreds of assets on a single low‑latency DON with >50% cost reductions since early 2025. (dev.chain.link)
- Pyth expanded pull and push price feeds across 100+ chains, rolled out Oracle Integrity Staking (OIS) to align publishers and stakers with data accuracy, and shipped Entropy v2 (configurable gas limits, better callback telemetry) for RNG. Production defaults and sponsored feed heartbeats/deviation thresholds are now documented per chain. (docs.pyth.network)
- API3 launched the OEV Network—a rollup-native auction layer for oracle updates that returns oracle extractable value to the dApp—already integrated by lending protocols across chains. Note: the public OEV Network and Auctioneer are undergoing a 2025 transition; partners continue via curated searchers and funds must bridge out by end of November 2025. (blog.api3.org)
- UMA’s Optimistic Oracle advanced with governance/security tweaks (e.g., higher settlement thresholds) and managed-proposer modes for specific integrations, while surpassing $30B in total transaction value secured—useful when “truth” is subjective or arrives offchain (governance outcomes, disputes, assertions). (outposts.io)
- Verifiable web data matured: TLSNotary’s modern MPC‑TLS stack provides portable proofs that a given HTTPS response came from a named host—crucial for NAV, compliance, or enterprise API assertions—alongside performance wins in 2025 benchmarks. (tlsnotary.org)
- Attestations standardized: W3C’s Verifiable Credentials 2.0 became a W3C Recommendation (May 15, 2025). Pair VCs with EAS (on/offchain attestations) for composable trust in identity, eligibility, and provenance. (w3.org)
- Indexing is decentralized by default: The Graph fully migrated from hosted to network (Sunrise 2024) and continues to scale Subgraphs/Substreams across new chains; Q1 2025 saw 6.14B queries and >12k active subgraphs, with Arbitrum migration lowering costs. This matters when your “verifiable feed” must reference provable on‑chain histories efficiently. (messari.io)
- ZK co-processors real-time race: Succinct’s SP1 Hypercube demonstrated sub‑12s real‑time Ethereum block proving; RISC Zero and Axiom/OpenVM push verifiable compute that you can compose with oracle pipelines for heavy offchain analysis plus onchain proofs. (blog.succinct.xyz)
- Compliance signaling: Chainlink obtained ISO 27001 and SOC 2 Type 1 (Aug 21, 2025) across Price Feeds/SmartData and CCIP—useful for enterprise procurement checklists. (blog.chain.link)
Architectures that work in production (with 2025 details)
1) Low-latency market data for perps/HFT DeFi
When your liquidation engine or risk checks must run at HFT cadence:
- Core pattern:
- Offchain stream subscription (WebSocket/REST) to low-latency oracle (e.g., Chainlink Data Streams or Pyth Core pull).
- Include the signed report in your transaction calldata; verify onchain against the verifier contract (Streams Verifier Proxy) or Pyth’s onchain verification, then execute. (docs.chain.link)
- Why now:
- Streams expanded to Ethereum, BNB Chain, Ronin, Hedera, HashKey, etc., with onchain verification libraries. Pyth’s pull default is optimized for latency (docs recommend pull for most apps). (dev.chain.link)
- Price methodology matters:
- For long‑tail or DEX‑native assets, consider Chainlink State Pricing (end‑of‑block pool state across vetted DEXs, with liquidity/volume weighting and outlier filters), now available as push (Feeds) or pull (Streams). This mitigates flash‑loan spikes by using state prices and multi‑pool aggregation. (blog.chain.link)
- Safety rails you should implement:
- Dual‑source lookups (e.g., Streams + Pyth) with quorum logic, staleness/heartbeat guards, and deviation circuit breakers that halt trading on abnormal deltas.
- Programmatic OHLC: Chainlink’s Candlestick API (beta) provides multi‑timeframe OHLC from Streams; align timeframes with your funding/mark logic to avoid skew. (blog.chain.link)
- Example parameterization:
- Pyth sponsored feeds often use 60 min heartbeat / 0.5–1.0% deviation on EVM chains; override by actively pushing updates or sponsoring tighter thresholds for your pairs. (docs.pyth.network)
2) Tokenized fund NAVs and RWA feeds you can defend to auditors
NAVs and real‑world metrics typically come from a single authoritative source—traditional market “aggregation” doesn’t apply.
- What’s different in 2025:
- Securitize named RedStone its primary oracle partner for tokenized funds (e.g., BlackRock BUIDL, Apollo ACRED). RedStone publishes NAV and daily rates on Ethereum and other networks, enabling DeFi composability (e.g., MMFs as collateral) while preserving authoritative source control. (cointelegraph.com)
- Trust model patterns that hold up:
- “Trusted Single Source Oracle” (TSSO): publish signed proofs that the NAV originated at the fund admin; combine with onchain verification and tamper‑evident storage. RedStone/Securitize published a model for NAV provenance to avoid post‑publication manipulation. (coindesk.com)
- Chainlink SmartData (Proof of Reserve / NAV) also exists under the Chainlink data standard and benefits from ISO/SOC2 scope; evaluate where dual‑publishing reduces operational risk. (blog.chain.link)
- Identity and eligibility:
- Use W3C Verifiable Credentials 2.0 for investor eligibility/KYB claims and EAS (Ethereum Attestation Service) to anchor allowlists (e.g., “address X is qualified investor until YYYY‑MM‑DD”). Both onchain and offchain attestations are supported, at scale (EAS reports 8.7M+ attestations). (w3.org)
- Interop at the fund layer:
- Securitize runs Wormhole for cross‑chain share class mobility (Jan 28, 2025); design your oracle verification to be chain‑agnostic and bridged safely. (prnewswire.com)
3) Verifiable web data (APIs) without trusting a middleman
When you must prove “this JSON came from api.example.com at time T”:
- TLSNotary (MPC‑TLS) lets a Prover obtain a portable proof that a HTTPS response was delivered by a named host, with selective disclosure. Current stack supports TLS 1.2, with onchain‑verifiable formats on the roadmap—use offchain verification plus onchain commitments today. 2025 saw significant performance gains via QuickSilver IZK backend. (tlsnotary.org)
- Implementation blueprint:
- Have your service obtain TLSNotary proofs of NAV/API responses, store proof commitments (e.g., IPFS + hash onchain), and issue an EAS attestation that binds the hash to a schema (“NAVReport v1”). Consumers can fetch the proof, verify offchain, and rely on the onchain attestation in contracts.
- When you also need heavy transforms:
- Use a ZK coprocessor for verifiable compute on large inputs (e.g., RISC Zero Bonsai, Succinct SP1). Keep raw provenance via TLS proof; publish a succinct onchain proof of the computed metric (e.g., covenant checks on NAV components). (dev.risczero.com)
Decision framework: choosing the right tool for each job
| Problem | Fit in 2025 | Why it’s different now |
|---|---|---|
| Perps/low-latency markets | Chainlink Data Streams (pull, signed reports) or Pyth Core pull; optional state pricing for DEX-heavy assets | Sub‑second feeds, onchain verification, and DEX state pricing reduce manipulation windows vs. 2022‑era designs. (docs.chain.link) |
| Blue‑chip lending markets | Push oracles (Chainlink Feeds, Pyth push, RedStone push), with conservative heartbeats/deviation and circuit breakers | Mature patterns; add a secondary pull source for liveness and lower time-to-recovery. (docs.pyth.network) |
| Liquidations/MEV leakage | API3 Oracle Stack + OEV Network | Converts oracle updates into auctions; proceeds go back to the dApp; mind 2025 migration. (blog.api3.org) |
| Subjective or slow‑resolving truth | UMA Optimistic Oracle | Scales where cryptographic proofs don’t exist; improved security thresholds and managed modes. (outposts.io) |
| RNG | Chainlink VRF v2.5; Pyth Entropy v2 | Both production: VRF v2.5 adds native‑token billing; Entropy v2 adds gas control and better telemetry. (blog.chain.link) |
| Identity/eligibility/rate limits | W3C VC 2.0 + EAS attestations | VC 2.0 is now a W3C Recommendation; EAS offers on/offchain schemas at scale. (w3.org) |
| Verifiable web/API data | TLSNotary | Portable proofs of HTTPS content origin with selective disclosure; 2025 perf upgrades. (tlsnotary.org) |
| Historical onchain analytics as inputs | The Graph Subgraphs/Substreams | Fully decentralized indexing; multi‑chain; Q1 2025 usage/scale. (messari.io) |
| Heavy offchain compute with onchain guarantees | ZK coprocessors (Succinct SP1, RISC Zero Bonsai, Axiom/OpenVM) | Real-time proving is emerging; production patterns are composable with oracle pipes. (blog.succinct.xyz) |
Implementation playbooks (with numbers you can copy)
A) Streams + Pull-verified pricing (fast perps)
- Ingest: Subscribe to Streams via WebSocket; keep a 1–5 second sliding window.
- Transact: Include latest signed report with txn; verify in EVM against the network’s Verifier Proxy; execute trade/liquidation in the same call. (docs.chain.link)
- Parameters we deploy:
- Max staleness: 1–2 seconds (block‑aligned).
- Deviation guard: halt > X% delta vs. rolling LWBA or cross‑source.
- Fallback: Pyth pull with immediate onchain verify; if both fail, freeze the market.
- Bonus: If your asset is DEX‑only, use State Pricing rather than sparse trade prints. (blog.chain.link)
B) RWA NAV feed with provable provenance
- Source: Fund admin publishes NAV to a known endpoint; obtain TLSNotary proofs; upload proof commitments; publish oracle update (RedStone NAV or Chainlink SmartData). (coindesk.com)
- Policy: Only accept NAV updates that (1) carry a valid TLS proof hash bound via EAS to your schema; (2) are signed by your chosen oracle keys; (3) pass time windows (e.g., D‑1 23:59:59 UTC).
- Eligibility: Gate mint/redeem via VC 2.0 claims (accredited, jurisdiction) proven offchain and attested onchain (EAS). (w3.org)
- Interop: If shares bridge across chains (Wormhole), validate remote attestations plus oracle update inclusion proofs. (prnewswire.com)
C) Liquidations with OEV recapture
- Oracle: Use API3 first‑party dAPIs; enable OEV Network to auction update rights at high‑value moments (liquidations). (blog.api3.org)
- Accounting: Route auction proceeds to your protocol treasury or a reserve that subsidizes user rates.
- 2025 note: Follow API3’s transition guidance; if using public OEV chain, bridge funds out by end‑Nov 2025 and work with partnered searchers while upgrades complete. (docs.api3.org)
Emerging best practices we deploy for clients
- Treat “oracle” as a portfolio, not a product:
- Combine push and pull; keep at least one fully independent verification path (e.g., Streams + Pyth pull); use The Graph for onchain context (LP depth, volatility regimes) that informs when to widen thresholds. (docs.pyth.network)
- Specify methodology, not just a vendor:
- For long‑tail assets, mandate state‑price or liquidity‑weighted methodologies; document pools, weightings, and outlier policies. Chainlink published State Pricing details you can mirror in a runbook. (blog.chain.link)
- Add liveness SLOs that match chain physics:
- Tie SLOs to block times and expected report cadence; e.g., “≥99.9% of updates within 2 blocks, <1s median delay.” Streams lists verifier addresses per network; Pyth docs specify when to choose pull vs push. (docs.chain.link)
- Capture value you’re leaking:
- If liquidations are competitive on your app, you’re likely losing value to searchers. OEV auction mechanisms are now turnkey for API3 users; budget the integration (and note the current migration). (blog.api3.org)
- Prefer attestations over allowlists:
- Use EAS schemas for “who may do what” (role‑based permissions, credit lines); your risk/compliance team can rotate attestations without redeploys. VC 2.0 ensures portability across vendors. (attest.org)
- New RNG defaults:
- For games/lotteries, migrate to VRF v2.5 (native‑token billing; easier upgrades) or Pyth Entropy v2 (custom gas limits, better error reporting). (blog.chain.link)
- Vendor governance and compliance matter:
- Chainlink’s ISO 27001 + SOC 2 Type 1 (Aug 21, 2025) can accelerate enterprise procurement; ask others for equivalent controls or compensating design. (blog.chain.link)
Deep‑dive notes by provider (what’s actually new)
- Chainlink
- Data Streams expanded networks and tooling; verify onchain via Verifier Proxy; Automations can trigger pulls. State Pricing targets DEX‑native assets; Candlestick API (beta) supports OHLC visualization and analytics. Formal certifications (ISO/SOC2) now cover Data Feeds/SmartData and CCIP. (dev.chain.link)
- Pyth
- Core/Pro catalog has 1300+ feeds marketing claim; docs emphasize pull as default for low latency; OIS economically aligns publishers/stakers, with Messari tracking OIS growth in 2025; Entropy v2 improves DX. Sponsored feed heartbeats/deviations are posted per chain. (pyth.network)
- API3
- First‑party dAPIs + OEV Network (Arbitrum Orbit rollup) turn liquidation MEV into protocol revenue. Note the 2025 change window (no public Auctioneer; partnered searchers; funds off network by Nov 2025). (blog.api3.org)
- UMA
- Raised SPAT threshold, added managed‑proposer mode for some integrations, and passed $30B TTV. Use when outcomes are disputed or context‑heavy (beyond numeric prices). (outposts.io)
- EAS + VCs
- EAS gives on/offchain attestations with growing network stats; use VC 2.0 to exchange credentials across orgs and apps. (attest.org)
- TLSNotary
- Production‑grade MPC‑TLS proofs of web data; 2025 benchmarks show throughput/latency improvements. Use for NAV/API provenance, privacy‑preserving selective disclosure. (tlsnotary.org)
- The Graph
- Full network migration complete; multi‑chain Subgraphs/Substreams with billions of queries per quarter; cheaper on Arbitrum; strong for deterministic onchain histories feeding your models. (messari.io)
- ZK Coprocessors
- Succinct SP1 Hypercube achieving sub‑12s block proving; RISC Zero Bonsai provides hosted proving; increasingly practical to combine with oracle data for verifiable analytics. (blog.succinct.xyz)
A 60‑day rollout plan (what we execute for clients)
- Week 1–2: Requirements capture
- Latency budget (e.g., ≤2 blocks), chains, assets, identity/eligibility constraints, compliance requirements (SOC/ISO), and MEV profile.
- Week 3–4: Design & proofs‑of‑concept
- Implement dual‑source pipeline: Streams pull + Pyth pull; onchain verification; The Graph Substreams for onchain context; EAS schemas for roles/eligibility; TLSNotary prototype for any web/NAV provenance. (docs.chain.link)
- Week 5–6: Hardening
- Circuit breakers, staleness/deviation guards, kill‑switch runbooks, chaos tests under spiky volatility; optionally wire API3 OEV for liquidation paths (if lending). (blog.api3.org)
- Week 7–8: Compliance & go‑live
- Document pricing methodologies (State Pricing vs. trade‑based), EAS schemas, VC trust frameworks, and vendor controls (e.g., Chainlink ISO/SOC2). Run phased rollouts by asset risk tiers. (blog.chain.link)
Common pitfalls (and fixes)
- Single‑source complacency: Relying on one oracle or one methodology (e.g., mid‑price only) invites correlated failure. Fix: configure heterogeneous feeds and methodologies; run active health checks with automatic failover.
- Underspecified data contracts: “BTC/USD price” is not enough. Define: aggregation windows, liquidity filters, pool sets, outlier rejection, and update semantics (push/pull/verify).
- Ignoring MEV economics: If your design leaks value at liquidation time, you’ll feel it in PnL. Fix: integrate OEV auctions where supported; otherwise, redesign liquidation incentives.
- Treating identity as static allowlists: Rotate to attestations/VCs so compliance can change policy without deploys.
Final word
The stack to build trustworthy, fast, and auditable onchain data pipelines is here—and it’s markedly better than even 18 months ago. If you’re still polling APIs and trusting screenshots, you’re behind. Design for verifiability at every hop: publisher incentives (OIS), cryptographic proofs (Streams/Pyth signatures, TLSNotary), standardized attestations (VCs/EAS), and verifiable compute where needed (ZK coprocessors). Then instrument for MEV recapture and compliance.
If you want help mapping this to your roadmap, 7Block Labs ships these architectures in weeks—not quarters.
Like what you're reading? Let's build together.
Get a free 30‑minute consultation with our engineering team.

