At 0xArc, we haven’t just built an analytics app. We've built data infrastructure to power all our downstream products and their requirements. Through this build, we have the opportunity to open up upstream layers of our data stack for those who want to achieve more custom solutions.

Overview

The 0xArc data stack has 4 major layers to it:

• Ingestion:
  • Pulls EVM data in real-time since genesis from RPC nodes for high redundancy and accuracy
  • Collects data from our Clickstream SDK that’s installed on our customer’s frontends
  • Price data for all assets on Coingecko, since genesis, on an hourly basis
  • Tens of millions of ABIs in our warehouse to ensure our customer’s data is readable
• Interpretation:
  • Compute applied on billions of rows of transactions and logs in an efficient and performant way
  • Complex DBT/SQL pipelines to join and transform all the ingested and decoded data
  • Attributes that help our customers understand more about their users (wallet ages, net-worth etc)
• Consumption:
  • Ensuring that data at every layer of the stack can be exported for different consumer needs
  • Data can be available in BigQuery, Pub/Sub topics, Kafka, Clickhouse and/or Postgres mirror

Chains and Tables Supported

Our infrastructure is chain-agnostic, provided the underlying virtual machine is consistent. At the moment we predominantly support EVM and the following chains:

• Ethereum, Polygon PoS, Base, Arbitrum, Optimism, Binance Smart Chain, Celo

Each chain we support is backfilled since genesis and is being kept-up in real-time. Adding new chains, provided they are standardised to the EVM standard can be added with ease.

All chains are standardised in how they are handled and offer support for the following tables:

• Blocks
• Transactions
  • Raw
  • Decoded
• Logs
  • Raw
  • Decoded
    • Transfers
• Receipts
• Contracts
• Call Traces
• RPC Provider Requests
  • This is an internal table used to determine which node data was sourced from, the latency and the result of the call

All of the tables above are available in real-time (anywhere from 5s to 25s latency, dependent on the table) and can have custom delivery options like pub-sub topics with custom filtering and replay support.

Next Steps

If you’re interested in access to any of the above data sets or delivery methods, please email k@0xarc.io or reach out via Telegram @kermankohli.

‍