Summary
Proponent: <a href="https://polkadot.subscan.io/account/13bfKSQXoBn3AMLtZaW6BKv797fqZzsD3PYF6xpJDir3tdoE" target="_blank" rel="noopener">Subsquid Lab Official</a> - 13bfKSQXoBn3AMLtZaW6BKv797fqZzsD3PYF6xpJDir3tdoE Beneficiary: <a href="https://polkadot.subscan.io/account/13bfKSQXoBn3AMLtZaW6BKv797fqZzsD3PYF6xpJDir3tdoE" target="_blank" rel="noopener">Subsquid Lab Official</a> - 13bfKSQXoBn3AMLtZaW6BKv797fqZzsD3PYF6xpJDir3tdoE
Contact Details: Subsquid Labs GmbH 6300 Zug, Switzerland <a href="mailto:mf@subsquid.io">mf@subsquid.io</a>
Short description: Ongoing development and maintenance costs for public SQD Archives
Archive raw data: Archive Infrastructure Metrics - <a href="https://docs.google.com/spreadsheets/d/17ueNw0-X_DVckSd_qmFwGa2mN3oilEWaCac7m3zY9KU/edit?gid=1549354589#gid=1549354589">July, August, September </a>
Requested: $310,592.98
Previous proposals: <a href="https://polkadot.polkassembly.io/referenda/1447" target="_blank" rel="noopener">https://polkadot.polkassembly.io/referenda/1447</a>
Motivation 
A) Archives
Archives are an important piece of Polkadot and Kusama data infrastructure provided by SQD (formerly Subsquid). They provide access to on-chain data for public chains in the Polkadot ecosystem. They are being used as a data source for <a href="https://www.sqd.ai/cloud" target="_blank" rel="noopener">Squids</a> and for efficient data exploration and ad-hoc queries. The Archives, as performant data sources of historical on-chain data, are critical to the operation of backend APIs run by major projects in the Polkadot ecosystem.
Popular Polkadot dApps and projects that depend on SQD include the following:
<ul>
<li>Tanssi Network</li>
<li>Talisman Wallet</li>
<li>Polimec</li>
<li>Polkassembly</li>
<li>Apillon</li>
<li>Hydration</li>
<li>Giant Squid API (maintained by LimeChain)</li>
<li>SubWallet</li>
<li>FiDi</li>
<li>KodaDot</li>
<li>RMRK</li>
<li>ChainSafe (in particular the Multix multi-sig, as well as other projects)</li>
<li>Phala Network</li>
<li>Stellaswap</li>
<li>Polkascan</li>
</ul>
Since the beginning of 2024, SQD has transitioned to a paid model for supporting parachains. However, public chains continue to be available for free use. Throughout the Q3 of 2024, we provided a free public data indexing service for Substrate blockchains, allowing interested parties to access indexed data on Substrate Events, Extrinsics, Storage Items, and EVM logs. Below is a list of the public chains we currently support at no cost:
<ul>
<li>polkadot</li>
<li>kusama</li>
<li>asset-hub-kusama</li>
<li>asset-hub-polkadot</li>
<li>bridge-hub-polkadot</li>
<li>collectives-polkadot</li>
<li>rococo</li>
<li>westend</li>
</ul>
B) Contribution
During Q3 2024, we addressed real-world use cases that were highly requested by the community:
<ul>
<li>Supported Substrate extrinsic v5, enhancing compatibility for newer Substrate-based chains.</li>
<li>Updated squid templates to the new data decoder interface.</li>
</ul>
Achievements
Increase in Archival Data Demand and Infrastructure Scaling
During Q3&rsquo;24, archival data demand increased approximately 3.6 times, from 3,265 GiB in Q2 to 11,713 GiB in Q3. We addressed the increasing demand for archival data by enhancing our infrastructure's throughput and redundancy through deploying archives to OVHCloud in addition to GCE, while also empowering our maintenance and engineering teams to support the expanded infrastructure effectively.
Decentralization of the SQD Network Enhancing the Polkadot Ecosystem:
In Q3&rsquo;24, we continued to empower the SQD Network, driving forward our mission to strengthen the Polkadot ecosystem&rsquo;s decentralization and resilience. By the end of the quarter, the SQD network had grown to include 1139 active Worker Nodes, securely storing 574TB of data and serving approximately 11TB of data per day. This expanding decentralized infrastructure enhances data processing and storage capabilities, delivering increased security, fault tolerance, and scalability for the Polkadot network.
Statistics and data
<img src="https://i.ibb.co/C3rjjhx6/Screenshot-2025-04-16-at-15-27-17.png" alt="" width="640" height="381" />
&nbsp;
Over the course of Q3 2024:
<ul>
<li>Served a total of 12,576,410,498,732 (~11.44 TiB) of data from the substrate based archives.</li>
<li>Served 979,736 archive requests from substrate based archives.</li>
<li>The highest daily total data transfer recorded for Substrate was 375.57 GiB within a single 24-hour period (2024-09-19).</li>
</ul>
Costing
This proposal encompasses the combined costs for running Archives for Polkadot, Kusama, and other public chains, along with the development contributions, amounting to a total of $310,592.98.
<a href="https://docs.google.com/spreadsheets/d/17ueNw0-X_DVckSd_qmFwGa2mN3oilEWaCac7m3zY9KU/edit?gid=466566330#gid=466566330" target="_blank" rel="noopener">Raw data for Archives can be seen here.</a>
The proposal is submitted towards the Polkadot treasury. Here is a summary of the running costs for Archives, in a tabular format:
<img src="https://i.ibb.co/390Kk1yp/costing-archives.png" alt="" width="640" height="378" />
Contribution costs:
<img src="https://i.ibb.co/d4NZZ3XF/costing-contribution.png" alt="" width="639" height="233" />

Propose and approve a spend of treasury funds.

## Dispatch Origin

Must be [`Config::SpendOrigin`] with the `Success` value being at least
`amount` of `asset_kind` in the native asset. The amount of `asset_kind` is converted
for assertion using the [`Config::BalanceConverter`].

## Details

Create an approved spend for transferring a specific `amount` of `asset_kind` to a
designated beneficiary. The spend must be claimed using the `payout` dispatchable within
the [`Config::PayoutPeriod`].

### Parameters
- `asset_kind`: An indicator of the specific asset class to be spent.
- `amount`: The amount to be transferred from the treasury to the `beneficiary`.
- `beneficiary`: The beneficiary of the spend.
- `valid_from`: The block number from which the spend can be claimed. It can refer to
  the past if the resulting spend has not yet expired according to the
  [`Config::PayoutPeriod`]. If `None`, the spend can be claimed immediately after
  approval.

## Events

Emits [`Event::AssetSpendApproved`] if successful.

- **Problem Statement:** 
  - Ongoing development and maintenance costs for public SQD Archives.

- **Significance:** 
  - Archives are crucial for providing historical on-chain data for projects in the Polkadot ecosystem, supporting popular dApps and backend APIs.

- **Proposed Solution:** 
  - Requesting $310,592.98 for running Archives for Polkadot, Kusama, and other public chains, including development contributions.

- **Expected Outcomes:** 
  - Enhanced infrastructure scaling, decentralization of the SQD Network, and increased data processing capabilities for the Polkadot ecosystem.

#1526 SQD (fka Subsquid) - Public Data Indexing Infrastructure for Polkadot and Kusama (Q3 2024)

No Active Proposals