Summary
Another productive month for the Pinax team with lots of improvements to our infrastructure, collaboration with core devs on data services, and plenty of educational content and events.
Looking back (what was delivered)
Provide infrastructure for chains currently supported on The Graph & to support protocol integration with new chains
- Continued to work on adding support for new chains that are on the roadmap for the Chain Integration Process.
- Arbitrum One Firehose and Substreams services are now publicly available.
- Mode RPC, Firehose and Substreams services are now publicly available.
- Ordered new hardware for Solana.
- Delivered a number of infrastructure improvements to enhance performance and reliability for services on the network:
- Added hardware to improve hosted service performance (RPCs)
- Increased storage space to be able to store more RPC snapshots + add Solana Firehose blocks (4.7 PiB in main ceph cluster)
- Reworked helm charts for separating Substreams tier1/tier2
- Upgraded datacentre to 40gb/s networking for ceph
- Changed Firehose Arbitrum index size to 100k
- Sped up Firehose
- Continued adding support for chains currently available on the Hosted Service in support of the Sunrise of decentralized data, and our indexer has begun supporting high demand Subgraphs that have been migrated to the network.
Education, onboarding & community support for Indexers and Developers working with new data services
- We published 4 new YouTube videos:
- Substreams Unleashed: Loading Blockchain Data into ClickHouse w/ Maryam & Syed
- The Graph Espresso Ep4: Massive Sunrise Upgrade Program, Firehose Integrated into Geth & More
- Give Blockchain Data A Fresh Look With This Amazing Tool: Substreams Treemap Demo
- Solange Gueiros Talks Chainlink Labs @ Hack’n Heights Kickoff Event in Berlin [Part 1]
- Pinax is continuing to publish summaries of the Indexer Office hours on our blog every week:
- We published 8 additional new blog posts with educational and promotional content on The Graph and Firehose & Substreams:
- Join the Hack’n Heights Online Hackathon: Unlock Web3’s Incredible Potential
- New Chains Coming Soon to The Graph Network: Mode Network, X Layer, Astar Network, and Blast
- Semiotic Labs Is Bringing SQL Magic to The Graph
- So, You Want to Become an Indexer on The Graph?
- Proven Steps to Become a Valuable Participant on The Graph
- How to Assess and Query Subgraphs on The Graph Network
- Substreams Builders: Spotlight on Thomas Monte and Substreams Triggers
- Arbitrum One Endpoints Now Available
- Contributed to 2 events supporting The Graph ecosystem:
- Organized and sponsored the Hack’N Heights hackathon for Berlin Blockchain week in collaboration with The Graph, Telekom, and Chainlink (see blog post and YouTube video shared above)
- Participated and managed The Graph booth at ETH Prague.
- We continue to support the production of The Graph Builders Office Hours each week.
- We continue to heavily promote The Graph ecosystem on the Pinax X account.
- This month we hosted 2 X Spaces events to promote The Graph Sunrise, along with a meme campaign across our Pinax account and individual team member accounts.
- Our Chinese Chinese community manager, Eleven, is now managing The Graph Chinese communities in Telegram, Discord, and WeChat.
Collaboration with core developers and new consumers on designing and testing new data services while augmenting the Indexer experience with new tooling
- Published Antelope Foundational Substreams Modules
- Foundational modules let developers build substreams modules on top, to minimize bytes billed and improve performance by filtering out non-relevant parts of blocks and by skipping irrelevant chunks of blocks from the stream.
- Collaborating with StreamingFast to bring Firehose & Substreams query fees to the network.
- Pinax indexer has received its first query fee payment in GRT for Firehose & Substreams services on the network.
Looking ahead (upcoming priorities)
Provide infrastructure for chains currently supported on The Graph & to support protocol integration with new chains
- Optimizing our indexer to use multiple shards.
- More RPC nodes for more blockchains to support the chain integration process and the upgrade indexer, in support of the sunrise of data services.
- Solana and others
- OP/Base syncing new blocks
- Test latest Erigon Firehose instrumentation.
Education, onboarding & community support for Indexers and Developers working with new data services
- More documentation on Firehose & Substreams.
- More videos and blog content.
Collaboration with core developers and new consumers on designing and testing new data services while augmenting the Indexer experience with new tooling
- Load testing Substreams data into ClickHouse (including changes to substreams-sink-sql).
- Continue working on CSV/Parquet sink.
- Kubernetes-Launchpad: storage/monitoring/etc rollout.
- Continue to explore hosting rollup chains for Geo.
- Geo data service development - integrating with indexer stack.
- Test verifiable Firehose.
- Determine Architecture for Substreams:SQL.
- Working on integrating Kafka into StreamingFast payment gateway to make this more reliable.
- Understand Semiotic “Optimus + Elric” stack.
- Antelope Spring v1 Firehose development and testing.
- Testing token API performance with ClickHouse.