GraphOps Update October 2024

:woman_astronaut: Executive Summary

We are excited to share this month’s achievements and updates across our workstreams!

For Launchpad, we’ve rolled out additional canary versions of the firehose-ethereum chart, integrated Scalar TAP support into the latest stable release of the Graph Namespace, and released new stable versions of both Charts and Namespaces. Additionally, we hosted an Indexer Office Hours session to introduce the new firehose-ethereum chart.

GraphSeer has introduced Subgraph ID search support, fixed various bugs, and improved performance through dynamic load testing. Our team has also been working on UI improvements.

Network Operations saw a hotfix for the Core Network Subgraph and the removal of pruning to ensure data integrity.

Additionally, our team had a productive and exciting time together during the recent offsite, collaborating with other Core Developers and advancing several key initiatives.

Happy October everyone :sparkles:

:tada: Looking Back (what was delivered)

Kubernetes Launchpad (Documentation, Starter, Charts, Namespaces, Taskfiles)

  • Chart updates released for Erigon, Arbitrum-Nitro, Lighthouse, Celo, Nimbus, Heimdall, and Graph-Network-Indexer, all with stable versions.
  • New stable versions for Namespaces: Ethereum, Gnosis, Polygon, Arbitrum, Celo, Graph, Monitoring, and Ingress.
  • Scalar TAP support now exists across charts (graph-network-indexer) and namespaces (graph).
  • Released more canary versions of the firehose-ethereum chart (applicable to all fireeth-based chains).
  • Conducted an IOH session to present the new firehose-ethereum chart we have been developing.
Kubernetes Launchpad Development Activity
  • Launchpad Charts pull requests merged:
    • #390, #386, #375, #378, #377, #373: Enhanced workflow configurations with new triggers and input parameters; improved dependency versioning for various services; addressed stability and performance issues with action updates.
    • #384, #381, #371: Updated graph dependencies to newer versions with enhanced performance and stability across various packages.
    • #383: Implemented dynamic command configuration for the indexer service in Helm chart and updated the README for better clarity.
    • #380, #379, #364: Enhanced Firehose Ethereum configurations and monitoring capabilities; streamlined JWT management; improved component identification and command customization in Kubernetes.
    • #372, #370, #369, #365, #357: Improved dependency management rules, addressed versioning issues, simplified configuration settings, and updated documentation for better clarity and usability.
    • #356, #352: Updated Erigon dependencies to the latest versions and improved release notes for clarity.
    • #353, #355: Renamed the Helm chart from Firehose EVM to Firehose Ethereum and introduced support for a genesis file to enhance deployment flexibility.
  • Launchpad Namespaces pull requests merged:
    • #992: Enhanced connectivity by updating WebSocket URL for the Erigon backend, expanded API support, and established a 16TB database size limit; resolved a WebSocket port number issue.
    • #939, #952: Updated Arbitrum network configurations for indexer components and corrected the Ethereum endpoint URL for proper connectivity.
    • #940: Introduced zero-install support for Yarn and enhanced Node.js module loading; improved contributing guidelines and updated dependencies.
    • #965, #967, #938: Updated various monitoring dependencies and patched versions for improved performance (kube-prometheus-stack, Loki, etc.).
    • #981, #944: Updated polygon and Ethereum dependencies for the Erigon package (0.10.6).
    • #947, #946, #948: Improved indexing and graph toolbox functionalities with patch updates.
    • #949, #951: Updated Celo and Arbitrum dependencies with new features and improvements.
    • #975, #982: Continued updates on polygon and Gnosis dependencies, enhancing patch versions and library functionalities.

Network Operations (Graph Network Subgraph, Graph Network Substreams, Graph Activity Subgraph, Network Monitoring Subgraph, Network Analytics Subgraph)

  • Hotfix for Core Network Subgraph to prevent a crash on a Curation edge case.
  • Removed pruning for safety reasons, ensuring data integrity, and triggering a full resync to maintain consistency.
Network Operations Development Activity
  • Graph Network Subgraph pull requests merged:
    • #272: Removed pruning for safety reasons and triggered a full resync.
    • #273: Updated scripts for improved functionality.

GraphSeer.com (Launch the app)

  • Added support for searching by Subgraph ID.
  • Fixed a bug where delegation balance was wrong for some graph accounts.
  • Fixed a visual bug on Indexer Stake chart.
  • Indexer performance averages are now weighted by query count.
  • UI fixes and updates.

Ecosystem Relations

:rocket: Looking Ahead (upcoming priorities)

  • Kubernetes Launchpad
    • Continue testing and refining the firehose-ethereum chart.
    • Add namespace support for Firehose EVM chains.
    • Continue updating the Graph Namespace with improvements related to TAP support as new versions of the graph-network-indexer are released.
    • Onboard the Pinax team to start contributing to the Launchpad stack.
  • Network Operations
    • QoS Oracle V2 MVP readiness.
    • Network Subgraph work for Horizon support.
  • GraphSeer
    • Production release with fixes and UI improvements.
    • Continue working on UI improvements.
  • Ecosystem Relations
    • Please join the community for Indexer Office Hours on Tuesday every week at 6pm UTC in the Graph Protocol Discord.
3 Likes