GraphOps Update July 2024

Research & Development Core Team Updates
1

:astronaut: Executive Summary

The GraphOps team is excited to share this month’s achievements and updates across our workstreams.

For GraphSeer, we have introduced new resolvers to power comparative data in the app (coming soon!). Additionally, we have unified our backend and frontend into a single monorepo to make cross-cutting feature development more streamlined.

Within Launchpad, we’ve updated various charts and supported the integration of several new releases, including Graph Network Indexer, Graph Node and many blockchain updates. Noteworthy is the hosting of Launchpad Office Hours (LOH) #19, spotlighting Loki v3, and the introduction of the Subgraph Availability Oracle (SAO) chart.

For Graphcast SDK, our team has actively engaged with the Teloxide team to address a memory leak by preventing bundling native-tls.

Indexer Components have been strengthened by the new release of Allocation Optimiser in collaboration with the Semiotic Labs team, introducing a novel optimization mode for Indexers with a large number of allocations.

In Network Operations, we’ve published all current graphprotocol and graphops subgraphs onto the decentralized network. The Graph Monitoring subgraph was also published in the decentralized network.

Happy July everyone :sparkles:

:tada: Looking Back (what was delivered)

GraphSeer (Launch the app)

  • Introduced new resolvers for Quality of Service (QoS) data.
  • Enhanced data resolvers with averages and percentiles for better insights.
  • Unified backend and frontend into a single monorepo.
  • Continued significant codebase improvements, nearing completion.
  • Fixed bugs related to data fetching and subgraph deployments for a smoother user experience.

Launchpad (Documentation, Starter, Charts, Namespaces)

  • Chart updates with nimbus, lighthouse, graph-node, graph-network-indexer, erigon, proxyd, arbitrum-nitro, subgraph-radio, subgraph-availability-oracle, listener-radio and celo all with updated releases
  • Updated arbitrum-nitro and lighthouse chart to handle relabelings in the serviceMonitor
  • Added support for new chart subgraph-availability-oracle
  • Namespaces releases for storage, polygon, ingress, graph, sealed-secrets, monitoring, ethereum, gnosis and arbitrum in addition to all the updated charts
  • Hosted LOH #19 covering Loki v3 Ensuring pods QoS and updates to WIP Firehose chart
Launchpad Development Activity
  • Launchpad Charts pull requests merged:
    • Dependency updates:
      • PR #321, PR #318, PR #305, PR #303: Updated Arbitrum dependencies to improve interaction with the Arbitrum network.
      • PR #320, PR #319, PR #312, PR #298: Updated Erigon dependencies to enhance Ethereum client performance.
      • PR #315, PR #308: Updated Graph protocol dependencies to support the latest features in indexing and query processing.
      • PR #314, PR #304: Updated Lighthouse dependencies to improve Ethereum 2.0 node stability and performance.
      • PR #310: Updated Nimbus dependencies to optimize Ethereum 2.0 consensus client operations.
      • PR #299: Updated Heimdall dependencies to ensure secure and efficient proof-of-stake operations.
      • PR #300: Updated Proxyd dependencies to enhance reverse proxy functionalities for blockchain networks.
    • Features and Refinements:
      • PR #317: Added Sao package to Renovate for automated dependency updates, aiming to maintain our projects with the latest and secure packages.
      • PR #313: Implemented metric relabelings in service monitor to refine and optimize the monitoring of services within our infrastructure.
      • PR #301: Introduced a new chart for the Subgraph Availability Oracle, further enriching our tooling suite for decentralized application development and operations.
      • PR #306, PR #302: Added support for readiness and liveness probes and performed more cleanup to improve the robustness and reliability of our Kubernetes configurations.
  • Launchpad Namespaces pull requests merged:
    • Dependency Updates:
      • Helm Chart updates across various components, ensuring continuous improvement in reliability and performance. Notable updates include:
        • Ingress & Sealed Secrets with PR #810, PR #809, PR #790, PR #789, PR #766, and PR #733
        • Promtail, Loki, and the full monitoring stack including kube-prometheus-stack with a series of PRs like PR #808, PR #801… all the way to PR #729, keeping monitoring sharp and up-to-date.
        • Erigon, Arbitrum, Graph-Node, and other blockchain-related dependencies ensuring high performance and compatibility (PR #806, PR #807 through PR #785, PR #807, PR #748, etc.).
        • Miscellaneous updates such as ZFS local PV, Postgres Operator (PR #775, PR #726), enhancing various backend functionalities and security.
    • General Maintenance:
      - A crucial chore in PR #728, adapting to a new module.cue format to keep the project’s structure in the best possible state for developers to work with.

Indexer Components (Indexer Components, Indexer Service Rewrite, Allocation Optimizer)

  • New release of Allocation Optimiser in collaboration with the Semiotic Labs team, containing new optimization mode ignoring gas assumptions and maximum allocations restrictions. This new mode is best for Indexers making a large number of allocations.
  • Basic implementation of a Knowledge Graph GraphQL query node: This includes the dynamic creation of schema and query resolvers for GraphQL queries based on a graph database. It supports flexible GraphQL types and relationships, plural queries, and argument filters.

Subgraph Radio (Documentation, Docker Image, Radio Crate, Radio Source)

  • Temporarily disabled MacOS workflows, streamlining the CI process
Subgraph Radio Development Activity
  • Subgraph Radio pull requests merged:
    • PR #157: Temporarily disables MacOS workflows, streamlining the CI process.

Graphcast SDK (Documentation, SDK Crate, SDK Source)

  • Chatted with the Teloxide team to figure out how to use their crate in the SDK without it bundling native-tls (which causes a memory leak Issue in the SDK)

Network Operations (Graph Network Subgraph, Graph Network Substreams)

  • Published all currently used graphprotocol and graphops subgraphs onto the decentralized network. (Network subgraphs can be found here)
  • Added support for RebateCollected to Activity Subgraph
  • Reviewed and published Graph Monitoring Subgraph onto the network

Ecosystem Relations

:rocket: Looking Ahead (upcoming priorities)

  • GraphSeer
    • Conclude the refactors
    • Continue addressing user feedback
    • Integrate frontend with new comparative data
  • Launchpad
    • Firehose chart support
  • Network Operations
    • Continue working on QoS Oracle V2 implementation
  • Ecosystem Relations
    • Please join the community for Indexer Office Hours on Tuesday every week at 6pm UTC in the Graph Protocol Discord
3 Likes