Indexer Performance Workshop

Questions & Feedback Feedback
1

Thinking about workshops for the following months, I would love to know if #participants:indexers would be interested in having an Indexer Performance Workshop, and what topics it should include :slight_smile:

9 Likes
2

These are some of the specific questions i had about performance :

  • How to identify bottlenecks in the overall indexer setup ?
  • How to speed up indexing ?
  • What’s the best performance metrics ?
  • Is “blocks processing” an accurate performance indicator ? Why is it just below 120 on OpenEthereum and just below 60 on TurboGeth, bizarly a factor 2 ? While simple 5 min interval measurements of how many blocks are indexed, shows them much closer ?
  • How to asses a setup’s capacity for handling real-world queries and which tweaks / improvements can be made to increase capacity ?
  • Does indexing more than one subgraph at the same time over the same infrastructure (indexer, ETH archive) slow down the speed at which it happens ?
12 Likes
3

I’d like to see a workshop that covers the lessons learned on hosted. It could be broken up by indexing component:

  • INDEXING: Optimising ethnode -> graph-node performance
  • INDEXING: Optimising graph-node -> database performance
  • SERVING QUERIES: Optimising query-node -> database performance
  • OPS: Top metrics monitored on hosted
  • PERFORMANCE ENGINEERING: Top ten performance issues on hosted and how they are mitigated
  • ANECDOTES: Hosted war stories

will edit and add more if they come to mind.

10 Likes
4

Yes, would love a workshop like this.

Would echo all the topic suggestions given by @cryptovestor and @Koen.

3 Likes
5

Hey @cryptovestor , that sounds awesome. However, I think an end to end guide on getting setup as an indexer is something else we need.

2 Likes
6

Agreed - would you create a post making the request then we can flesh out what it would look like?

1 Like
7

Sure @cryptovestor, will do.

2 Likes
8

Would like to see this also, adding the topic to the already brought up ones;
PERFORMANCE: comparing bare metal and docker/kubernetes setups, when to choose what

2 Likes
9

I would love a better understanding of the gateway selection if possible, especially stuff like this to be explained how and why it happened.

3 Likes
10

+1 for Speed up Indexing for subgraph. :grimacing:

2 Likes
11

Maybe not related to performance, but a session on monitoring and alerts would be handy.

4 Likes
12

Could be interesting indeed, but yeah, i’d suggest making that different workshop. Feel free to make a fresh thread proposing this. :grin:

1 Like
13

Adding to @Koen’s msg, @DAppsDeFiCrypto it would be great that when you create a new thread for this proposal to include details or questions (maybe even a detail of what you already have in place?) for context to kickstart the conversation :slight_smile:

2 Likes
14

done

:slightly_smiling_face:

1 Like
15

Any update on this workshop ? I’d love to gain understanding of performance & tuning. @martintel

1 Like
16

Indexers expressed a lot of interest for this workshop in this week’s Office Hours :relaxed:

7 Likes