The Graph + Singer = Blockchain data pipeline!

I’ve been doing a lot of work with blockchain data recently and I wanted a way to incorporate The Graph into a web2 data pipeline…so I built it.

A bit of background: Singer is an open-source spec for writing data extraction scripts (taps) and data loading scripts (targets). The idea is that any tap is compatible with any target, so you don’t need to roll your own script if one already exists for your source / destination!

I wrote a tap for The Graph so now you can load entities from subgraphs into Postgres, Snowflake, MongoDB, CSV, etc. or any other destination with a Singer target.

I wrote a blog post about it and put the tap on GitHub.

Feel free to try it out and let me know if you have any feedback!

2 Likes