Data

For onchain analysis, the limiting factor is often SQL and data plumbing. Researchers end up spending too much time writing queries and moving data between Dune and external APIs. At Blocmates, we solved this with an agent-driven ETL pipeline that automates dashboard production for the research team. You fill out a data spec, the agent writes, tests, and pushes queries to Dune using GitHub for version control. If the spec involves heavy API usage, the agent sets up a GitHub Action to collect data and load it into Dune. Queries are generated in minutes and are then ready for visualization in Dune’s UI. ...

While building the MetaDAO dashboard at Blocmates, @563defi and I spent some time digging into MetaDAO’s launchpad program to understand the existing Dune queries, build on them, and create new ones. These are my notes, which I will be referring back to as I verify & build out more queries on MetaDAO’s activity. This can also be used as context to feed to an LLM for generating simple queries. Hopefully this helps you understand the program structure and verify your queries are pulling the right data. ...