Once the indexer enters the ad sync stage, the ingest metrics are zero for a given provider until the chain is downloaded. It then starts inserting key-values into the store and we see that via ingest throughput metrics.
What we really want is visibility in the ad sync stage.
- Add a Counter that increments for every ad that is being downloaded.
- Add a Counter that increments for every multihash entry IPLD node that is being dowloaded.
This should give us bare minimum metrics to have some visibility into what the indexer is doing.
Eventually, however, we should have tagging for top n providers so that we can answer qualifying questions like "from whom the ads/entries are being downloaded". For now a simple counter will do.
Once the indexer enters the ad sync stage, the ingest metrics are zero for a given provider until the chain is downloaded. It then starts inserting key-values into the store and we see that via ingest throughput metrics.
What we really want is visibility in the ad sync stage.
This should give us bare minimum metrics to have some visibility into what the indexer is doing.
Eventually, however, we should have tagging for top n providers so that we can answer qualifying questions like "from whom the ads/entries are being downloaded". For now a simple counter will do.