Skip to content

Releases: gitphantomman/scraping_subnet

ScrapingSubnet by apify

09 Nov 19:18
Compare
Choose a tag to compare

Changed:

  • We have transitioned from using the Twitter API key to Apify.
  • We no longer use wandb for storage. Instead, we've switched to Wasabi S3 storage, which will now house all scraped data.
  • Validators will now verify the authenticity of scraped data using their own scraper.
  • While miners previously selected the search key, this task will now be performed by validators.
  • We've introduced a new endpoint to facilitate faster access to S3 storage for validators (via an indexing table).