Changed:
- We have transitioned from using the Twitter API key to Apify.
- We no longer use wandb for storage. Instead, we've switched to Wasabi S3 storage, which will now house all scraped data.
- Validators will now verify the authenticity of scraped data using their own scraper.
- While miners previously selected the search key, this task will now be performed by validators.
- We've introduced a new endpoint to facilitate faster access to S3 storage for validators (via an indexing table).