Adding a maxPage to Sitemap

[sathia-musso]

it would be helpful when you have more than 50k urls to add to be able to split a big sitemap into smaller ones and then automatically index it on sitemap.xml

Ideally it should do it automatically when it sees that there are more than 50k urls

[sathia-musso]

if there's interest I could work a PR on something like this

    public function writeToFile(string $path): static
    {

        # https://developers.google.com/search/docs/crawling-indexing/sitemaps/build-sitemap#:~:text=Sitemap%20size%20limits%3A%20All%20formats,single%20index%20file%20to%20Google.
        $tags = collect($this->tags)->unique('url')->filter()->chunk(50_000);

        if($tags->count() === 1){
            $this->tags = $tags[0]->toArray();
            file_put_contents($path, $this->render());
        }
        else {

            $sitemap = SitemapIndex::create();
            $format = str_replace('.xml', '_%d.xml', $path);
            $tags->each(function ($t, int $key) use ($format, $sitemap) {
                $n_path = sprintf($format, $key);
                $this->tags = $t->toArray();
                file_put_contents($n_path, $this->render());
                $sitemap->add(last(explode('public', $n_path)));
            });
            $sitemap->writeToFile($path);

        }

        return $this;
    }

[jonathands]

it'd be interesting if I could know which files were created, like ['sitemap1.xml','sitemap2.xml'] , because I could use this information to automatically submit the new sitemaps to google, bing appears to be able to handle larger files

I was also thinking about adding a resume feature, because it's taking a while to generate here.

Thanks for sharing the code, Please keep us posted!

[sathia-musso]

I just monkey patched the class, if i find that there's only 1 chunk it means all the sitemap sits well inside 1 file otherwise i create an index and feed chunks to it.

<?php

namespace App\Classes;

use Spatie\Sitemap\Sitemap as SM;
use Spatie\Sitemap\SitemapIndex;

class Sitemap extends SM
{

    public function writeToFile(string $path): static
    {

        # https://developers.google.com/search/docs/crawling-indexing/sitemaps/build-sitemap#:~:text=Sitemap%20size%20limits%3A%20All%20formats,single%20index%20file%20to%20Google.
        $tags = collect($this->tags)->unique('url')->filter()->chunk(50_000);

        if ($tags->count() === 1) {
            $this->tags = $tags[0]->toArray();
            file_put_contents($path, $this->render());
        } else {

            $sitemap = SitemapIndex::create();
            $format = str_replace('.xml', '_%d.xml', $path);
            $tags->each(function ($t, int $key) use ($format, $sitemap) {
                $n_path = sprintf($format, $key);
                $this->tags = $t->toArray();
                file_put_contents($n_path, $this->render());
                $sitemap->add(last(explode('public', $n_path)));
            });
            $sitemap->writeToFile($path);

        }

        return $this;

    }

    public function render(): string
    {

        return view('sitemap::sitemap')
            ->with(['tags' => $this->tags])
            ->render();

    }


}