Remove redundant noindex meta tag?

[hilja]

epic-stack/app/root.tsx

Line 172 in 9db9a75

<meta name="robots" content="noindex, nofollow" />

Correct me if I’m wrong but since the 'X-Robots-Tag', 'noindex, nofollow' header is set in server:

epic-stack/server/index.ts

Line 217 in 9db9a75

res.set('X-Robots-Tag', 'noindex, nofollow')

The above meta tag might not be needed.

Instead of a tag, you can return an X-Robots-Tag HTTP header with a value of either noindex or none in your response.

At least that’s how I’m reading the Google docs.

[kentcdodds]

I do remember adding both of these, but I can't remember why I thought they were both necessary at the time. Maybe other search engines need them both? Or some use one and some use the other?

[hilja]

Interesting, you might be right. At least this blog post from ahrefs says some niche crawlers like Seznam only support the meta tag.