Description
It’d be great to have a @frontity/robots
package where people can configure their robots.txt file their Frontity settings.
User Stories
As a Frontity project developer
I want to configure my robots.txt using the settings
so that I can configure different robots.txt for each site from the comfort of my settings
Possible solution
This could be the configuration for the package:
export default {
//...
packages: [
// ...
{
name: "@frontity/robots",
state: {
robots: {
file: "User-agent: *\nDisallow: /some-url"
}
}
}
]
}
Dependencies
We need the server extensibility for this. I’ll update this post as soon as I write the feature request card for that.