Right now we are returning a default
Even though we want to provide a Frontity package to configure the
robots.txt file using the Frontity settings in the future, it’d be great to be able to configure it using a file in your root directory as well, similar to what we are doing for the
As a Frontity project developer
I want to use a robots.txt file
so that I can get control of my robots easily
I guess we have to check if the file exists first. If it does return it and if it doesn’t, return the default string like we are doing right now.