metadata.moe/social.metadata.moe
1
0
Fork 0
mirror of https://github.com/Babibubebon/social.metadata.moe.git synced 2024-09-23 00:54:21 +09:00
Code Issues Projects Releases Packages Wiki Activity Actions
social.metadata.moe/priv/static/robots.txt

3 lines
25 B
Text
Raw Normal View History

robots.txt Add default robots.txt that allows bots access to all paths. Add mix task to generate robots.txt taht allows bots access to no paths. Document custom emojis, MRF and static_dir static_dir documentation includes docs for the robots.txt Mix task.
2019-01-20 10:44:00 +09:00
User-Agent: *
Disallow:
Reference in a new issue Copy permalink