Allow robots.txt to be configured per fully qualified domain name

Description

We want to be able to serve different robots.txt files depending on the fully qualified domain name.

We need to start with having both versions of robots.txt available in production, however the deploy currently overwrites the one that bans all bots.

Activity

Show:
redsummernight
August 30, 2020, 10:29 PM

Looks good on staging:

Setting to pending attention on beta, things to check:

DeployedToBeta

Assignee

james_

Reporter

james_

Roadmap

Misc

Priority

Medium

Affects versions

Fix versions

Components

FrontEnd

Difficulty

Medium

Milestone

Internal 0.9