There are a number of automated tests that fail intermittently. The goal of this issue is to make some of those tests pass more consistently. (Hopefully.)
For this test, the HTML snapshot from cucumber seems to indicate that the user isn't logged-in, even though there's a step immediately beforehand which is supposed to make the user log in:
It seems like something about the log-in step may be causing it to fail:
This is a common issue that may also contribute to these intermittent failures:
The line the failure typically occurs on is 235, the last line in this block of code:
If you look at the snapshot of HTML that cucumber prints out when this failure occurs, you can see that "Anubis Arc" is correctly listed as "Unwrangleable," which ought to mean that it doesn't show up on the "Unwrangled" page. But the "Unwrangleable" mark is determined from the SQL database; the choice of which tags to include is an Elasticsearch query. So it must be that Elasticsearch isn't up to date.
Tags automatically reindex themselves when the value of unwrangleable changes:
However, tags can't refresh Elasticsearch automatically. And because the tag automatically reindexes itself, the test doesn't currently include the joint reindex/refresh test step. So Elasticsearch isn't guaranteed to perform a refresh in between the change to unwrangleable and the page that performs the query. It may be that refreshing is all that's needed to fix this test.
This should be tested during the review phase by running the Travis builds enough times to see if the tests are less flaky than they used to be. Doesn't require any QA once it's deployed to staging.