Uploaded image for project: 'Archive of Our Own'
  1. Archive of Our Own
  2. AO3-4636

Mass Import: Add option to turn off metadata detection

    Details

    • Type: New Feature
    • Status: Deployed
    • Priority: Medium
    • Resolution: DeployedToBeta
    • Affects Version/s: None
    • Fix Version/s: 0.9.167
    • Required Access Level:
      Archivist
    • Milestone:
      Internal 0.9
    • Difficulty:
      Medium
    • Roadmap:
      WorkImporting
    • Components:
      BackEnd

      Description

      The StoryParser is designed to scrape metadata from the web pages it imports. However, this often results in rubbish tags being imported. Some specific problems have been addressed in AO3-4383 Deployed and AO3-3724 Closed among others, but additional tags still scoop up rambling nonsense. In some cases, these are also invalid tags which make the import fail.

      When Open Doors are performing more semi-automated imports where the metadata is provided directly from the external site's database, there is no need to detect the metadata from the content - it's provided in the API call. There should therefore have an option to allow the detection to be turned off.

        Attachments

          Issue links

            Activity

              People

              • Assignee:
                ariana Ariana
                Reporter:
                ariana Ariana
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: