Add /rss/ in finder's wellKnownUrls

ATCOM netvolution WCM, probably alongside others, a CMS powering several
high profile and high traffic Greek news sites, among other sites,
publishes the RSS feed under /rss/. Add it to the list. It's generic
enough to allow us to assume other software might do it to

On a select set of 627 Greek news media sites (the infamous Petsas list),
adding this rule increased discoverability of RSS feeds by a factor of
2.61% (from 498 to 511).
This commit is contained in:
Alexandros Kosiaris 2021-07-20 20:10:44 +03:00 committed by fguillot
parent fc766de02d
commit b8b16c3bdf

View file

@ -146,6 +146,7 @@ func tryWellKnownUrls(websiteURL, userAgent, cookie, username, password string)
"/feed.xml": "atom", "/feed.xml": "atom",
"/feed/": "atom", "/feed/": "atom",
"/rss.xml": "rss", "/rss.xml": "rss",
"/rss/": "rss",
} }
lastCharacter := websiteURL[len(websiteURL)-1:] lastCharacter := websiteURL[len(websiteURL)-1:]