jebbs 10207967c4 scraper follow the only link ... * in some cases, what the scraper got is only a landing page, user can use scraper rules to extract the link of the landing page and follow it * it also fix the wrong scrape rule apply when the server redirects it to another host		2022-10-31 19:49:34 -07:00
..
testdata	Return outer HTML when scraping elements	2019-12-21 21:18:31 -08:00
doc.go	Fix some linter issues	2022-08-08 22:06:38 -07:00
rules.go	Add scraping rules for theverge.com	2022-10-16 11:58:35 -07:00
scraper.go	scraper follow the only link	2022-10-31 19:49:34 -07:00
scraper_test.go	Remove deprecated io/ioutil package	2021-02-16 21:25:21 -08:00