VaclavRut/sitemap-sniffer VaclavRut/sitemap-sniffer

  • Stars
    star
    4
  • Rank 3,304,323 (Top 66 %)
  • Language
    JavaScript
  • Created over 4 years ago
  • Updated almost 2 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
VaclavRut/sitemap-sniffer
github

VaclavRut

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Crawler that will check for most common URLs where are sitemaps, which simplifies the crawling when you know the sitemap.

More Repositories

1

actor-amazon-crawler

Amazon crawler - this configuration will extract items for a keywords that you will specify in the input, and it will automatically extract all pages for the given keyword. You can specify more keywords on the input for one run.
JavaScript
72
star
2

covid-pl

Updated data for COVID info from Polish goverment website. Run it on apify.com
JavaScript
2
star
3

cernyrytir-scraper

JavaScript
1
star