Sitemap Crawler

I’ve written before about my love for serverless. Today I’m announcing an open-source project pet project, you can contribute to, or use as appropriate. It is available on GitHub at the link below.

https://github.com/mjsmale/az-function-sitemap-crawler

The goal is to create a simple web-crawler as an Azure function. The web-crawler will use xml sitemaps like those used by Google search. I will use ones created by https://www.xml-sitemaps.com/

0 comments… add one

Leave a Comment