Sitemap Crawler

I’ve written before about my love for serverless. Today I’m announcing an open-source project pet project, you can contribute to, or use as appropriate. It is available on GitHub at the link below.

The goal is to create a simple web-crawler as an Azure function. The web-crawler will use xml sitemaps like those used by Google search. I will use ones created by

0 comments… add one

Leave a Comment