BitsExplorer finds what people are building with AI, every day. See today's picks →

Sitemap To Markdown Crawler Apify Actor

Website to markdown crawler: give a domain, it finds the sitemap, fetches pages over plain HTTP and returns clean Markdown, headings, links, lastmod and content hash. Incremental re-crawls. Export JSON/CSV/Excel.

Description excerpted from the original listing, which is linked below.

Open it Source code

Facts

Published: 5 Oct 2026 (14d ago)
Medium: web
Language: English (the page says so itself)
Subject: Developer tools (read from the page)
First seen: 5 Oct 2026, 11:46 UTC

Built with

Claude Code: confirmed
the agent's own trailer in the repository's commit history

What we can see

88 hygiene score

Certificate issued by Amazon RSA 2048 M04, 103 days remaining
Cookie attributes no cookies set
Credentials and payment does not ask for either
Strict transport security set
Served over HTTPS
Mail authentication sender policy and authentication published
Loads insecure resources 1 resources
Redirects none
Security headers 3 of 5 set, policy permits inline or evaluated script
Third-party origins 22
Transport security TLS 1.3

Observed 5 Oct 2026 by fetching the page as a browser would. This describes hygiene and transparency, not safety: a missing header does not make a site dangerous, and a complete set does not make it trustworthy.

Made this?

Show it on your own site or README. It links back to this page.

Get the badge

For a web page

<a href="https://bitsexplorer.com/i/1840923/sitemap-to-markdown-crawler-apify-actor"><img src="https://bitsexplorer.com/badge/1840923.svg" alt="Featured on BitsExplorer" height="22"></a>

For a README (Markdown)

[![Featured on BitsExplorer](https://bitsexplorer.com/badge/1840923.svg)](https://bitsexplorer.com/i/1840923/sitemap-to-markdown-crawler-apify-actor)

Changes we have seen

5 Oct 2026 first indexed

Sitemap To Markdown Crawler Apify Actor

More built with Claude Code

Today's picks

The week in AI-built software