BitsExplorer

BitsExplorer finds what people are building with AI, every day. See today's picks →

Preview of Text Harvest

Text Harvest

Streams openly licensed text corpora from the Hugging Face Hub (FineWeb, FineWeb-Edu, FineWeb-2 Finnish, Wikipedia, Common Pile: Gutenberg, arXiv, peS2o, PubMed, StackExchange, Stack-Edu code; FineMath, OpenWebMath, Cosmopedia, SmolTalk), filters + exact-dedupes them, and uploads jsonl.zst shards…

Description excerpted from the original listing, which is linked below.

Open it Listing Source code

The week in AI-built software

Every Monday: how many projects were built with AI that week, which tools built them, where they came from, and the week's picks.

Read the latest week