have: library genesis, a project to collect all books, stories, and science articles in the world
- sm: nonfiction scientific articles
- ff: fiction books and stories
- lg: nonfiction books, textbooks
ff and lg are converted to .txt and packaged as libgen-text/libgen-crystal. sm is converted to .txt but not yet released.
wanted: map data, for navigating anywhere in the world
wanted: computer translation software, for automatic local translation
commoncrawl, a project which regularly crawls the web and provides all their data for free.
wanted: get data, reduce size
wanted: make it work locally as a search engine
wanted: daily news archive (print)