wtf is crawlyx?

Crawlyx is a free tool that crawls a website, page by page, and reports back detailed information about how well that site is set up for search engines. It is meant to be a self-hosted alternative to paid tools like Screaming Frog or Sitebulb, and it runs entirely on your own computer, with no account, no usage limits, and no license fee. Once pointed at a site, Crawlyx follows links to map out the whole structure, and along the way it collects things like page titles, meta descriptions, headings, canonical tags, and social sharing tags. It can also render pages built with JavaScript frameworks such as React, Vue, or Angular, using a browser automation tool called Playwright, so it can see content that only appears after a page finishes loading in a real browser. Beyond just collecting data, Crawlyx checks for more than thirty common problems automatically, covering search engine, content, technical, and performance issues. It also studies how pages link to each other internally, scoring which pages seem most important and flagging pages that are orphaned or that link to broken or redirected pages. There are visual diagrams showing the crawl structure and how link authority flows through the site, plus a duplicate content detector. Every crawl is saved locally in a small SQLite database, so you can pause a crawl and resume it later, or reload past results without starting over. Results can be exported as CSV, Excel, JSON, XML, or as a ready to share HTML audit report. Getting started just means running a start script on Windows, Mac, or Linux, or using Docker, after which the tool opens in your web browser. It is written in Python using the Flask web framework, and is released under the MIT license, which allows free use for any purpose, including commercial projects.