susbot 2.2.0
“robots.txt checker for the command line and CI (sus.bot). Installs the same `susbot` program as the susbot-cli crate.”
Large registry install base (10k+ downloads)Near-zero recent downloads for registry package
SHA-2564bc9da4758764f4417697ddc079e001d04bba78fea88116da2edf95a02c287df
MaleculeH(Cm)Md₂(Bk)
Evidence
1# susbot
2
3The command-line version of [sus.bot](https://sus.bot/), a robots.txt checker: which search engines and AI crawlers a site lets in, what is wrong with the file, and which paths it reveals.
4
5```
6cargo install susbot
7susbot https://example.com
8```
9
10This crate installs the same `susbot` program as [susbot-cli](https://crates.io/crates/susbot-cli), …
10:122… cumented. Source and GitHub Action: [github.com/sitefig/robots](https://github.com/sitefig/robots).
11
12- The same tool elsewhere: [susbot on PyPI](https://pypi.org/project/susbot/), [@sitefig/susbot on npm](https: …
16:2… PolyForm Noncommercial 1.0.0](LICENSE.md): free for noncommercial use. Commercial use needs a licence from [Sitefig](https://sitefig.eu/).
No evidence locations were recorded for this file. Raw result