Skip to content
HackIndex Ladon
Menu

HackIndexBot

The crawler of HackIndex Ladon. It reads public data from the WordPress.org plugin and theme directory, package registries, GitHub and the OSV.dev export, so Ladon can tell teams when software they use gets a new version or a known vulnerability.

How to recognize it

Every request carries this User-Agent:

HackIndexBot/1.0 (+https://ladon.hackindex.io/bot)

Requests to package registries also carry a contact address, as Packagist and crates.io ask:

HackIndexBot/1.0 (+https://ladon.hackindex.io/bot)

What it fetches

  • Names, versions and release dates of plugins and themes, from the public API on api.wordpress.org.
  • Whether a plugin or theme was closed or came back in the directory.
  • New WordPress releases.
  • Versions and maintenance status of packages that teams watch, and search results when someone searches for a package in Ladon, from registry.npmjs.org, packagist.org, repo.packagist.org, pypi.org, rubygems.org, crates.io, proxy.golang.org, go.dev, repo1.maven.org, search.maven.org and api.github.com.
  • Security advisories and reports of malicious packages from the public OSV.dev export on storage.googleapis.com.
  • Security advisories that maintainers publish in the GitHub repository of a package, and for projects linked to a repository the list of files on its default branch and the lockfiles and manifests in it, from api.github.com.
  • Every CVE from the CVE List of the CVE Program, CVSS scores from the NVD, the CISA list of exploited vulnerabilities and EPSS scores, from github.com, objects.githubusercontent.com, raw.githubusercontent.com, services.nvd.nist.gov, raw.githubusercontent.com and epss.empiricalsecurity.com.

It only talks to api.wordpress.org, registry.npmjs.org, packagist.org, repo.packagist.org, pypi.org, rubygems.org, crates.io, proxy.golang.org, go.dev, repo1.maven.org, search.maven.org, api.github.com, storage.googleapis.com, github.com, objects.githubusercontent.com, raw.githubusercontent.com, services.nvd.nist.gov and epss.empiricalsecurity.com. It does not visit websites, does not sign in anywhere and does not send forms.

How often

On WordPress.org it waits at least one second between two requests, and mostly asks only for what changed since its last visit.

On package registries and GitHub it refreshes what teams watch or have in a project at most every half hour, and everything else it knows once a day. It sends the ETag or date of its last copy, so an unchanged package costs almost nothing. On GitHub it uses a token without any rights, only for the rate limit. On crates.io it waits a second between two requests.

A private repository it only reads when a team shared it through the Ladon GitHub App, with a token GitHub gives for that one repository and read access, which expires within the hour.

The CVE List it checks every two minutes with a small file that says what changed, and once an hour it reads the changes of the day. The CISA list it checks every hour and EPSS once a day.

Alerts sent to webhooks

Alerts that Ladon sends to a webhook use their own User-Agent:

HackIndex-Webhooks/1.0 (+https://ladon.hackindex.io/docs/webhooks)

How to verify webhook deliveries

Contact

Does HackIndexBot cause trouble, or do you want it to stop? Open a ticket on our support site and we will sort it out. support.hackindex.io