CannabisIntelligenceBot — crawler information

CannabisIntelligenceBot is the web crawler operated by the Marijobs / CannabisOS job network.

How it identifies itself

Our fetchers identify themselves with this User-Agent:

Mozilla/5.0 (compatible; CannabisIntelligenceBot/1.0; +https://marijobs.ai/bot)

A few older components identify as JobBoardBot/1.0 with the same info URL and contact (legal@marijobs.ai) — same operator, same policy. We never impersonate a browser, Googlebot, or any other crawler.

What it fetches

• Public job-posting APIs of applicant tracking systems (Greenhouse, Lever, Ashby, Workable, SmartRecruiters, Recruitee, Personio).
• Public company career pages and websites, to keep listings and profiles accurate.

What it never does

• It respects robots.txt and stops fetching disallowed paths.
• It does not bypass rate limits, CAPTCHAs, login walls, or bot blocks.
• It does not collect personal data about candidates or website visitors.

Opt out or request removal

Use the self-serve takedown page (honored immediately) or email takedown@marijobs.ai. Verified requests are honored within 2 business days. To block the crawler at the edge, disallow CannabisIntelligenceBot in your robots.txt.