BidLassoBot
The small, polite crawler behind the BidLasso daily bid digest.
Who we are
BidLasso sends Texas contractors a daily email of open public bid opportunities and new commercial building permits. Every lead links back to the agency's official posting. BidLassoBot is the program that checks those public postings once a day.
How to recognize it
Every request carries this User-Agent header:
BidLassoBot/0.1 (+https://bidlasso.com/bot; daily public-bid digest; contact [email protected])
The robots.txt product token is BidLassoBot.
What it fetches
- Public bid and solicitation listings published by government agencies and public utilities, and the detail page of each new or changed listing.
- Open-data files and APIs that agencies publish for reuse, such as building-permit datasets.
- It never logs in, never submits forms other than a listing's own public paging, never solves or bypasses CAPTCHAs, and never downloads bid documents behind a registration wall. Those stay on the agency site, and we link to them.
How often
About once each weekday morning (Central time). It makes only a handful of requests per site. Unchanged detail pages are not fetched again. Requests to any one host are spaced at least 2 seconds apart, or further apart if your Crawl-delay asks for it.
It respects robots.txt
- BidLassoBot reads
/robots.txtbefore fetching from a site and follows it, using the standard rules in RFC 9309. If robots.txt disallows a page, BidLassoBot does not fetch it. - AI-crawler opt-outs count too. BidLasso may use automated tools, including AI language models, to sort listings by trade and write one-line summaries. So if your robots.txt blocks AI or LLM crawlers (for example GPTBot, ClaudeBot, anthropic-ai, CCBot, or Google-Extended), or carries an AI
Content-Signal, we treat that as a "no" for BidLassoBot as well and do not collect from your site. We do not use your content to train AI models. - We also honor terms of use that prohibit automated collection. BidLassoBot does not collect from those sources automatically.
How to block or limit it
To keep BidLassoBot off your whole site, add this to your robots.txt:
User-agent: BidLassoBot Disallow: /
To slow it down instead, add Crawl-delay: 10 (in seconds) under the same user-agent line. Changes take effect on the next daily run.
Contact
Questions, concerns, or a request to stop? Email [email protected]. We read every message and act on removal requests promptly.