What is AutoFeedBot?
AutoFeedBot is the AutoFeed crawler that reads authorised UK dealer websites every 15 minutes to keep stock in sync with Carslink.ai.
After a dealer signs up to AutoFeed and authorises it, AutoFeedBot fetches public listing pages the same way a search engine would, so new arrivals, price drops and sold cars flow through to Carslink.ai within minutes.
User-agent: AutoFeedBot. Crawl frequency: every 15 minutes per authorised dealer site. If you're a site administrator and want AutoFeedBot to slow down or stop visiting your site, please get in touch via the contact form.
AutoFeedBot at a glance
| Property | Value |
|---|---|
| User-agent | AutoFeedBot |
| Operator | AutoFeed (autofeed.uk) |
| Crawl frequency | Every 15 minutes per authorised site |
| Request rate | Up to ~2 requests per second |
| Respects robots.txt | Yes |
| Contact | https://autofeed.uk/contact |
Glossary
- Authorised site
- A dealer website whose owner has signed the AutoFeed authorisation declaration.
- Polite crawler
- A bot that identifies itself, honours robots.txt, and limits request rate to avoid load.
- Listing page
- A public page on a dealer site that describes a single vehicle for sale.
What is AutoFeedBot?
AutoFeedBot is the automated agent that reads a dealer's public listing pages on their behalf, after the dealer has signed up to AutoFeed and authorised it. It fetches pages the same way a search engine does, so stock stays in sync with Carslink.ai and other marketplaces.
How often does AutoFeedBot crawl my site?
AutoFeedBot revisits each authorised dealer site roughly every 15 minutes so stock changes — new arrivals, price drops, sold cars — are reflected on Carslink.ai within minutes.
Does AutoFeedBot respect robots.txt?
Yes. AutoFeedBot identifies itself with the user-agent 'AutoFeedBot' and honours robots.txt directives. Site administrators can slow it down or block it via robots.txt or by contacting AutoFeed.
Will AutoFeedBot slow down my website?
No. AutoFeedBot crawls at a polite rate (a couple of requests per second at most) and is engineered to behave like a normal search-engine crawler.