KosaricaBot
KosaricaBot/1.0 (+https://kosarica.ai/bot)
KosaricaBot je spletni pajek aplikacije Košarica AI. Zbira javno objavljene cene živil in drogerijskih izdelkov v slovenskih trgovinah – le pri trgovcih, ki so nam dali pisno dovoljenje, in pri odprtih virih podatkov.
Kako deluje
- Upošteva
robots.txt, vključno sCrawl-delayinVisit-time. - Pošlje en zahtevek naenkrat in največ 30 zahtevkov na minuto na spletno mesto (večinoma manj), praviloma ponoči med 2. in 6. uro.
- Ob odgovoru 403 ali 429 ali ob preverjanju »ali ste robot« se ustavi. Zaščit, prijav in omejitev nikoli ne obide.
- Ne zbira osebnih podatkov in ne uporablja uporabniških računov.
Kako ga ustavim
V robots.txt dodajte User-agent: KosaricaBot in Disallow: / ali nam pišite na podpora@kosarica.ai.
In English
KosaricaBot is the crawler of the Košarica AI app. It collects publicly published grocery and drugstore prices from Slovenian retailers that have given us written permission, and from open data sources. It follows robots.txt (including Crawl-delay and Visit-time), sends one request at a time and at most 30 requests per minute per site (usually fewer), mostly at night. It stops on HTTP 403 or 429 or any bot check and never bypasses protections, logins or limits. It collects no personal data. To stop it, add User-agent: KosaricaBot / Disallow: / to robots.txt or email podpora@kosarica.ai.