Kelogs
@_kelogs
SaaS Technical SEO - Crawler & Log File Analysis for SEO - kelo.gs
ID: 3742000941
http://kelo.gs 22-09-2015 19:58:37
150 Tweet
138 Takipçi
589 Takip Edilen
Hi John 🧀 ... 🧀 I have a gift for you, have a nice week 🤓 ot-campings.com/robots.txt
Kelogs Aysun Akarsu Yeah, we are openbook on HTTP headers. We emulate Google, but obviously we can't crawl from their IP range etc, so you'll never be exact. We use Chromium as well for rendering, but not Chrome 41 (which again, is a little different). Close as possible, but never exact.