Colly (@gocolly) 's Twitter Profile
Colly

@gocolly

Elegant scraper and crawler framework for Golang

ID: 970744592881500161

linkhttp://go-colly.org calendar_today05-03-2018 19:35:21

14 Tweet

53 Takipçi

0 Takip Edilen

Colly (@gocolly) 's Twitter Profile Photo

Scarping the Web in Golang with Colly and Goquery: hk.saowen.com/a/d7defbacbf7b… #colly #golang #scraping #scraper #crawler

Colly (@gocolly) 's Twitter Profile Photo

Do not forget to attend the Detroit Go Meetup on 14th March. Connect with other users and share your thoughts on #colly: meetup.com/DetroitGolang/… #golang #Meetup #Detroit #scraping

Colly (@gocolly) 's Twitter Profile Photo

New colly feature: Configure scapers using environment variables! go-colly.org/docs/introduct… #colly #scraper #scraping #golang

Colly (@gocolly) 's Twitter Profile Photo

New Golang library have been released to interact with 2captcha API: github.com/gocolly/twocap… #golang #captcha #scraping #scraper #crawler

Colly (@gocolly) 's Twitter Profile Photo

New request queue module is added to Colly: godoc.org/github.com/goc… #scraper #scraping #crawler #golang #colly #request #queue

Colly (@gocolly) 's Twitter Profile Photo

Redis storage can be used as a request queue of a Colly collector: github.com/gocolly/rediss… #redis #queue #golang #scraping #scraper #crawler

Colly (@gocolly) 's Twitter Profile Photo

SQLite3 storage is available for Colly: github.com/velebak/colly-… #colly #scraper #scraping #crawler #sqlite #golang

Colly (@gocolly) 's Twitter Profile Photo

It's possible to blacklist URLs using regular expressions during scraping with Colly by setting the DisallowedURLFilters option of a Collector. #scraping #scraper #crawler #golang