搜索资源列表
获取代理案例
- 利用scrapy框架写的python爬虫程序,使用爬取代理的案例来讲解的。(Scrapy framework is used to program crawler procedures in Python.)
多线程爬虫
- 一个简单健壮的多线程爬虫程序,可以添加代理IP池、url池。并且已经构造好请求头和异常处理(A simple and robust crawler program, which can add agent IP pool and URL pool. And have constructed the request header and exception handling)
