搜索资源列表
获取代理案例
- 利用scrapy框架写的python爬虫程序,使用爬取代理的案例来讲解的。(Scrapy framework is used to program crawler procedures in Python.)
gotoweb
- 利用python语言,实现从IP代理网站获取IP,并用此IP重复访问指定网页(Using the python language, the IP is obtained from the IP proxy site, and the specified page is repeatedly accessed with this IP)
多线程爬虫
- 一个简单健壮的多线程爬虫程序,可以添加代理IP池、url池。并且已经构造好请求头和异常处理(A simple and robust crawler program, which can add agent IP pool and URL pool. And have constructed the request header and exception handling)
