CDN加速镜像 | 设为首页 | 加入收藏夹
当前位置: 首页 资源下载 WEB源码

文件名称:pholcus_v2

  • 所属分类:
  • 标签属性:
  • 上传时间:
    2017-03-09
  • 文件大小:
    8.18mb
  • 已下载:
    0次
  • 提 供 者:
  • 相关连接:
  • 下载说明:
    别用迅雷下载,失败请重下,重下不扣分!

介绍说明--下载内容来自于网络,使用问题请自行百度

一款纯Go语言编写的支持分布式的高并发、重量级爬虫软件,定位于互联网数据采集,为具备一定Go或JS编程基础的人提供一个只需关注规则定制的功能强大的爬虫工具。

它支持单机、服务端、客户端三种运行模式,拥有Web、GUI、命令行三种操作界面;规则简单灵活、批量任务并发、输出方式丰富(mysql/mongodb/csv/excel等)、有大量Demo共享;另外它还支持横纵向两种抓取模式,支持模拟登录和任务暂停、取消等一系列高级功能。-High concurrency, heavyweight software support a distributed crawler written in pure Go, located in the Internet data collection, provide a crawler tool only needs to pay attention to the rules of custom and powerful to have Go or JS programming based on the people.

It supports a single server and client three operating modes, including Web, GUI, three command line interface rules simple and flexible, batch task and rich output mode (mysql/mongodb/csv/excel), a large number of Demo shared and it also supports the horizontal and vertical two grasping mode, supports analog login and task suspend, cancel a series of advanced features.
(系统自动生成,下载前可以参看下载内容)

下载文件列表

pholcus-1.2.0/
pholcus-1.2.0/.gitignore
pholcus-1.2.0/app/
pholcus-1.2.0/app/aid/
pholcus-1.2.0/app/aid/history/
pholcus-1.2.0/app/aid/history/failure.go
pholcus-1.2.0/app/aid/history/history.go
pholcus-1.2.0/app/aid/history/success.go
pholcus-1.2.0/app/aid/proxy/
pholcus-1.2.0/app/aid/proxy/host.go
pholcus-1.2.0/app/aid/proxy/proxy.go
pholcus-1.2.0/app/app.go
pholcus-1.2.0/app/crawler/
pholcus-1.2.0/app/crawler/crawler.go
pholcus-1.2.0/app/crawler/crawlerpool.go
pholcus-1.2.0/app/crawler/spiderqueue.go
pholcus-1.2.0/app/distribute/
pholcus-1.2.0/app/distribute/interface.go
pholcus-1.2.0/app/distribute/master_api.go
pholcus-1.2.0/app/distribute/slave_api.go
pholcus-1.2.0/app/distribute/task.go
pholcus-1.2.0/app/distribute/taskjar.go
pholcus-1.2.0/app/downloader/
pholcus-1.2.0/app/downloader/downloader.go
pholcus-1.2.0/app/downloader/downloader_surfer.go
pholcus-1.2.0/app/downloader/request/
pholcus-1.2.0/app/downloader/request/request.go
pholcus-1.2.0/app/downloader/request/request_test.go
pholcus-1.2.0/app/downloader/request/temp.go
pholcus-1.2.0/app/downloader/surfer/
pholcus-1.2.0/app/downloader/surfer/agent/
pholcus-1.2.0/app/downloader/surfer/agent/agent.go
pholcus-1.2.0/app/downloader/surfer/agent/agent_bsd.go
pholcus-1.2.0/app/downloader/surfer/agent/agent_linux.go
pholcus-1.2.0/app/downloader/surfer/agent/agent_windows.go
pholcus-1.2.0/app/downloader/surfer/param.go
pholcus-1.2.0/app/downloader/surfer/phantom.go
pholcus-1.2.0/app/downloader/surfer/request.go
pholcus-1.2.0/app/downloader/surfer/surf.go
pholcus-1.2.0/app/downloader/surfer/surfer.go
pholcus-1.2.0/app/downloader/surfer/util.go
pholcus-1.2.0/app/pipeline/
pholcus-1.2.0/app/pipeline/collector/
pholcus-1.2.0/app/pipeline/collector/collector.go
pholcus-1.2.0/app/pipeline/collector/data/
pholcus-1.2.0/app/pipeline/collector/data/data.go
pholcus-1.2.0/app/pipeline/collector/docker.go
pholcus-1.2.0/app/pipeline/collector/output_csv.go
pholcus-1.2.0/app/pipeline/collector/output_data.go
pholcus-1.2.0/app/pipeline/collector/output_excel.go
pholcus-1.2.0/app/pipeline/collector/output_file.go
pholcus-1.2.0/app/pipeline/collector/output_kafka.go
pholcus-1.2.0/app/pipeline/collector/output_mgo.go
pholcus-1.2.0/app/pipeline/collector/output_mysql.go
pholcus-1.2.0/app/pipeline/collector/output_util.go
pholcus-1.2.0/app/pipeline/output.go
pholcus-1.2.0/app/pipeline/pipeline.go
pholcus-1.2.0/app/scheduler/
pholcus-1.2.0/app/scheduler/matrix.go
pholcus-1.2.0/app/scheduler/scheduler.go
pholcus-1.2.0/app/spider/
pholcus-1.2.0/app/spider/common/
pholcus-1.2.0/app/spider/common/common.go
pholcus-1.2.0/app/spider/common/form.go
pholcus-1.2.0/app/spider/context.go
pholcus-1.2.0/app/spider/parsejs.go
pholcus-1.2.0/app/spider/species.go
pholcus-1.2.0/app/spider/spider.go
pholcus-1.2.0/app/spider/timer.go
pholcus-1.2.0/app/spider/timer_test.go
pholcus-1.2.0/cmd/
pholcus-1.2.0/cmd/pholcus-cmd.go
pholcus-1.2.0/common/
pholcus-1.2.0/common/bytes/
pholcus-1.2.0/common/bytes/bytes.go
pholcus-1.2.0/common/config/
pholcus-1.2.0/common/config/config.go
pholcus-1.2.0/common/config/fake.go
pholcus-1.2.0/common/config/ini.go
pholcus-1.2.0/common/config/ini_test.go
pholcus-1.2.0/common/config/json.go
pholcus-1.2.0/common/config/json_test.go
pholcus-1.2.0/common/gc/
pholcus-1.2.0/common/gc/gc.go
pholcus-1.2.0/common/kafka/
pholcus-1.2.0/common/kafka/kafka.go
pholcus-1.2.0/common/mahonia/
pholcus-1.2.0/common/mahonia/8bit.go
pholcus-1.2.0/common/mahonia/ASCII.go
pholcus-1.2.0/common/mahonia/big5-data.go
pholcus-1.2.0/common/mahonia/big5.go
pholcus-1.2.0/common/mahonia/charset.go
pholcus-1.2.0/common/mahonia/convert_string.go
pholcus-1.2.0/common/mahonia/cp51932.go
pholcus-1.2.0/common/mahonia/entity.go
pholcus-1.2.0/common/mahonia/entity_data.go
pholcus-1.2.0/common/mahonia/euc-jp.go
pholcus-1.2.0/common/mahonia/euc-kr-data.go
pholcus-1.2.0/common/mahonia/euc-kr.go
pholcus-1.2.0/common/mahonia/fallback.go
pholcus-1.2.0/common/mahonia/gb18030-data.go
pholcus-1.2.0/common/mahonia/gb18030.go
pholcus-1.2.0/common/mahonia/gbk-data.go
pholcus-1.2.0/common/mahonia/gbk.go
pholcus-1.2.0/common/mahonia/iso2022jp.go
pholcus-1.2.0/common/mahonia/jis0201-data.go
pholcus-1.2.0/common/mahonia/jis0208-data.go
pholcus-1.2.0/common/mahonia/jis0212-data.go
pholcus-1.2.0/common/mahonia/kuten.go
pholcus-1.2.0/common/mahonia/mahoniconv/
pholcus-1.2.0/common/mahonia/mahoniconv/mahoniconv.go
pholcus-1.2.0/common/mahonia/mbcs.go
pholcus-1.2.0/common/mahonia/ms-jis-data.go
pholcus-1.2.0/common/mahonia/reader.go
pholcus-1.2.0/common/mahonia/README.md
pholcus-1.2.0/common/mahonia/shiftjis-data.go
pholcus-1.2.0/common/mahonia/shiftjis.go
pholcus-1.2.0/common/mahonia/tcvn3.go
pholcus-1.2.0/common/mahonia/translate.go
pholcus-1.2.0/common/mahonia/utf16.go
pholcus-1.2.0/common/mahonia/utf8.go
pholcus-1.2.0/common/mahonia/writer.go
pholcus-1.2.0/common/mgo/
pholcus-1.2.0/common/mgo/count.go
pholcus-1.2.0/common/mgo/find.go
pholcus-1.2.0/common/mgo/insert.go
pholcus-1.2.0/common/mgo/list.go
pholcus-1.2.0/common/mgo/mgo.go
pholcus-1.2.0/common/mgo/operator.go
pholcus-1.2.0/common/mgo/operator_test.go
pholcus-1.2.0/common/mgo/rem

相关说明

  • 本站资源为会员上传分享交流与学习,如有侵犯您的权益,请联系我们删除.
  • 搜珍网是交换下载平台,只提供交流渠道,下载内容来自于网络,除下载问题外,其它问题请自行百度。更多...
  • 本站已设置防盗链,请勿用迅雷、QQ旋风等下载软件下载资源,下载后用WinRAR最新版进行解压.
  • 如果您发现内容无法下载,请稍后再次尝试;或换浏览器;或者到消费记录里找到下载记录反馈给我们.
  • 下载后发现下载的内容跟说明不相乎,请到消费记录里找到下载记录反馈给我们,经确认后退回积分.
  • 如下载前有疑问,可以通过点击"提供者"的名字,查看对方的联系方式,联系对方咨询.

相关评论

暂无评论内容.

发表评论

*快速评论: 推荐 一般 有密码 和说明不符 不是源码或资料 文件不全 不能解压 纯粹是垃圾
*内  容:
*验 证 码:
搜珍网 www.dssz.com