搜索资源列表
Bohaoqi
- 使用API来自动拨号换取IP,并自动记录到数据库中,如果该IP在一天内重复,则可以继续自动换IP。直到IP不相同为止,一般可以用来抓取网页,发送信息等限制IP的网站。-Using the API to automatically dial in exchange for IP, and automatically record to the database, if the IP is repeated in a day, you can continue to automatically ch
search
- 统一资源定位符(URL)是网站页面的地址判别方式,也是蜘蛛抓取网站网页信息的途径。那搜索引擎蜘蛛是如何通过URL链接抓取网站页面的呢?搜索引擎工作大致分为三个阶段:爬行和抓取阶段(搜索引擎蜘蛛访问页面,并获取页面html代码存入数据库):预处理(对页面文字进行提取、分词、消除噪音、去重 和建立索引);排名(根据页面的相关性和网站权重高低展示给用户)。-Uniform Resource Locator (URL) address discrimination is the way web page
Biostockdata
- 可在网页上抓取数据,给研究提供数据支持,在数据库没有更新数据的情况下及时获得所需数据-Can capture data on the Web, to provide data to support research, to obtain the required data in a timely manner in case the database does not update data
net
- 网页数据抓取,JAVA开发,简单易懂,适合新手学习-web information get
Flashyxzsdz-v2.0
- 一款可以用来对网页flash抓取的程序,效果非常不错,可以-A flash can be used for web crawling program, the effect is very good, you can try
zhuaqudongtaiwangye-manhua
- 抓取漫画网页,到本地,可以无限享受漫画了,只需要运行脚本,漫画自动跟新到本地。非常方便。-Grab comics pages, to the local, you can enjoy unlimited comics, and only need to run the scr ipt automatically updates for local comics. Very convenient.
studydocmanege
- VB6写的一款笔记软件的源码,里面包含有很多窗体控件的使用技巧,比如MSHFlexgrid表格、TreeView的动态加载、Ado的增删改查等。 本软件提供对日常生活、工作中的学习笔记、图文并茂存储以及自由抓取网页中好的文章进行管理存储。知识点: 1、MSHFlexgrid 表格的灵活运用,其中的表格列项显示、隐藏功能很有参考意义,另外还有列项位置的动态加载。 2、异性窗体,圆形窗体使用。 3、自制专业界面,虽然只有一个雏形,不过已经提供了一个简单的思路,菜单、选项
HtmlAgilityPackDemos
- 使用开源的HtmlAgilityPack抓取和解释网页的例子Demos-Use open source HtmlAgilityPack web crawling and explain examples Demos
first
- 若用有向网表示网页的链接网络,其中顶点表示某个网页,有向弧表示网页之间的链接关系。试设计一个网络蜘蛛系统,分别以广度优先和深度优先的策略抓取网页。-If there indicate that the page with links to the network to the network, where the vertices represent a page, there are links to the arcs represent relationships between pages
SNAP
- VB网页抓图精灵2源码,自带网页浏览器,打开某一网址后,点击抓图按钮,可将本网页完整抓取成图片,原理和以前的截图相似,有兴趣的Vb爱好者可参考。-VB Web Wizard 2 capture source, comes with a Web browser, open a Web site, click on the Capture button, you can crawl into a complete picture of the pages, the principle is simi
MyProxy
- VC socket抓取网页获取代理信息,作者:邱景栋。程序通过socket 抓取网页文件,并读取指定网址的代理信息。-VC socket crawl the web to obtain the proxy information, the author: Qiu Jingdong. Program files crawled pages socket, and read the proxy information specified URL.
phpQuery
- 根据给出的链接地址,获取DOM树,根据树,活的每个元素,从而抓取到web网页的内容-According to the given URL, obtain the DOM tree, the tree, each element of living, which captures the web Webpage content
webobtain
- 用于网页信息的抓取,没有看到python的分类,所以分类在网络下面了,linux下可行,windows下没试-Information for web crawling, did not see the classification of python, so classified in the network below, the next viable linux, windows did not try
vbcapture
- VB网页抓图精灵2源码,自带网页浏览器,打开某一网址后,点击抓图按钮,可将本网页完整抓取成图片,原理和以前的截图相似,有兴趣的Vb爱好者可参考。-VB Webpage Capture Wizard 2 source code, with Webpage browser, open a web site, click the capture button, can be the Webpage complete crawl into the picture, the principle and t
关键词主题爬虫
- java编写的主题关键词爬虫程序源代码,SQLSERVER数据库 根据用户的关键词进行抓取相关的网页,
ourCrawler
- JAVA 实现的根据主题关键词进行爬虫程序 根据用户关键词来抓取所需要的网页-JAVA be implemented according to the user keyword crawlers to crawl the web by topic keyword needs
WebPageScreenShot
- C#版本的网页拍照工具,整个网页内容(包含图片)都抓取在一张图片里。-C# version of the web screenshot tool, the entire web content (including pictures) are crawling at a picture inside.
Webpage-capture
- VB网页抓图精灵2源码,自带网页浏览器,打开某一网址后,点击抓图按钮,可将本网页完整抓取成图片,原理和以前的截图相似,有兴趣的Vb爱好者可参考。-VB Webpage Capture Wizard 2 source code, with Webpage browser, open a web site, click the capture button, can be the Webpage complete crawl into the picture, the principle and t
catchewebbroswer
- 抓取Webbroswer中的网页,可以抓取超长而未显示的部分-convert the page witch from Webbroswer to jpg
Webpage-Capture-Wizard
- VB网页抓图精灵2源码,自带网页浏览器,打开某一网址后,点击抓图按钮,可将本网页完整抓取成图片,原理和以前的截图相似,有兴趣的Vb爱好者可参考。-VB Webpage Capture Wizard 2 source code, with Webpage browser, open a web site, click the capture button, can be the Webpage complete crawl into the picture, the principle and t