大型网页去重算法之一，bloomfliter算法，基于shingling算法进行改良，可处理海量网页数据。-One of large Web pages De-emphasis algorithms: bloomfliter algorithm.Based on the shingling algorithm and be improved, which can handle massive web data.

shingling算法实现，比较弱，但是思想是对的，对新手可以有些帮助-shingling algorithm is relatively weak, but the idea is right, can help the novice