Repositories list

• khazeshgar.github.io

  Public
  khazeshgar.ir

  CSS

  •00 forks•11 star•00 issues•00 pull requests•Updated May 6, 2017May 6, 2017

• email_grabber

  Public
  Crawler for gab website emails

  Java

  •00 forks•11 star•00 issues•00 pull requests•Updated Feb 13, 2017Feb 13, 2017

• fast-file-io

  Public
  This package present some io function that help you to fast as fast file read and write

  Java

  •00 forks•11 star•00 issues•00 pull requests•Updated Feb 13, 2017Feb 13, 2017

• fess

  Public
  Fess is very powerful and easily deployable Enterprise Search Server.

  Java

  •

  Other

  •172172 forks•11 star•00 issues•00 pull requests•Updated Feb 10, 2017Feb 10, 2017

• importer

  Public
  Norconex Importer is a Java library and command-line application meant to "parse" and "extract" content out of a file as plain text, whatever its format (HTML, …

  Java

  •2222 forks•11 star•00 issues•00 pull requests•Updated Feb 8, 2017Feb 8, 2017

• gecco

  Public
  Easy to use lightweight web crawler（易用的轻量化网络爬虫）

  Java

  •

  MIT License

  •876876 forks•11 star•00 issues•00 pull requests•Updated Feb 8, 2017Feb 8, 2017

• crawler-commons

  Public
  A set of reusable Java components that implement functionality common to any web crawler

  Java

  •

  Apache License 2.0

  •9090 forks•11 star•00 issues•00 pull requests•Updated Feb 7, 2017Feb 7, 2017

• collector-http

  Public
  Norconex HTTP Collector is a flexible web crawler for collecting, parsing, and manipulating data from the Internet (or Intranet) to various data repositories su…

  Java

  •7070 forks•00 stars•00 issues•00 pull requests•Updated Feb 6, 2017Feb 6, 2017

• okhttp

  Public
  An HTTP+HTTP/2 client for Android and Java applications.

  Java

  •

  Apache License 2.0

  •9.3k9.3k forks•00 stars•00 issues•00 pull requests•Updated Feb 5, 2017Feb 5, 2017

• awesome-crawler

  Public
  List of Some Crawler!

  crawlerextractorharvest+ 2

  crawlerextractorharvestbigdatawebcrawler

  GNU General Public License v3.0

  •00 forks•11 star•00 issues•00 pull requests•Updated Feb 3, 2017Feb 3, 2017

• news-crawl

  Public
  News crawling with SC - stores output as WARC

  Java

  •

  Apache License 2.0

  •3939 forks•11 star•00 issues•00 pull requests•Updated Feb 3, 2017Feb 3, 2017

• crawler4j

  Public
  Open Source Web Crawler for Java

  Java

  •

  Other

  •1.9k1.9k forks•11 star•00 issues•00 pull requests•Updated Jan 31, 2017Jan 31, 2017

• webmagic

  Public
  A scalable web crawler framework for Java.

  Java

  •4.1k4.1k forks•11 star•00 issues•00 pull requests•Updated Jan 27, 2017Jan 27, 2017

• khazeshgar.com

  Public
  00 forks•00 stars•00 issues•00 pull requests•Updated Jan 27, 2017Jan 27, 2017

• khazeshgar.ir

  Public
  00 forks•11 star•00 issues•00 pull requests•Updated Jan 27, 2017Jan 27, 2017

• tabula-java

  Public
  Extract tables from PDF files

  Java

  •

  MIT License

  •450450 forks•11 star•00 issues•00 pull requests•Updated Jan 25, 2017Jan 25, 2017

• heritrix3

  Public
  Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

  Java

  •781781 forks•11 star•00 issues•00 pull requests•Updated Jan 23, 2017Jan 23, 2017

• SeimiCrawler

  Public
  一个敏捷的，分布式的爬虫框架;An agile, distributed crawler framework.

  Java

  •

  Apache License 2.0

  •684684 forks•00 stars•00 issues•00 pull requests•Updated Jan 11, 2017Jan 11, 2017

• WebCollector

  Public
  WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web cr…

  Java

  •

  GNU General Public License v3.0

  •1.4k1.4k forks•11 star•00 issues•00 pull requests•Updated Jan 7, 2017Jan 7, 2017

• webporter

  Public
  基于 webmagic 的 Java 爬虫应用

  Java

  •850850 forks•11 star•00 issues•00 pull requests•Updated Dec 27, 2016Dec 27, 2016

• awesome-crawler-1

  Public
  A collection of awesome web crawler,spider in different languages

  MIT License

  •748748 forks•11 star•00 issues•00 pull requests•Updated Dec 2, 2016Dec 2, 2016

• JsoupXpath

  Public
  A html parser with xpath base on Jsoup.Maybe it is the best in java,ha ha.Just try it.

  Java

  •152152 forks•11 star•00 issues•00 pull requests•Updated Nov 16, 2016Nov 16, 2016

• wikipedia-extractor

  Public
  This is a mirror of the script by Giuseppe Attardi, and contains history before the official repo started: https://github.com/attardi/wikiextractor --- Extracts…

  Python

  •9393 forks•11 star•00 issues•00 pull requests•Updated Aug 17, 2016Aug 17, 2016

• saan-market-selenium-testing

  Public
  این مخزن شامل کد تست سلنیوم برای وبسایت سان مارکت می باشد که به زبان جاوا نوشته شده است

  Java

  •11 fork•00 stars•00 issues•00 pull requests•Updated Jan 2, 2016Jan 2, 2016

• anthelion

  Public
  Anthelion is a plugin for Apache Nutch to crawl semantic annotations within HTML pages

  Java

  •

  Apache License 2.0

  •659659 forks•11 star•00 issues•00 pull requests•Updated Dec 17, 2015Dec 17, 2015

• crawler

  Public
  Simple java web crawler

  Java

  •

  Apache License 2.0

  •5353 forks•11 star•00 issues•00 pull requests•Updated May 15, 2015May 15, 2015

• crawler-1

  Public
  Simple java web crawler

  Java

  •3737 forks•11 star•00 issues•00 pull requests•Updated Dec 2, 2014Dec 2, 2014

• commoncrawl-crawler

  Public
  The CommonCrawl Crawler Engine and Related MapReduce code

  Java

  •6363 forks•11 star•00 issues•00 pull requests•Updated Jul 14, 2013Jul 14, 2013

• Crawler-2

  Public
  simple crawler that fetches all the http://mehrnews.ir's news

  Java

  •11 fork•11 star•00 issues•00 pull requests•Updated May 24, 2011May 24, 2011