Skip to content

Pull requests: yasserg/crawler4j

New pull request New
22 Open 106 Closed
22 Open 106 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

learning github
#481 opened Mar 22, 2026 by anilarelli5-gif Loading…
3
added disregarded protocols
#446 opened May 31, 2020 by mihalispap Loading…
Selenium basic integration
#444 opened May 10, 2020 by dgoiko Loading…
1
added custom html content filter
#168 opened Nov 7, 2016 by pdesmet Loading…
1
Began work on an asynchronous crawling
#157 opened Sep 8, 2016 by lostmsu Loading…
maxPagesToFetch bug
#155 opened Aug 9, 2016 by cmacdonald Loading…
2
Record the URLs of Sitemaps found within robots.txt files
#153 opened Aug 9, 2016 by cmacdonald Loading… 4.5.0
13
subclasses of WebCrawler should be able to change the parser
#150 opened Aug 9, 2016 by cmacdonald Loading…
1
Create CrawlerConfigurationException Specialization. Avoid throw Exception.
#149 opened Aug 8, 2016 by gustavofoa Loading…
3
BerkeleyDB to Redis migration
#145 opened Jul 15, 2016 by christophe-pietquin Loading… 4.5.0
9
Making Maximum Download URL Sequentially configurable
#128 opened Apr 29, 2016 by Vineeth-Mohan Loading…
2
Allow URLCanonicalizer to handle multiple values for a single query param key
#124 opened Apr 21, 2016 by Phil4 Loading…
3
allow parsing script tag and other html tags
#114 opened Feb 10, 2016 by code-911 Loading…
Add the ability to choose a URLTransformer and not forced to stick wi…
#90 opened Aug 20, 2015 by tiboun Loading…
3
Canonical URL meta tag handling and AJAX crawling
#82 opened Jul 15, 2015 by EgbertW Contributor Loading…
2
Better management of proxies
#80 opened Jul 9, 2015 by Bouki Loading…
4
refactored some fields from private to protected to make it possible …
#79 opened Jul 8, 2015 by PatrickHuetter Loading…
1
Feature: seed tracking
#63 opened May 20, 2015 by EgbertW Contributor Loading…
2
Allow negative priorities
#61 opened May 20, 2015 by EgbertW Contributor Loading…
7
Allow to differentiate between queue sizes in Frontier
#60 opened May 20, 2015 by EgbertW Contributor Loading…
Also notify waiting lists when a single URL has been schedules, instead
#59 opened May 20, 2015 by EgbertW Contributor Loading…
Improved delay handling
#57 opened May 20, 2015 by EgbertW Contributor Loading…
ProTip! Mix and match filters to narrow down what you’re looking for.