DeadFinder Action
ActionsFind dead-links (broken links)
Dead link (broken link) means a link within a web page that cannot be connected. These links can have a negative impact to SEO and Security. This tool makes it easy to identify and modify.
gem install deadfinder
# https://rubygems.org/gems/deadfindergem 'deadfinder'
# and `bundle install`brew install deadfinder
# https://formulae.brew.sh/formula/deadfinderdocker pull ghcr.io/hahwul/deadfinder:latestdeadfinder sitemap https://www.hahwul.com/sitemap.xmlsteps:
- name: Run DeadFinder
uses: hahwul/[email protected]
# or uses: hahwul/deadfinder@latest
id: broken-link
with:
command: sitemap # url / file / sitemap
target: https://www.hahwul.com/sitemap.xml
# timeout: 10
# concurrency: 50
# silent: false
# headers: "X-API-Key: 123444"
# worker_headers: "User-Agent: Deadfinder Bot"
# include30x: false
# user_agent: "Apple"
# proxy: "http://localhost:8070"
# proxy_auth: "id:pw"
# match:
# ignore:
- name: Output Handling
run: echo '${{ steps.broken-link.outputs.output }}'If you have found a Dead Link and want to automatically add it as an issue, please refer to the "Automating Dead Link Detection" article.
require 'deadfinder'
runner = DeadFinder::Runner.new
options = runner.default_options
options['concurrency'] = 30
DeadFinder.run_url('https://www.hahwul.com/cullinan/csrf/', options)
puts DeadFinder.output
# {"https://www.hahwul.com/cullinan/csrf/" => ["https://www.hahwul.com/tag/cullinan/"]}For various examples and detailed usage, including sitemap, file, and other modes, please refer to the rubydoc and examples directory in the repository.
Commands:
deadfinder completion <SHELL> # Generate completion script for shell.
deadfinder file <FILE> # Scan the URLs from File. (e.g., deadfinder file urls.txt)
deadfinder help [COMMAND] # Describe available commands or one specific command
deadfinder pipe # Scan the URLs from STDIN. (e.g., cat urls.txt | deadfinder pipe)
deadfinder sitemap <SITEMAP-URL> # Scan the URLs from sitemap.
deadfinder url <URL> # Scan the Single URL.
deadfinder version # Show version.
Options:
r, [--include30x], [--no-include30x] # Include 30x redirections
c, [--concurrency=N] # Number of concurrency
# Default: 50
t, [--timeout=N] # Timeout in seconds
# Default: 10
o, [--output=OUTPUT] # File to write result (e.g., json, yaml, csv)
f, [--output-format=OUTPUT_FORMAT] # Output format
# Default: json
H, [--headers=one two three] # Custom HTTP headers to send with initial request
[--worker-headers=one two three] # Custom HTTP headers to send with worker requests
[--user-agent=USER_AGENT] # User-Agent string to use for requests
# Default: Mozilla/5.0 (compatible; DeadFinder/1.7.0;)
p, [--proxy=PROXY] # Proxy server to use for requests
[--proxy-auth=PROXY_AUTH] # Proxy server authentication credentials
m, [--match=MATCH] # Match the URL with the given pattern
i, [--ignore=IGNORE] # Ignore the URL with the given pattern
s, [--silent], [--no-silent] # Silent mode
v, [--verbose], [--no-verbose] # Verbose mode
[--debug], [--no-debug] # Debug mode
# Scan the URLs from STDIN (multiple URLs)
cat urls.txt | deadfinder pipe
# Scan the URLs from File. (multiple URLs)
deadfinder file urls.txt
# Scan the Single URL.
deadfinder url https://www.hahwul.com
# Scan the URLs from sitemap. (multiple URLs)
deadfinder sitemap https://www.hahwul.com/sitemap.xmldeadfinder sitemap https://www.hahwul.com/sitemap.xml \
-o output.json
cat output.json | jq{
"Origin URL": [
"DeadLink URL",
"DeadLink URL",
"DeadLink URL"
]
}We welcome contributions from everyone! If you have an idea for an improvement or want to report a bug:
- Fork the repository.
- Create a new branch for your feature or bug fix (e.g.,
feature/awesome-featureorbugfix/annoying-bug). - Make your changes.
- Commit your changes with a clear commit message.
- Push to the branch.
- Submit a Pull Request (PR) to our
mainbranch.
We'll review your PR as soon as possible. Thank you for contributing to our project!
DeadFinder Action is not certified by GitHub. It is provided by a third-party and is governed by separate terms of service, privacy policy, and support documentation.
DeadFinder Action is not certified by GitHub. It is provided by a third-party and is governed by separate terms of service, privacy policy, and support documentation.