Skip to content

Ignore 403 errors #919

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
May 19, 2025
Merged

Ignore 403 errors #919

merged 1 commit into from
May 19, 2025

Conversation

unixorn
Copy link
Owner

@unixorn unixorn commented May 19, 2025

Description

Some sites forbid scraping from GitHub IPs, so treat a permission error for a page as it being present, otherwise we'd be getting a 404.

Type of changes

  • Add/Remove/Update a helper script or git alias
  • Add/Remove/Update link to an external resource like a blog post or video
  • Plugin file updates - functions added here probably should be standalone scripts in /bin
  • Text cleanups/updates
  • Test updates

License Acceptance

  • This repository is Apache version 2.0 licensed (some scripts may have alternate licensing inline in their code) and by making this PR, I am contributing my changes to the repository under the terms of the Apache 2 license.

Checklist

  • I have read the CONTRIBUTING document.
  • I have confirmed that the link(s) in my PR are valid.
  • All new and existing tests pass.
  • Any scripts added use #!/usr/bin/env interpreter instead of potentially platform-specific direct paths (#!/bin/sh is an allowed exception)
  • Scripts added/updated in this PR are all marked executable.
  • Scripts added/updated in this PR do not have a language file extension unless they are meant to be sourced and not run standalone. No one should have to know if a script was written in bash, python, ruby or whatever. Not including file extensions makes it easier to rewrite the script in another language later without having to change every reference to the previous version.
  • I have added a credit line to README.md for any new scripts.
  • If there was no author credit inside a script added in this PR, I have added one.

Some sites forbid scraping from GitHub IPs, so treat a permission error
for a page as it being present, otherwise we'd be getting a 404.

Signed-off-by: Joe Block <[email protected]>
Copy link

codeclimate bot commented May 19, 2025

Code Climate has analyzed commit e72bd7e and detected 0 issues on this pull request.

View more on Code Climate.

Copy link

github-actions bot commented May 19, 2025

🦙 MegaLinter status: ⚠️ WARNING

Descriptor Linter Files Fixed Errors Warnings Elapsed time
✅ COPYPASTE jscpd yes no no 1.28s
✅ REPOSITORY dustilock yes no no 3.05s
✅ REPOSITORY gitleaks yes no no 0.41s
✅ REPOSITORY git_diff yes no no 0.01s
⚠️ REPOSITORY kics yes 3 no 1.82s
✅ REPOSITORY secretlint yes no no 1.26s
✅ REPOSITORY syft yes no no 1.55s
✅ REPOSITORY trivy-sbom yes no no 0.55s
✅ REPOSITORY trufflehog yes no no 3.06s
⚠️ YAML prettier 1 1 2 0.32s
✅ YAML v8r 1 0 0 3.38s
⚠️ YAML yamllint 1 6 0 0.3s

See detailed report in MegaLinter reports
Set VALIDATE_ALL_CODEBASE: true in mega-linter.yml to validate all sources, not only the diff

MegaLinter is graciously provided by OX Security

@unixorn unixorn merged commit 1dbdce0 into main May 19, 2025
8 checks passed
@unixorn unixorn deleted the ignore-403s branch May 19, 2025 15:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant