Add the Pre-Commit Ecosystem (#13977)

* pre-commit scaffold

* removing bazel example

* Update file_parser_spec to use PreCommit::FileParser

* Pre commit file fetcher (#13982)

* Implement pre-commit file fetching

* Add exclude path

* Refactor file fetcher specs to use experiment registration for beta ecosystems and enhance file fetching tests for various pre-commit config formats

* Implement PreCommit file parser (#13991)

* Implement pre-commit file fetching

* Add exclude path

* Refactor file fetcher specs to use experiment registration for beta ecosystems and enhance file fetching tests for various pre-commit config formats

* Implement PreCommit file parser

* Add PreCommit ecosystem support with package manager and requirement classes

* Set typed: true for spec files to enable type checking

* add pre-commit to docker-dev-shell

* Change type annotation from strict to strong in multiple files

* lint

* Add pre commit fixtures to yaml linting ignore list

* Fix newline at end of file in .yamllint.yaml for pre_commit_configs ignore rule

* Refactor PackageManager and FileParser initialization for improved clarity

* lint

* Add pre commit update checker functionality (#14019)

* add pre commit update checker functionality

* fix lint errors

* add more specs

* fix lint errors and failing specs

* add test for package details fetcher and latest version finder

* fix lint errors

* fix lint errors

* Add pre commit file updater functionality (#14020)

* add pre commit file updater

* fix same version in different repo issue

* fix lint errors

* update specs

* remove unecessary comments in code

* Fix no files changed error (#14053)

* fix no files changed error

* add spec for no files changed error

* pre-commit scaffold

* removing bazel example

* Update file_parser_spec to use PreCommit::FileParser

* Pre commit file fetcher (#13982)

* Implement pre-commit file fetching

* Add exclude path

* Refactor file fetcher specs to use experiment registration for beta ecosystems and enhance file fetching tests for various pre-commit config formats

* Implement PreCommit file parser (#13991)

* Implement pre-commit file fetching

* Add exclude path

* Refactor file fetcher specs to use experiment registration for beta ecosystems and enhance file fetching tests for various pre-commit config formats

* Implement PreCommit file parser

* Add PreCommit ecosystem support with package manager and requirement classes

* Set typed: true for spec files to enable type checking

* add pre-commit to docker-dev-shell

* Change type annotation from strict to strong in multiple files

* lint

* Add pre commit fixtures to yaml linting ignore list

* Fix newline at end of file in .yamllint.yaml for pre_commit_configs ignore rule

* Refactor PackageManager and FileParser initialization for improved clarity

* lint

* Add pre commit update checker functionality (#14019)

* add pre commit update checker functionality

* fix lint errors

* add more specs

* fix lint errors and failing specs

* add test for package details fetcher and latest version finder

* fix lint errors

* fix lint errors

* Add pre commit file updater functionality (#14020)

* add pre commit file updater

* fix same version in different repo issue

* fix lint errors

* update specs

* remove unecessary comments in code

* Fix no files changed error (#14053)

* fix no files changed error

* add spec for no files changed error

* Implement base architecture for additional dependencies support for ecosystems (#14115)

* add additional deps architecture

* add additional deps architecture

* add additional deps architecture

* Add additional dependencies support for python (#14117)

* add additional deps architecture

* add additional deps architecture

* add additional deps architecture

* add additional support for python

* fix sorbet and lint erros

* Refactor Ecosystem Parsing in Pre-Commit (#14123)

* Removing additional depenency parsering, and using the python ecosystem's parsers

* reverting gem

* Refactor lower bound operator handling in version extraction

* Fix edge case failures in pre-commit additional dependencies support (#14135)

* pre-commit scaffold

* removing bazel example

* Update file_parser_spec to use PreCommit::FileParser

* Pre commit file fetcher (#13982)

* Implement pre-commit file fetching

* Add exclude path

* Refactor file fetcher specs to use experiment registration for beta ecosystems and enhance file fetching tests for various pre-commit config formats

* Implement PreCommit file parser (#13991)

* Implement pre-commit file fetching

* Add exclude path

* Refactor file fetcher specs to use experiment registration for beta ecosystems and enhance file fetching tests for various pre-commit config formats

* Implement PreCommit file parser

* Add PreCommit ecosystem support with package manager and requirement classes

* Set typed: true for spec files to enable type checking

* add pre-commit to docker-dev-shell

* Change type annotation from strict to strong in multiple files

* lint

* Add pre commit fixtures to yaml linting ignore list

* Fix newline at end of file in .yamllint.yaml for pre_commit_configs ignore rule

* Refactor PackageManager and FileParser initialization for improved clarity

* lint

* Add pre commit update checker functionality (#14019)

* add pre commit update checker functionality

* fix lint errors

* add more specs

* fix lint errors and failing specs

* add test for package details fetcher and latest version finder

* fix lint errors

* fix lint errors

* Add pre commit file updater functionality (#14020)

* add pre commit file updater

* fix same version in different repo issue

* fix lint errors

* update specs

* remove unecessary comments in code

* Fix no files changed error (#14053)

* fix no files changed error

* add spec for no files changed error

* add additional deps architecture

* add additional deps architecture

* add additional deps architecture

* add additional support for python

* Removing additional depenency parsering, and using the python ecosystem's parsers

* Implement base architecture for additional dependencies support for ecosystems (#14115)

* add additional deps architecture

* add additional deps architecture

* add additional deps architecture

* Add additional dependencies support for python (#14117)

* add additional deps architecture

* add additional deps architecture

* add additional deps architecture

* add additional support for python

* fix sorbet and lint erros

* restore updater gemfile and lockfile

* call python requirements updater for update process

* call python requirements updater for update process

* Update pre_commit/lib/dependabot/pre_commit/additional_dependency_checkers/python.rb

Co-authored-by: Rob Aiken <6567647+robaiken@users.noreply.github.com>

* fix merge conflicts

---------

Co-authored-by: Rob Aiken <6567647+robaiken@users.noreply.github.com>

* Add support for Node.js additional dependencies (#14138)

* feat: add support for Node.js additional dependencies in pre-commit hooks

- Implemented `parse_dep_string` method in `Dependabot::NpmAndYarn::Requirement` to parse package names and versions.
- Created `Node` class in `Dependabot::PreCommit::AdditionalDependencyCheckers` to handle Node.js additional dependencies.
- Updated `FileParser` to recognize Node.js additional dependencies and parse them correctly.
- Added integration tests for Node.js additional dependencies in pre-commit hooks.
- Updated Dockerfile and gemspec to include necessary dependencies for Node.js support.
- Created fixtures for testing Node.js additional dependencies in pre-commit configurations.

* replace StanderdError with specific errors

* Add support for Rust additional dependencies (#14147)

* Add Rust support for additional dependencies in pre-commit hooks

* Add Rust support for additional dependencies in pre-commit hooks

* adding back comments

* Fixing specs

* Add additional dependencies support for go modules (#14144)

* pre-commit scaffold

* removing bazel example

* Update file_parser_spec to use PreCommit::FileParser

* Pre commit file fetcher (#13982)

* Implement pre-commit file fetching

* Add exclude path

* Refactor file fetcher specs to use experiment registration for beta ecosystems and enhance file fetching tests for various pre-commit config formats

* Implement PreCommit file parser (#13991)

* Implement pre-commit file fetching

* Add exclude path

* Refactor file fetcher specs to use experiment registration for beta ecosystems and enhance file fetching tests for various pre-commit config formats

* Implement PreCommit file parser

* Add PreCommit ecosystem support with package manager and requirement classes

* Set typed: true for spec files to enable type checking

* add pre-commit to docker-dev-shell

* Change type annotation from strict to strong in multiple files

* lint

* Add pre commit fixtures to yaml linting ignore list

* Fix newline at end of file in .yamllint.yaml for pre_commit_configs ignore rule

* Refactor PackageManager and FileParser initialization for improved clarity

* lint

* Add pre commit update checker functionality (#14019)

* add pre commit update checker functionality

* fix lint errors

* add more specs

* fix lint errors and failing specs

* add test for package details fetcher and latest version finder

* fix lint errors

* fix lint errors

* Add pre commit file updater functionality (#14020)

* add pre commit file updater

* fix same version in different repo issue

* fix lint errors

* update specs

* remove unecessary comments in code

* Fix no files changed error (#14053)

* fix no files changed error

* add spec for no files changed error

* add additional dependencies support for go modules

* remove comments and fix lint erros

* fix sorbet errors

* remove comments

* fix merge conflicts

---------

Co-authored-by: Rob Aiken <6567647+robaiken@users.noreply.github.com>

* Add additional dependencies support for Ruby (#14160)

* pre-commit scaffold

* removing bazel example

* Update file_parser_spec to use PreCommit::FileParser

* Pre commit file fetcher (#13982)

* Implement pre-commit file fetching

* Add exclude path

* Refactor file fetcher specs to use experiment registration for beta ecosystems and enhance file fetching tests for various pre-commit config formats

* Implement PreCommit file parser (#13991)

* Implement pre-commit file fetching

* Add exclude path

* Refactor file fetcher specs to use experiment registration for beta ecosystems and enhance file fetching tests for various pre-commit config formats

* Implement PreCommit file parser

* Add PreCommit ecosystem support with package manager and requirement classes

* Set typed: true for spec files to enable type checking

* add pre-commit to docker-dev-shell

* Change type annotation from strict to strong in multiple files

* lint

* Add pre commit fixtures to yaml linting ignore list

* Fix newline at end of file in .yamllint.yaml for pre_commit_configs ignore rule

* Refactor PackageManager and FileParser initialization for improved clarity

* lint

* Add pre commit update checker functionality (#14019)

* add pre commit update checker functionality

* fix lint errors

* add more specs

* fix lint errors and failing specs

* add test for package details fetcher and latest version finder

* fix lint errors

* fix lint errors

* Add pre commit file updater functionality (#14020)

* add pre commit file updater

* fix same version in different repo issue

* fix lint errors

* update specs

* remove unecessary comments in code

* Fix no files changed error (#14053)

* fix no files changed error

* add spec for no files changed error

* add additional deps support for ruby

* fix merge conflicts

* revert removed comment

---------

Co-authored-by: Rob Aiken <6567647+robaiken@users.noreply.github.com>

* Adding pre_commit gem in gem

* Bump dependabot-pre_commit and related dependencies to version 0.361.1

* Add dependabot-pre_commit gem and update Gemfile.lock

* Add pre_commit ecosystem to Dockerfile for source management

* Add pre_commit volume mappings to devcontainer configuration

* revert incorrect gem lock file changes

* add dependabot-bundler in gemspec

* add dependabot-bundler in gemspec

* add comment in dockerfile updater core to invalidate cache from ghcr registry

* fix lint error

* add arg in dockerfile updater core to force cache invalidation

* add pre_commit dependency to setup

* fix order of COPY commands in Dockerfile for consistency

* remove pre_commit volume mapping from dependabot script

* revert updater gemfile and lockfile changes b1546fe

* revert changes in updater setup file

---------

Co-authored-by: Abhishek <abhishekbhaskar@github.com>

Author: robaiken

.devcontainer/core-dev/devcontainer.json

@@ -63,6 +63,9 @@
     "-v", "${localWorkspaceFolder}/nuget/dependabot-nuget.gemspec:/home/dependabot/dependabot-core/nuget/dependabot-nuget.gemspec",
     "-v", "${localWorkspaceFolder}/nuget/lib:/home/dependabot/dependabot-core/nuget/lib",
     "-v", "${localWorkspaceFolder}/nuget/spec:/home/dependabot/dependabot-core/nuget/spec",
+    "-v", "${localWorkspaceFolder}/pre_commit/dependabot-pre_commit.gemspec:/home/dependabot/dependabot-core/pre_commit/dependabot-pre_commit.gemspec",
+    "-v", "${localWorkspaceFolder}/pre_commit/lib:/home/dependabot/dependabot-core/pre_commit/lib",
+    "-v", "${localWorkspaceFolder}/pre_commit/spec:/home/dependabot/dependabot-core/pre_commit/spec",
     "-v", "${localWorkspaceFolder}/pub/dependabot-pub.gemspec:/home/dependabot/dependabot-core/pub/dependabot-pub.gemspec",
     "-v", "${localWorkspaceFolder}/pub/lib:/home/dependabot/dependabot-core/pub/lib",
     "-v", "${localWorkspaceFolder}/pub/spec:/home/dependabot/dependabot-core/pub/spec",

.github/ci-filters.yml

@@ -77,6 +77,9 @@ npm_and_yarn:
 nuget:
   - *shared
   - 'nuget/**'
+pre_commit:
+  - *shared
+  - 'pre_commit/**'
 pub:
   - *shared
   - 'pub/**'

.github/issue-labeler.yml

@@ -81,3 +81,6 @@
 
 "L: julia":
     - '(julia)'
+
+"L: pre:commit":
+    - '(pre_commit)'

.github/smoke-filters.yml

@@ -53,6 +53,9 @@ npm_and_yarn:
 nuget:
   - *common
   - 'nuget/**'
+pre_commit:
+  - *common
+  - 'pre_commit/**'
 python:
   - *common
   - 'python/**'

.github/smoke-matrix.json

@@ -94,6 +94,16 @@
     "test": "nuget-resolvability",
     "ecosystem": "nuget"
   },
+  {
+    "core": "opentofu",
+    "test": "opentofu",
+    "ecosystem": "opentofu"
+  },
+  {
+    "core": "pre_commit",
+    "test": "pre-commit",
+    "ecosystem": "pre-commit"
+  },
   {
     "core": "pub",
     "test": "pub",
@@ -119,11 +129,6 @@
     "test": "terraform",
     "ecosystem": "terraform"
   },
-  {
-    "core": "opentofu",
-    "test": "opentofu",
-    "ecosystem": "opentofu"
-  },
   {
     "core": "vcpkg",
     "test": "vcpkg",

.github/workflows/ci.yml

@@ -38,6 +38,7 @@ jobs:
           - { path: maven, name: maven, ecosystem: maven }
           - { path: npm_and_yarn, name: npm_and_yarn, ecosystem: npm }
           - { path: nuget, name: nuget, ecosystem: nuget }
+          - { path: pre_commit, name: pre_commit, ecosystem: pre-commit }
           - { path: pub, name: pub, ecosystem: pub }
           - { path: python, name: python_slow, ecosystem: pip }
           - { path: python, name: python, ecosystem: pip }

.github/workflows/images-branch.yml

@@ -79,6 +79,7 @@ jobs:
           - { name: maven, ecosystem: maven }
           - { name: npm_and_yarn, ecosystem: npm }
           - { name: nuget, ecosystem: nuget }
+          - { name: pre_commit, ecosystem: pre-commit }
           - { name: pub, ecosystem: pub }
           - { name: python, ecosystem: pip }
           - { name: rust_toolchain, ecosystem: rust-toolchain }

.github/workflows/images-latest.yml

@@ -56,6 +56,7 @@ jobs:
           - { name: maven, ecosystem: maven }
           - { name: npm_and_yarn, ecosystem: npm }
           - { name: nuget, ecosystem: nuget }
+          - { name: pre_commit, ecosystem: pre-commit }
           - { name: pub, ecosystem: pub }
           - { name: python, ecosystem: pip }
           - { name: rust_toolchain, ecosystem: rust-toolchain }

.yamllint.yaml

@@ -26,3 +26,4 @@ ignore:
   # TODO: VCR seems to be putting in bad indentation... need to track down why
   - "*/spec/fixtures/vcr_cassettes/*"
   - "helm/spec/fixtures/helm/*"
+  - "pre_commit/spec/fixtures/pre_commit_configs/*"

Dockerfile.updater-core

@@ -161,8 +161,10 @@ COPY --chown=dependabot:dependabot updater/Gemfile updater/Gemfile.lock dependab
 
 COPY --chown=dependabot:dependabot --parents */.bundle */*.gemspec common/lib/dependabot.rb LICENSE omnibus $DEPENDABOT_HOME
 
+# This ARG must be updated when adding/removing ecosystems - it invalidates Docker layer cache
+ARG ECOSYSTEM_LIST="bazel bun bundler cargo composer conda devcontainers docker docker_compose dotnet_sdk elm git_submodules github_actions go_modules gradle helm hex julia maven npm_and_yarn nuget opentofu pre_commit pub python rust_toolchain silent swift terraform uv vcpkg"
 # prevent having all the source in every ecosystem image
-RUN for ecosystem in git_submodules terraform github_actions hex elm docker docker_compose nuget maven gradle cargo composer go_modules python pub npm_and_yarn bundler silent swift devcontainers dotnet_sdk bun uv helm julia vcpkg rust_toolchain conda bazel opentofu; do \
+RUN for ecosystem in $ECOSYSTEM_LIST; do \
     mkdir -p $ecosystem/lib/dependabot; \
     touch $ecosystem/lib/dependabot/$ecosystem.rb; \
   done