Allow multiple dynamic project generates profiles with workflow configurable

[zongsizhang]

it's quite typical for Atlantis users to mange repo in below architecture:

  project-1/
  project-2/
staging: -> need a separate workflow, deploy to different aws account
  project-1/
  project-2/```

Currently in digger the only way is to manually clarify all the projects as generate projects all share the same default workflow config.

The most straight forward way is to enable multiple generate_preojects

generate_projects:

• includes: xxx
  excludes: xxx
• includes: xxx
  excludes: xxx

I suggest digger can enable us to clarify projects in any sub folders under the repo. In this case the main config file doesn't need to care about the project structure at all.

prod/
digger.yml -> config differ
project-1/
project-2/
staging/
digger.yml -> config digger
project-1/
project-2/

And make digger binary to discover the config files, and execute accordingly.

Much appreciate!

[motatoes]

Hi there! Thanks for filing the issue ..

Another idea I also have to keep everything toplevel is to enable workflow under each inc/udes/excludes pair as follows:

generate_projects:
    - includes: xxx
       excludes: xxx
       workflow: staging
    - includes: xxx
       excludes: xxx
       workflow: prod

workflows:
  staging:
    envs:
      state:
      - name: AWS_ACCESS_KEY_ID
        value_from: STAGING_ACCESS_KEY_ID
      - name: AWS_SECRET_ACCESS_KEY
        value_from: STAGING_SECRET_ACCESS_KEY
      commands:
      - name: AWS_ACCESS_KEY_ID
        value_from: STAGING_ACCESS_KEY_ID
      - name: AWS_SECRET_ACCESS_KEY
        value_from: STAGING_SECRET_ACCESS_KEY
  prod:
    envs:
      state:
      - name: AWS_ACCESS_KEY_ID
        value_from: PROD_ACCESS_KEY_ID
      - name: AWS_SECRET_ACCESS_KEY
        value_from: PROD_SECRET_ACCESS_KEY
      commands:
      - name: AWS_ACCESS_KEY_ID
        value_from: PROD_ACCESS_KEY_ID
      - name: AWS_SECRET_ACCESS_KEY
        value_from: PROD_SECRET_ACCESS_KEY

[zongsizhang]

Yes if it's important to keep the top-level design this will help.

[zongsizhang]

btw there are fields like terragtunt: bool seems can't assign to this discovery

[veziak]

Hi @zongsizhang we have fixed this issue, you can check how it works in this demo repo https://github.com/diggerhq/generate_projects_multiple_blocks_demo
The change is in develop branch at the moment and it should be released next week

[zongsizhang]

cool thanks!

[zongsizhang]

Will the new github action be released together?

[motatoes]

hey @zongsizhang , the new action is realeased in v0.2.0 you can try to use this version directly!

[zongsizhang]

much appreciate, will try and if works will close this issue

[motatoes]

Hey @zongsizhang good speaking today :) By the way did you get a chance to test out this new feature ?