Linting kind of breaks while fixing errors?

[kepi]

Take i.e. this example as a minimal reproduction:

---
- name: transport cert installed
  copy:
    dest: /some/path/transport.crt
    src: "some.crt"

There are two errors in this snippet:

• name is starting with a lowerase character
• mode is missing

But I'm seeing only one:

So I add mode, save and this is what I'm seeing:

I see two exclamation points but I don't see anywhere what the problem is. When I change "t" to uppercase and save the file, everything looks OK.

Real problem is, that with more complex examples, it kinds of totally breaks and starts showing errors in many places without real reason. Only thing that works for me is to revert buffer after saving, which I'm doing now, but that isn't great experience.

Disclaimer: It is definitely possible that this is how flymake is supposed to work and I just don't now something relevant, but I didn't find anything related while quick checking flymake doc. I never used it before.

I would be glad even for ideas/workaround as I have tons of files to fix ahead and I would like to improve the workflow before I get to it.

[kepi]

Btw. here is how it looks like when it goes totally haywire:

[jamescherti]

Hello @kepi,

1. Please ensure to upgrade flymake-ansible-lint to the latest version.

2. What version of ansible-lint are you using?

3. Could you also please send me the output of ansible-lint:

cd /parent/directory/of/the/ansible/directory 
ansible-lint --parseable --nocolor ansible/roles/elasticsearch/tasks/pokus.yml

[kepi]

Hello @kepi,

1. Please ensure to upgrade flymake-ansible-lint to the latest version.

I had your first version c1eb9e13a8fb42c1ed4ef08069777895c40ad2d1, updated to 1.0.5 now.

3. What version of ansible-lint are you using?

❯ ansible-lint --version
ansible-lint 25.9.3.dev0 using ansible-core:2.19.3 ansible-compat:25.8.2 ruamel-yaml:0.18.10 ruamel-yaml-clib:0.2.14

5. Could you also please send me the output of ansible-lint:> > ```
   cd /parent/directory/of/the/ansible/directory
   ansible-lint --parseable --nocolor ansible/roles/elasticsearch/tasks/pokus.yml

definitely, here it is:

❯ ansible-lint --parseable --nocolor roles/elasticsearch/tasks/pokus.yml
[WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg.
[DEPRECATION WARNING]: DEFAULT_MANAGED_STR option. Reason: The `ansible_managed` variable can be set just like any other variable, or a different variable can be used.
Alternatives: Set the `ansible_managed` variable, or use any custom variable in templates. This feature will be removed from ansible-core version 2.23.

[WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg.
[DEPRECATION WARNING]: DEFAULT_MANAGED_STR option. Reason: The `ansible_managed` variable can be set just like any other variable, or a different variable can be used.
Alternatives: Set the `ansible_managed` variable, or use any custom variable in templates. This feature will be removed from ansible-core version 2.23.

WARNING  Skipped installing old role dependencies due to running in offline mode.
WARNING  Skipped installing collection dependencies due to running in offline mode.
WARNING  Listing 2 violation(s) that are fatal
roles/elasticsearch/tasks/pokus.yml:2:9: name[casing][/]: All names should start with an uppercase letter.
roles/elasticsearch/tasks/pokus.yml:2: risky-file-permissions: File permissions unset or incorrect.
Read documentation for instructions on how to ignore specific rule violations.

# Rule Violation Summary

  1 name profile:moderate tags:idiom
  1 risky-file-permissions profile:moderate tags:unpredictability

Failed: 2 failure(s), 0 warning(s) in 1 files processed of 1 encountered. Last profile that met the validation criteria was 'basic'. Rating: 1/5 star

I just tried same example on 1.0.5 and it behaves same as before.

Feel free to ping me with anything else to test, I'll gladly help.

[jamescherti]

Here is the output from ansible-lint:

roles/test/tasks/test.yml:2:9: name[casing][/]: All names should start with an uppercase letter.
roles/test/tasks/test.yml:2: risky-file-permissions: File permissions unset or incorrect.
roles/test/tasks/test.yml:3:3: fqcn[action-core]: Use FQCN for builtin module actions (copy).
roles/test/tasks/test.yml:6: yaml[empty-lines]: Too many blank lines (1 > 0)

All of the issues mentioned above have been identified:

Unfortunately, I couldn't reproduce the issue.

[kepi]

As I'm not sure how flymake search patterns, I turned of deprecation warnings for now, but it didn't help. Here is updated output without deprecation warnings:

❯ ansible-lint --parseable --nocolor roles/elasticsearch/tasks/pokus.yml
WARNING  Skipped installing old role dependencies due to running in offline mode.
WARNING  Skipped installing collection dependencies due to running in offline mode.
WARNING  Listing 2 violation(s) that are fatal
roles/elasticsearch/tasks/pokus.yml:2:9: name[casing][/]: All names should start with an uppercase letter.
roles/elasticsearch/tasks/pokus.yml:2: risky-file-permissions: File permissions unset or incorrect.
Read documentation for instructions on how to ignore specific rule violations.

# Rule Violation Summary

  1 name profile:moderate tags:idiom
  1 risky-file-permissions profile:moderate tags:unpredictability

Failed: 2 failure(s), 0 warning(s) in 1 files processed of 1 encountered. Last profile that met the validation criteria was 'basic'. Rating: 1/5 star

Btw. what is your ansible-lint version? But I suppose that wouldn't be the source of problem.

What seams especially weird is that I see only single error instead of two

To have more complete repro (Or better if you just don't see anything which might be relevant):

my args

(setq flymake-ansible-lint-args '("--offline"))

.yamllint.yml

inside project root using your my-setup-flymake-ansible-lint-project-dir.

---
extends: default

rules:
  line-length:
    max: 180

  truthy:
    # FIXME: we want to use only yes/no for future
    # allowed-values: ["yes", "no"]
    allowed-values: ["true", "false", "yes", "no"]
    check-keys: false

  indentation:
    indent-sequences: consistent

  comments-indentation: disable

  comments:
    min-spaces-from-content: 1

  octal-values:
    forbid-implicit-octal: true
    forbid-explicit-octal: true

  braces:
    max-spaces-inside: 1

.ansible-lint.yml

inside project root using your my-setup-flymake-ansible-lint-project-dir.

---
enable_list:
  - yaml

skip_list:
  - name[missing]
  - var-naming[no-role-prefix]
  - fqcn[action-core]

# Offline mode disables installation of requirements.yml and schema refreshing
offline: true

[jamescherti]

As I'm not sure how flymake search patterns, I turned of deprecation warnings for now, but it didn't help. Here is updated output without deprecation warnings:

Here is the regular expression:

(rx bol
      ;; file.yaml:57:7: syntax-check[specific]: message
      ;; file.yaml:1: internal-error: Unexpected error code 1
      (seq (zero-or-more any)
           (literal (file-name-nondirectory file-path)) ":" ; File name
           ;; Line/Column
           (group (one-or-more digit)) ":" ; Line number
           (optional (group (one-or-more digit) ":")) ; Optional column
           ;; Code
           (one-or-more space)
           (group (one-or-more (not ":")))  ":" ; Code
           ;; Message
           (one-or-more space)
           (group (one-or-more any))) ; Msg
      eol)

The regular expression above matches the these two kinds of errors:

roles/test/tasks/test.yml:2:9: name[casing][/]: All names should start with an uppercase letter.
roles/test/tasks/test.yml:2: risky-file-permissions: File permissions unset or incorrect.

(One contains only the line, while the other contains both the line and the column.)

❯ ansible-lint --parseable --nocolor roles/elasticsearch/tasks/pokus.yml
WARNING  Skipped installing old role dependencies due to running in offline mode.
WARNING  Skipped installing collection dependencies due to running in offline mode.
WARNING  Listing 2 violation(s) that are fatal
roles/elasticsearch/tasks/pokus.yml:2:9: name[casing][/]: All names should start with an uppercase letter.
roles/elasticsearch/tasks/pokus.yml:2: risky-file-permissions: File permissions unset or incorrect.
Read documentation for instructions on how to ignore specific rule violations.

# Rule Violation Summary

  1 name profile:moderate tags:idiom
  1 risky-file-permissions profile:moderate tags:unpredictability

Failed: 2 failure(s), 0 warning(s) in 1 files processed of 1 encountered. Last profile that met the validation criteria was 'basic'. Rating: 1/5 star

Only stdout is taken into consideration:

roles/elasticsearch/tasks/pokus.yml:2:9: name[casing][/]: All names should start with an uppercase letter.
roles/elasticsearch/tasks/pokus.yml:2: risky-file-permissions: File permissions unset or incorrect.

Btw. what is your ansible-lint version? But I suppose that wouldn't be the source of problem.

ansible-lint 25.9.3.dev0 using ansible-core:2.19.3 ansible-compat:25.8.2 ruamel-yaml:0.18.10 ruamel-yaml-clib:0.2.14

What seams especially weird is that I see only single error instead of two

To have more complete repro (Or better if you just don't see anything which might be relevant):

my args

(setq flymake-ansible-lint-args '("--offline"))

.yamllint.yml

inside project root using your my-setup-flymake-ansible-lint-project-dir.

---

extends: default

rules:
line-length:
max: 180

truthy:
# FIXME: we want to use only yes/no for future
# allowed-values: ["yes", "no"]
allowed-values: ["true", "false", "yes", "no"]
check-keys: false

indentation:
indent-sequences: consistent

comments-indentation: disable

comments:
min-spaces-from-content: 1

octal-values:
forbid-implicit-octal: true
forbid-explicit-octal: true

braces:
max-spaces-inside: 1

.ansible-lint.yml

inside project root using your my-setup-flymake-ansible-lint-project-dir.

---

enable_list:

• yaml

skip_list:

• name[missing]
• var-naming[no-role-prefix]
• fqcn[action-core]

Offline mode disables installation of requirements.yml and schema refreshing

offline: true

Here is my configuration:

  (setq flymake-ansible-lint-args
        '("--offline"
          "--skip=yamllint"
          "--skip-list"
          "run-once[play],no-free-form,trailing-whitespace,yaml[line-length]"))

And yamllint.yml:

---

yaml-files:
  - '*.yaml'
  - '*.yml'

rules:
  comments-indentation: enable
  line-length: false

  # Enabled by default
  braces: enable
  brackets: enable
  colons: enable
  commas: enable
  comments:
    level: warning
  document-start:
    level: warning
  empty-lines: enable
  hyphens: enable
  indentation: enable
  key-duplicates: enable
  new-line-at-end-of-file: enable
  new-lines: enable
  trailing-spaces: false
  truthy:
    level: warning

  # Disabled by default
  document-end: disable
  empty-values: disable
  key-ordering: disable
  octal-values: disable
  quoted-strings: disable

I will test later using your configuration files and keep you updated.

Please let me know if you discover anything interesting in the meantime. Thank you, @kepi.

[kepi]

What I tried so far:

• removed yamllint and ansible lint configs
• removed ansible-lint argument setting from emacs
• removed that per-project function
• install ansible-lint from git

After every step I tried to check the file again with new emacs instance, but each time I see only File permissions unset or incorrect, nothing else in error overview. Btw. one other difference I see is that I see it as column 1 in error list but you have it as column 0 when column isn't defined in output.

I'll try to run on clean emacs profile later and let you know.