Env variables for schema_registry

[badsector3]

Hi.

I have a question about env variables for schema_registry
I use the following configuration under config key:

schema_registry.schemas.avro_schema_eventkey {
  type = "avro" 
  source = "my_source"
  description = "Schema"
}

That works fine, however I have multi envs and schema_registry.schemas.avro_schema_eventkey.source must be overwritten by env variables.

I tried to use the following:

apiVersion: apps.emqx.io/v2beta1
kind: EMQX
metadata:
  name: {{ include "emqx-operator-crd.fullname" . }}
  labels:
     {{- include "emqx-operator-crd.labels" . | nindent 4 }}
spec:
  coreTemplate:
    spec: 
      env:
        - name: EMQX_SCHEMA_REGISTRY__SCHEMAS__AVRO_SCHEMA_EVENTKEY__SOURCE
          value:  "my_value"

Getting error:
│ 2023-10-17T21:09:30.452886+00:00 [error] #{kind => validation_error,matched_type => "avro",path => "schema_registry.schemas.avro_schema_eventkey.source",reason => required_field

Keep in mind that I still keep the schema_registry config under config key but without the source, so:

schema_registry.schemas.avro_schema_eventkey {
  type = "avro" 
  description = "Schema"
}

Something similar works for auth and bridges but doesn't work for schema_registry.

Any ideas why is that?

[zhongwencool]

I try with

EMQX_SCHEMA_REGISTRY__SCHEMAS__AVRO_SCHEMA_EVENTKEY__SOURCE="\{\"test\":1\}" ./bin/emqx console

it's report error as:

2023-10-18T11:16:59.647198+08:00 [error] failed_to_check_schema: emqx_enterprise_schema
2023-10-18T11:16:59.647286+08:00 [error] #{kind => validation_error,matched_type => "avro",path => "schema_registry.schemas.avro_schema_eventkey.source",reason => #{expected => "emqx_schema:json_binary()"},value => "\\{\"test\":1\\}"}

it's not the error: reason => required_field as your mention.
Can you provide the value of the source you use? not my-value

[badsector3]

Sure:

  source = "{\"type\":\"record\",\"name\":\"EventRawKey\",\"namespace\":\"api.platformevents.raw\",\"fields\":[{\"name\":\"organizationId\",\"type\":{\"type\":\"string\",\"avro.java.string\":\"String\"}},{\"name\":\"projectId\",\"type\":{\"type\":\"string\",\"avro.java.string\":\"String\"}}]}"

[zmstone]

I believe this is fixed in emqx/emqx#12672

cluster.hocon is now loaded for schema check when generating app..config