Can not create a new adapter

[waynelao]

Hi there,

I am currently using StreamPipes 0.91.0 and run docker-compose up -d to start the application. I follow the documentation here (https://streampipes.apache.org/docs/docs/use-connect.html) to create a new adapter. Once I fill the required infos (access mode, boker hostname, port) and there is an error on Topic.

Any solution to this issue? Really appreciate the help!

[tenthe]

Hi @waynelao,
thanks for reporting the problem.

What does the error message say when you click Details?
It seems that you cannot connect to your Kafka cluster.
In this stage StreamPipes tries to connect to Kafka and read all available topics.
Is Kafka port 9092 configured in Kafka for this inbound IP?

[waynelao]

Hi @tenthe,
Thank you for the quick reply.

Here is the detail error message

I don't think Kafka is configured in port 9092 as I check the docker.
Here is the docker info:

Should I manually set up Kafka in port 9092? (I thought by running docker-compose up -d, Kafka is automatically configured).

Thank you!

[tenthe]

Ah ok, if you are using the internal Kafka you must use the DNS name "Kafka" instead of the IP address.

If you want to use the IP address of your host you must change the configurations of Kafka. Please let me know if this fixes your problem.

[waynelao]

Ah ok, if you are using the internal Kafka you must use the DNS name "Kafka" instead of the IP address.

Sorry, I don't really understand. Are you talking about making changes in docker-compose.yml file or something else?

Could you please provide step-by-step guidance on how to make StreamPipes connect to Kafka?
Thank you!

[tenthe]

Hi @waynelao,

sure. Here is an example for the configuration:

• Access Mode: Unauthenticated Plain
• Broker Hostname: kafka
• Broker Port: 9092

[waynelao]

It works great, thank you!

[tenthe]

Great, I am happy to hear that. If you have any problems or feedback feel free to share it in a discussion.