how to read a file in karavan

[richardwesley69]

how to read a file in karavan using camel processor or something else if so kindly give a brief explanation

[mgubaidullin]

Need more context

[richardwesley69]

iam connected to a server in sftp i want to read file in the /files directory i ve used the sftp component and by seeing the log the connection is successful but the content is not shown in the log how to solve this issue a help would be nice thank you

[davsclaus]

You can tweak the logging level to be DEBUG/TRACE that can show more information of the communication with the FTP server. Also mind about passive vs active mode, and also firewalls blocking ports (networking).

Also make sure that there are files ready for download in the FTP server.

And since you use sftp, then security also need to be configured correctly.

[davsclaus]

This is a general Camel issue. You can configure logging to be DEBUG/TRACE level to see more log output from camel-ftp that can maybe indicate what is happening.

[gun2rin]

Hi. What we need to do to say camel that we need to download a file and not upload? There's no settings or flags and it seems camel try to write a file (or upload). There's nothing in logs.

2025-03-12 14:37:41.440  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> SSH_MSG_KEXINIT received
2025-03-12 14:37:41.440  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> server proposal: KEX algorithms: curve25519-sha256,[email protected],ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group-exchange-sha256,diffie-hellman-group16-sha512,diffie-hellman-group18-sha512,diffie-hellman-group14-sha256,[email protected]
2025-03-12 14:37:41.440  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> server proposal: host key algorithms: rsa-sha2-512,rsa-sha2-256,ssh-rsa,ecdsa-sha2-nistp256,ssh-ed25519
2025-03-12 14:37:41.440  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> server proposal: ciphers c2s: [email protected],aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected]
2025-03-12 14:37:41.441  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> server proposal: ciphers s2c: [email protected],aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected]
2025-03-12 14:37:41.441  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> server proposal: MACs c2s: [email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
2025-03-12 14:37:41.441  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> server proposal: MACs s2c: [email protected],[email protected],[email protected],[email protected],[email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
2025-03-12 14:37:41.441  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> server proposal: compression c2s: none,[email protected]
2025-03-12 14:37:41.441  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> server proposal: compression s2c: none,[email protected]
2025-03-12 14:37:41.442  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> server proposal: languages c2s: 
2025-03-12 14:37:41.442  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> server proposal: languages s2c: 
2025-03-12 14:37:41.442  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> client proposal: KEX algorithms: curve25519-sha256,[email protected],ecdh-sha2-nistp256,ecdh-sha2-nistp384,ecdh-sha2-nistp521,diffie-hellman-group-exchange-sha256,diffie-hellman-group16-sha512,diffie-hellman-group18-sha512,diffie-hellman-group14-sha256,ext-info-c
2025-03-12 14:37:41.442  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> client proposal: host key algorithms: ssh-ed25519,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,rsa-sha2-512,rsa-sha2-256
2025-03-12 14:37:41.443  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> client proposal: ciphers c2s: aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected]
2025-03-12 14:37:41.443  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> client proposal: ciphers s2c: aes128-ctr,aes192-ctr,aes256-ctr,[email protected],[email protected]
2025-03-12 14:37:41.443  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> client proposal: MACs c2s: [email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
2025-03-12 14:37:41.443  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> client proposal: MACs s2c: [email protected],[email protected],[email protected],hmac-sha2-256,hmac-sha2-512,hmac-sha1
2025-03-12 14:37:41.443  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> client proposal: compression c2s: none
2025-03-12 14:37:41.443  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> client proposal: compression s2c: none
2025-03-12 14:37:41.444  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> client proposal: languages c2s: 
2025-03-12 14:37:41.444  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> client proposal: languages s2c: 
2025-03-12 14:37:41.445  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> kex: algorithm: curve25519-sha256
2025-03-12 14:37:41.445  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> kex: host key algorithm: ssh-ed25519
2025-03-12 14:37:41.445  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> kex: server->client cipher: aes128-ctr MAC: [email protected] compression: none
2025-03-12 14:37:41.445  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> kex: client->server cipher: aes128-ctr MAC: [email protected] compression: none
2025-03-12 14:37:41.446  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> SSH_MSG_KEX_ECDH_INIT sent
2025-03-12 14:37:41.446  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> expecting SSH_MSG_KEX_ECDH_REPLY
2025-03-12 14:37:41.471  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> ssh_eddsa_verify: ssh-ed25519 signature true
2025-03-12 14:37:41.472  WARN 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> Permanently added ***************' (EDDSA) to the list of known hosts.
2025-03-12 14:37:41.472  WARN 15 --- [- timer://timer] omponent.file.remote.SftpOperations : Server asks for confirmation (yes|no): /karavan/.ssh/known_hosts does not exist.
Are you sure you want to create it?. Camel will answer no.
2025-03-12 14:37:41.472  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> SSH_MSG_NEWKEYS sent
2025-03-12 14:37:41.472  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> SSH_MSG_NEWKEYS received
2025-03-12 14:37:41.476  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> SSH_MSG_SERVICE_REQUEST sent
2025-03-12 14:37:41.477  INFO 15 --- [- timer://timer] omponent.file.remote.SftpOperations : JSCH -> SSH_MSG_EXT_INFO received

The route is somthing like that

[davsclaus]

you need to poll if you want the file to consume(read) instead of produce(write)

[gun2rin]

Thanx! i'll try it.

[gun2rin]

There's somthing wrong when i am switching poll on.

Unknown node id: poll
in file:/karavan/code/sftptoclickhouse.camel.yaml, line 11, column 11:
           - poll:

Maybe my fault, idk.

My config is:

- route:
    id: route-2ca6
    nodePrefixId: route-710
    from:
      id: from-ecfb
      uri: timer
      parameters:
        timerName: timer
        repeatCount: "1"
      steps:
        - poll:
            id: to-9b40
            uri: sftp
            parameters:
              host: *************
              port: "22"
              directoryName: /home/demo
              fileName: pens.csv
              username: ********
              password: ********
              tempPrefix: demo
              knownHosts: ********

[davsclaus]

wait for karavan 4.10.x release