Skip to content

mongodb-source-connector #26

Open
Open
@sangeesivakumar

Description

@sangeesivakumar

my connections are opened but it is not flushing any records from the database
INFO Kafka version : 1.1.0-cp1 (org.apache.kafka.common.utils.AppInfoParser:109)
[2018-05-08 17:10:24,265] INFO Kafka commitId : 93e03414f72c2485 (org.apache.kafka.common.utils.AppInfoParser:110)
[2018-05-08 17:10:24,281] INFO Created connector mongodb-source-connector-thirteen (org.apache.kafka.connect.cli.ConnectStandalone:104)
[2018-05-08 17:10:24,422] INFO Cluster created with settings {hosts=[127.0.0.1:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500} (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,445] INFO Cluster description not yet available. Waiting for 30000 ms before timing out (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,664] INFO Opened connection [connectionId{localValue:1, serverValue:6}] to 127.0.0.1:27017 (org.mongodb.driver.connection:71)
[2018-05-08 17:10:24,665] INFO Monitor thread successfully connected to server with description ServerDescription{address=127.0.0.1:27017, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 4]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, roundTripTimeNanos=550564} (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,678] INFO Cluster created with settings {hosts=[127.0.0.1:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500} (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,684] INFO Cluster description not yet available. Waiting for 30000 ms before timing out (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,691] INFO Opened connection [connectionId{localValue:2, serverValue:7}] to 127.0.0.1:27017 (org.mongodb.driver.connection:71)
[2018-05-08 17:10:24,694] INFO Monitor thread successfully connected to server with description ServerDescription{address=127.0.0.1:27017, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 6, 4]}, minWireVersion=0, maxWireVersion=6, maxDocumentSize=16777216, roundTripTimeNanos=1392005} (org.mongodb.driver.cluster:71)
[2018-05-08 17:10:24,699] INFO WorkerSourceTask{id=mongodb-source-connector-thirteen-0} Source task finished initialization and start (org.apache.kafka.connect.runtime.WorkerSourceTask:165)
[2018-05-08 17:10:24,739] INFO Opened connection [connectionId{localValue:4, serverValue:8}] to 127.0.0.1:27017 (org.mongodb.driver.connection:71)
[2018-05-08 17:10:24,754] INFO Opened connection [connectionId{localValue:3, serverValue:9}] to 127.0.0.1:27017 (org.mongodb.driver.connection:71)
[2018-05-08 17:11:24,281] INFO WorkerSourceTask{id=mongodb-source-connector-thirteen-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:328)
[2018-05-08 17:11:24,282] INFO WorkerSourceTask{id=mongodb-source-connector-thirteen-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:345)
[2018-05-08 17:12:24,283] INFO WorkerSourceTask{id=mongodb-source-connector-thirteen-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:328)
[2018-05-08 17:12:24,283] INFO WorkerSourceTask{id=mongodb-source-connector-thirteen-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:345)

my property file

name=mongodb-source-connector-fifteen
connector.class=org.apache.kafka.connect.mongodb.MongodbSourceConnector
tasks.max=1
uri=mongodb://127.0.0.1:27017
host=127.0.0.1
port=27017
batch.size=100
schema.name=mongodbschema
topic.prefix=mongodb-kafka
converter.class=org.apache.kafka.connect.mongodb.converter.JsonStructConverter
databases=volumata.demography,volumata.mycollection

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions