everything is ok ,but can not sync data

[tantou]

I use another tool go-mysql and it can works well, the output

=== QueryEvent ===
Date: 2015-12-16 07:49:52
Log position: 1476
Event size: 109
Slave proxy ID: 38
Execution time: 0
Error code: 0
Schema: esdb
Query: insert into accesslog(name) value('antoher 3')

=== XIDEvent ===
Date: 2015-12-16 07:49:52
Log position: 1503
Event size: 27
XID: 146

but I start the go-mysql-elasticsearch,the output below:

[2015/12/16 07:30:21] status.go:52 [Info] run status http server 127.0.0.1:12800
[2015/12/16 07:30:21] dump.go:95 [Info] skip dump, use last binlog replication pos (mysql-bin.000012, 564)
[2015/12/16 07:30:21] sync.go:15 [Info] start sync binlog at (mysql-bin.000012, 564)
[2015/12/16 07:30:21] sync.go:46 [Info] rotate binlog to (mysql-bin.000012, 564)

everything looks like ok,but it can not sync data;
and if I restart mysql and go-mysql-elasticsearch, it can sync once at the begining,and then can not sync data any more;
Can you help me to figure out the reason?

[siddontang]

Can't sync even you insert new data? what's output when you browse stat web https://127.0.0.1:12800/stat ?

[tantou]

nothing output to the console

[tantou]

here is the http://127.0.0.1:12800/stat output

server_current_binlog:(mysql-bin.000012, 1503)
read_binlog:(mysql-bin.000012, 1503)
insert_num:0
update_num:0
delete_num:0

[tantou]

yes, nothing output even I insert new data to the table,and if I restart go-mysql-elasticsearch and mysql service，it will sync once at the begining,because I can see the new inserted data from elasticsearch
Could you help me to figure out the reason ?
Thanks in Advanced !

[tantou]

here it my etc/river.toml config,

# user must have replication privilege in MySQL.
my_addr = "127.0.0.1:3306"
my_user = "root"
my_pass = "weiyang154"

# Elasticsearch address
es_addr = "127.0.0.1:9200"

# Path to store data, like master.info, and dump MySQL data 
data_dir = "./var"

# Inner Http status address
stat_addr = "127.0.0.1:12800"

# pseudo server id like a slave 
server_id = 5

# mysql or mariadb
flavor = "mysql"

# mysqldump execution path
mysqldump = "/usr/bin/mysqldump"

# MySQL data source
[[source]]
schema = "esdb"

# Only below tables will be synced into Elasticsearch.
# "test_river_[0-9]{4}" is a wildcard table format, you can use it if you have many sub tables, like table_0000 - table_1023
# I don't think it is necessary to sync all tables in a database.
#tables = ["test_river", "test_river_[0-9]{4}"]
tables = ["accesslog"]
# Below is for special rule mapping
[[rule]]
schema = "esdb"
table = "accesslog"
index = "accesslog"
type = "accesslog"

[siddontang]

Do you use the latest source?

You can use flush logs in mysql and to check whether the log outputs rotate binlog to, if not, means that the program can't sync from mysql, something may be wrong.

[tantou]

yes, it's the latest
and I have use the flus logs; and the master.info file has updated,but the console ouput nothing

[tantou]

program can't sync from mysql,but how to know which part has been wrong?

[siddontang]

No, I don't know now too. As you said above, the standalone go-mysql was ok, which confused me too, because go-mysql-elasticsearch just uses go-mysql for syncing.

I will check this in the weekend, sorry for not answering you immediately, I don't have any time now.
Or you can help me find the reason too. I think the source is very easy to read. :-)

[tantou]

where is the code that listen mysql binlog changed? can you tell me the core part so that I can debug local?

[tantou]

I have never use the go lang , so if you could tell me the core part ,it's appreciate

[siddontang]

The core replication is in go-mysql/replication/binlogsyncer.go, function is onStream, you can add log here to check whether go-mysql syncs or not.

[tantou]

the same problem has shown in my partner's computer,all config is same ,and also can not sync data

[siddontang]

Hi @tantou
can you run go test in river directory.