MySQL Writer

MySQL Writer plugin implements the functionality of writing data to MySQL destination tables.

Example

Assume the MySQL table to be written has the following DDL statement:

create table test.addax_tbl ( col1 varchar(20) , col2 int(4), col3 datetime, col4 boolean, col5 binary ) default charset utf8;

Here we use data generated from memory to import into MySQL.

json

{
  "job": {
    "setting": {
      "speed": {
        "channel": 1,
        "bytes": -1
      }
    },
    "content": {
      "reader": {
        "name": "streamreader",
        "parameter": {
          "column": [
            {
              "value": "Addax",
              "type": "string"
            },
            {
              "value": 19880808,
              "type": "long"
            },
            {
              "value": "1988-08-08 08:08:08",
              "type": "date"
            },
            {
              "value": true,
              "type": "bool"
            },
            {
              "value": "test",
              "type": "bytes"
            }
          ],
          "sliceRecordCount": 1000
        }
      },
      "writer": {
        "name": "mysqlwriter",
        "parameter": {
          "writeMode": "insert",
          "username": "root",
          "password": "",
          "column": [
            "*"
          ],
          "session": [
            "set session sql_mode='ANSI'"
          ],
          "preSql": [
            "delete from @table"
          ],
          "connection": {
            "jdbcUrl": "jdbc:mysql://127.0.0.1:3306/test?useSSL=false",
            "table": [
              "addax_tbl"
            ]
          }
        }
      }
    }
  }
}

Save the above configuration file as job/stream2mysql.json

Execute Collection Command

Execute the following command for data collection

bash

bin/addax.sh job/stream2mysql.json

Parameters

This plugin is based on RDBMS Writer, so you can refer to all configuration items of RDBMS Writer, and adds some MySQL-specific configuration items.

Configuration	Required	Type	Default Value	Description
writeMode	Yes	string	insert	The way data is written to the table, see below
batchSize	No	int	1024	Defines the number of batch data fetched between plugin and database server each time

driver

The current MySQL JDBC driver uses version 8.0 and above, with driver class name com.mysql.cj.jdbc.Driver, not com.mysql.jdbc.Driver. If you need to collect from MySQL server below 5.6 and need to use Connector/J 5.1 driver, you can take the following steps:

Replace the built-in driver in the plugin rm -f plugin/writer/mysqlwriter/libs/mysql-connector-java-*.jar
Copy the old driver to the plugin directory cp mysql-connector-java-5.1.48.jar plugin/writer/mysqlwriter/libs/
Specify driver class name In your json file, configure "driver": "com.mysql.jdbc.Driver"

writeMode

insert means using insert into
replace means using replace into method
update means using ON DUPLICATE KEY UPDATE statement

MySQL Writer ​

Example ​

Execute Collection Command ​

Parameters ​