feat: support config and deploy openmldb-kafka-connect in docker and k8s

[tobegit3hub]

• add dockerfile
• add k8s deployment yaml

[codecov]

Codecov Report

Patch coverage has no change and project coverage change: +39.58 🎉

Comparison is base (7e39246) 36.01% compared to head (17dbd46) 75.60%.

Additional details and impacted files

@@              Coverage Diff              @@
##               main    #3276       +/-   ##
=============================================
+ Coverage     36.01%   75.60%   +39.58%     
  Complexity      393      393               
=============================================
  Files           169      681      +512     
  Lines          9991   125737   +115746     
  Branches       1185     1185               
=============================================
+ Hits           3598    95059    +91461     
- Misses         6157    30442    +24285     
  Partials        236      236               

see 512 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

[tobegit3hub]

connect-standalone.properties:

 # These are defaults. This file just demonstrates how to override some settings.
 bootstrap.servers=10.120.2.40:9092

 # The converters specify the format of data in Kafka and how to translate it into Connect data. Every Connect user will
 # need to configure these based on the format they want their data in when loaded from or stored into Kafka
 key.converter=org.apache.kafka.connect.json.JsonConverter
 value.converter=org.apache.kafka.connect.json.JsonConverter
 # Converter-specific settings can be passed in by prefixing the Converter's setting with the converter we want to apply
 # it to
 key.converter.schemas.enable=false
 value.converter.schemas.enable=true

 offset.storage.file.filename=/tmp/connect.offsets
 # Flush much faster than normal, which is useful for testing/debugging
 offset.flush.interval.ms=10000

 # Set to a list of filesystem paths separated by commas (,) to enable class loading isolation for plugins
 # (connectors, converters, transformations). The list should consist of top level directories that include
 # any combination of:
 # a) directories immediately containing jars with plugins and their dependencies
 # b) uber-jars with plugins and their dependencies
 # c) directories immediately containing the package directory structure of classes of plugins and their dependencies
 # Note: symlinks will be followed to discover dependencies or plugins.
 # Examples:
 # plugin.path=/usr/local/share/java,/usr/local/share/kafka/plugins,/opt/connectors,
 #plugin.path=/usr/local/share/java
 #plugin.path=/Users/tobe/code/4pd/OpenMLDB/extensions/kafka-connect-jdbc/tobedemo/kafka-connect-jdbc
 #plugin.path=/Users/tobe/temp/kafka_plugin_path
 #plugin.path=/Users/tobe/temp/kafka_plugin_path
 #plugin.path=/Users/tobe/code/4pd/openMLDB/extensions/kafka-connect-jdbc/docker
 plugin.path=/tmp



 topic.tracking.enable=true

openmldb-sink.properties:

 name=test-sink
 connector.class=io.confluent.connect.jdbc.JdbcSinkConnector
 tasks.max=1
 topics=topic1
 connection.url=jdbc:openmldb:///kafka_test?zk=10.120.2.40:2181&zkPath=/openmldb
 auto.create=true

K8S config map openmldb-kafka-connect-configmap:

kubectl create configmap openmldb-kafka-connect-configmap --from-file=connect-standalone.properties=connect-standalone.properties --from-file=openmldb-sink.properties=openmldb-sink.properties

Build docker image command:

docker build -t registry.cn-shenzhen.aliyuncs.com/tobe43/openmldb-kafka-connect -f Dockerfile .

Submit K8S deployment command:

kubectl create -f ./openmldb-kafka-connect-deployment.yaml