Skip to content

Latest commit

 

History

History
105 lines (76 loc) · 2.79 KB

README_EN.md

File metadata and controls

105 lines (76 loc) · 2.79 KB

Porter | 中文

GitHub release License

Abstract

Porter began in 2017 and provides data synchronization, but it's not just limited to data synchronization, it's widely used within the Suixingpay. Mainly provide the following features:

  • Database real-time synchronization
  • Database migrate
  • Database governance
  • Custom source and target data synchronization
  • Custom data extraction logic

Core features

  • Native support Oracle|Mysql to Jdbc relational database final consistent synchronization
  • Plugin friendly, Support for custom source consumer plugins, target loading plugins, and alarm plugins for secondary development.
  • Support for custom source, target table, field mapping
  • Support configuration file based node synchronization task configuration.
  • Support management of background synchronization task push, node, task management. Provides task running indicator monitoring, node running logs, and task abnormal alarms.
  • Support node resource limit and allocation.
  • A distributed architecture based on the Zookeeper cluster plugin. Support for custom cluster plugins.

Quick start

Compile from source

git clone https://github.com/sxfad/porter.git
cd porter
git checkout version
gradle build
Find the installation package from the build/distributions list

Configuration

configuration document

porter.id=unique id
#cluser
porter.cluster.strategy=ZOOKEEPER
porter.cluster.client.url=127.0.0.1:2181
porter.cluster.client.sessionTimeout=100000

#stastistics
porter.cluster.statistic.sourceType=KAFKA_PRODUCE
porter.cluster.statistic.servers=127.0.0.1:9200
porter.cluster.statistic.topic=your kafka topic

#standalone
porter.cluster.strategy=STANDALONE
porter.cluster.client.home=./.porter

Run

tar zxvf build/distributions/porter-boot-version.tar
porter-boot-version/bin/porter-boot

Debug

porter-boot-version/bin/porter-boot  debug port

Operating environment

porter-boot-version/bin/porter-boot --spring.profiles.active=Operating environment

Elegant close

porter-boot-version/bin/shutdown.sh

Document

Architecture

architecture_design dataflow

Screenshot

Home

	manager-boot default website: http://127.0.0.1:8081
	manager-boot default account: admin admin

Contact Us

  • QQ group:835209101