utils

package

v1.0.7 Latest Latest Go to latest Published: Jun 21, 2021 License: Apache-2.0 Imports: 34 Imported by: 12

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/pingcap/dm

Links

Open Source Insights

Documentation ¶

Rendered for

Index ¶

Variables
func AddSuffixForUUID(uuid string, ID int) string
func CompareBinlogPos(a, b mysql.Position, deviation float64) int
func CompareShardingDDLs(s, t []string) bool
func DecodeBinlogPosition(pos string) (*mysql.Position, error)
func Decrypt(ciphertextB64 string) (string, error)
func DecryptOrPlaintext(ciphertextB64 string) string
func Encrypt(plaintext string) (string, error)
func ExtractTable(name string) (string, string, error)
func FetchAllDoTables(db *sql.DB, bw *filter.Filter) (map[string][]string, error)
func FetchTargetDoTables(db *sql.DB, bw *filter.Filter, router *router.Table) (map[string][]*filter.Table, error)
func GenFakeRotateEvent(nextLogName string, logPos uint64, serverID uint32) (*replication.BinlogEvent, error)
func GenHashKey(key string) uint32
func GenTableKey(schema, table string) string
func GetAllServerID(ctx context.Context, db *sql.DB) (map[uint32]struct{}, error)
func GetFileSize(file string) (int64, error)
func GetFlavor(ctx context.Context, db *sql.DB) (string, error)
func GetGlobalVariable(db *sql.DB, variable string) (value string, err error)
func GetMariaDBGTID(db *sql.DB) (gtid.Set, error)
func GetMariaDBGtidDomainID(db *sql.DB) (uint32, error)
func GetMariaDBUUID(db *sql.DB) (string, error)
func GetMasterStatus(db *sql.DB, flavor string) (gmysql.Position, gtid.Set, error)
func GetParser(db *sql.DB, ansiQuotesMode bool) (*parser.Parser, error)
func GetRawInfo() string
func GetSQLMode(db *sql.DB) (tmysql.SQLMode, error)
func GetServerID(db *sql.DB) (uint32, error)
func GetServerUUID(db *sql.DB, flavor string) (string, error)
func GetSlaveServerID(ctx context.Context, db *sql.DB) (map[uint32]struct{}, error)
func GetSuffixUUID(indexPath, uuid string) (string, error)
func GetUUIDBySuffix(uuids []string, suffix string) string
func HasAnsiQuotesMode(db *sql.DB) (bool, error)
func IsBuildInSkipDDL(sql string) bool
func IsContextCanceledError(err error) bool
func IsDirExists(name string) bool
func IsErrBinlogPurged(err error) bool
func IsFileExists(name string) bool
func IsMySQLError(err error, code uint16) bool
func IsNoSuchThreadError(err error) bool
func JoinProcessErrors(errors []*pb.ProcessError) string
func KillConn(db *sql.DB, connID uint32) error
func ParseMetaData(filename string) (*mysql.Position, error)
func ParseSuffixForUUID(uuid string) (string, int, error)
func ParseUUIDIndex(indexPath string) ([]string, error)
func PrintInfo(app string, callback func())
func PrintInfo2(app string)
func SuffixIntToStr(ID int) string
func TrimCtrlChars(s string) string
func TruncateInterface(v interface{}, n int) string
func TruncateString(s string, n int) string
func WaitSomething(backoff int, waitTime time.Duration, fn func() bool) bool
type StorageSize
- func GetStorageSize(dir string) (size StorageSize, err error)

Constants ¶

This section is empty.

Variables ¶

View Source

var (
	ReleaseVersion = "None"
	BuildTS        = "None"
	GitHash        = "None"
	GitBranch      = "None"
	GoVersion      = "None"
)

Version information.

View Source

var (
	UUIDIndexFilename = "server-uuid.index"
	MetaFilename      = "relay.meta"
)

not support to config yet

View Source

var (
	// OsExit is function placeholder for os.Exit
	OsExit func(int)
)

Functions ¶

func CompareBinlogPos ¶

func CompareBinlogPos(a, b mysql.Position, deviation float64) int

CompareBinlogPos compares binlog positions. The result will be 0 if |a-b| < deviation, otherwise -1 if a < b, and +1 if a > b.

func CompareShardingDDLs ¶

func CompareShardingDDLs(s, t []string) bool

CompareShardingDDLs compares s and t ddls only concern in content, ignore order of ddl

func DecodeBinlogPosition ¶

func DecodeBinlogPosition(pos string) (*mysql.Position, error)

DecodeBinlogPosition parses a mysql.Position from string format

func Decrypt ¶

func Decrypt(ciphertextB64 string) (string, error)

Decrypt tries to decrypt base64 encoded ciphertext to plaintext

func DecryptOrPlaintext ¶ added in v1.0.6

func DecryptOrPlaintext(ciphertextB64 string) string

DecryptOrPlaintext tries to decrypt base64 encoded ciphertext to plaintext or return plaintext

func Encrypt ¶

func Encrypt(plaintext string) (string, error)

Encrypt tries to encrypt plaintext to base64 encoded ciphertext

func ExtractTable ¶

func ExtractTable(name string) (string, string, error)

ExtractTable extracts schema and table from `schema`.`table`

func FetchAllDoTables ¶

func FetchAllDoTables(db *sql.DB, bw *filter.Filter) (map[string][]string, error)

FetchAllDoTables returns all need to do tables after filtered (fetches from upstream MySQL)

func FetchTargetDoTables ¶

func FetchTargetDoTables(db *sql.DB, bw *filter.Filter, router *router.Table) (map[string][]*filter.Table, error)

FetchTargetDoTables returns all need to do tables after filtered and routed (fetches from upstream MySQL)

func GenFakeRotateEvent ¶

func GenFakeRotateEvent(nextLogName string, logPos uint64, serverID uint32) (*replication.BinlogEvent, error)

GenFakeRotateEvent generates a fake ROTATE_EVENT without checksum ref: https://github.com/mysql/mysql-server/blob/4f1d7cf5fcb11a3f84cff27e37100d7295e7d5ca/sql/rpl_binlog_sender.cc#L855

func GenHashKey ¶

func GenHashKey(key string) uint32

GenHashKey generates key with crc32 algorithm

func GetAllServerID ¶ added in v1.0.2

func GetAllServerID(ctx context.Context, db *sql.DB) (map[uint32]struct{}, error)

GetAllServerID gets all slave server id and master server id

func GetFlavor ¶ added in v1.0.2

func GetFlavor(ctx context.Context, db *sql.DB) (string, error)

GetFlavor gets flavor from DB

func GetGlobalVariable ¶

func GetGlobalVariable(db *sql.DB, variable string) (value string, err error)

GetGlobalVariable gets server's global variable

func GetMariaDBGTID ¶

func GetMariaDBGTID(db *sql.DB) (gtid.Set, error)

GetMariaDBGTID gets MariaDB's `gtid_binlog_pos` it can not get by `SHOW MASTER STATUS`

func GetMariaDBGtidDomainID ¶

func GetMariaDBGtidDomainID(db *sql.DB) (uint32, error)

GetMariaDBGtidDomainID gets MariaDB server's `gtid_domain_id`

func GetMariaDBUUID ¶

func GetMariaDBUUID(db *sql.DB) (string, error)

GetMariaDBUUID gets equivalent `server_uuid` for MariaDB `gtid_domain_id` joined `server_id` with domainServerIDSeparator

func GetParser ¶

func GetParser(db *sql.DB, ansiQuotesMode bool) (*parser.Parser, error)

GetParser gets a parser which maybe enabled `ANSI_QUOTES` sql_mode

func GetServerUUID ¶

func GetServerUUID(db *sql.DB, flavor string) (string, error)

GetServerUUID gets server's `server_uuid`

func GetSlaveServerID ¶ added in v1.0.2

func GetSlaveServerID(ctx context.Context, db *sql.DB) (map[uint32]struct{}, error)

GetSlaveServerID gets all slave server id

func GetSuffixUUID ¶

func GetSuffixUUID(indexPath, uuid string) (string, error)

GetSuffixUUID gets UUID (with suffix) by UUID (without suffix) when multi UUIDs (without suffix) are the same, the newest will be return

func GetUUIDBySuffix ¶

func GetUUIDBySuffix(uuids []string, suffix string) string

GetUUIDBySuffix gets UUID from uuids by suffix

func HasAnsiQuotesMode ¶

func HasAnsiQuotesMode(db *sql.DB) (bool, error)

HasAnsiQuotesMode checks whether database has `ANSI_QUOTES` set

func IsBuildInSkipDDL ¶ added in v1.0.3

func IsBuildInSkipDDL(sql string) bool

IsBuildInSkipDDL return true when checked sql that will be skipped for syncer

func IsContextCanceledError ¶ added in v1.0.3

func IsContextCanceledError(err error) bool

IsContextCanceledError checks whether err is context.Canceled

func IsErrBinlogPurged ¶

func IsErrBinlogPurged(err error) bool

IsErrBinlogPurged checks whether err is BinlogPurged error

func IsMySQLError ¶

func IsMySQLError(err error, code uint16) bool

IsMySQLError checks whether err is MySQLError error

func IsNoSuchThreadError ¶

func IsNoSuchThreadError(err error) bool

IsNoSuchThreadError checks whether err is NoSuchThreadError

func JoinProcessErrors ¶ added in v1.0.4

func JoinProcessErrors(errors []*pb.ProcessError) string

JoinProcessErrors return the string of pb.ProcessErrors joined by ", "

func KillConn ¶

func KillConn(db *sql.DB, connID uint32) error

KillConn kills the DB connection (thread in mysqld)

func ParseMetaData ¶

func ParseMetaData(filename string) (*mysql.Position, error)

ParseMetaData parses mydumper's output meta file and returns binlog position

func ParseSuffixForUUID ¶

func ParseSuffixForUUID(uuid string) (string, int, error)

ParseSuffixForUUID parses UUID (with suffix) to (UUID without suffix, suffix) pair

func PrintInfo ¶

func PrintInfo(app string, callback func())

PrintInfo prints some information of the app, like git hash, binary build time, etc.

func SuffixIntToStr ¶

func SuffixIntToStr(ID int) string

SuffixIntToStr convert int-represented suffix to string-represented

func TrimCtrlChars ¶

func TrimCtrlChars(s string) string

TrimCtrlChars returns a slice of the string s with all leading and trailing control characters removed.

func TruncateInterface ¶

func TruncateInterface(v interface{}, n int) string

TruncateInterface converts the interface to a string and returns a string with only the leading (at most) n runes of the input string. If the converted string is truncated, a `...` tail will be appended. It is not effective for large structure now.

func TruncateString ¶

func TruncateString(s string, n int) string

TruncateString returns a string with only the leading (at most) n runes of the input string. If the string is truncated, a `...` tail will be appended.

func WaitSomething ¶

func WaitSomething(backoff int, waitTime time.Duration, fn func() bool) bool

WaitSomething waits for something done with `true`.

Types ¶

type StorageSize ¶

type StorageSize struct {
	Capacity  uint64
	Available uint64
}

StorageSize represents the storage's capacity and available size Learn from tidb-binlog source code.

func GetStorageSize ¶

func GetStorageSize(dir string) (size StorageSize, err error)

GetStorageSize gets storage's capacity and available size

Source Files ¶

View all Source files

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL

Documentation ¶

Index ¶

Constants ¶

Variables ¶

Functions ¶

func AddSuffixForUUID ¶

func CompareBinlogPos ¶

func CompareShardingDDLs ¶

func DecodeBinlogPosition ¶

func Decrypt ¶

func DecryptOrPlaintext ¶ added in v1.0.6

func Encrypt ¶

func ExtractTable ¶

func FetchAllDoTables ¶

func FetchTargetDoTables ¶

func GenFakeRotateEvent ¶

func GenHashKey ¶

func GenTableKey ¶

func GetAllServerID ¶ added in v1.0.2

func GetFileSize ¶

func GetFlavor ¶ added in v1.0.2

func GetGlobalVariable ¶

func GetMariaDBGTID ¶

func GetMariaDBGtidDomainID ¶

func GetMariaDBUUID ¶

func GetMasterStatus ¶

func GetParser ¶

func GetRawInfo ¶

func GetSQLMode ¶

func GetServerID ¶

func GetServerUUID ¶

func GetSlaveServerID ¶ added in v1.0.2

func GetSuffixUUID ¶

func GetUUIDBySuffix ¶

func HasAnsiQuotesMode ¶

func IsBuildInSkipDDL ¶ added in v1.0.3

func IsContextCanceledError ¶ added in v1.0.3

func IsDirExists ¶

func IsErrBinlogPurged ¶

func IsFileExists ¶

func IsMySQLError ¶

func IsNoSuchThreadError ¶

func JoinProcessErrors ¶ added in v1.0.4

func KillConn ¶

func ParseMetaData ¶

func ParseSuffixForUUID ¶

func ParseUUIDIndex ¶

func PrintInfo ¶

func PrintInfo2 ¶

func SuffixIntToStr ¶

func TrimCtrlChars ¶

func TruncateInterface ¶

func TruncateString ¶

func WaitSomething ¶

Types ¶

type StorageSize ¶

func GetStorageSize ¶

Source Files ¶