mysql-data-generator

README

mysql-data-generator

Insert random data into MySQL.

Available Options

❯ ./mysql-data-generator --help
Usage of ./mysql-data-generator:
  -concurrency int
        Number of parallel thread to inject data (default 1)
  -database string
        Name of the database to create (default "sampleData")
  -host string
        MySQL host address (default "localhost")
  -overwrite
        Drop previous database/table (if they exist) before inserting new one.
  -password string
        Password to use to connect with the database
  -port int
        Port number where the MySQL is listening (default 3306)
  -size string
        Size of the desired database (default "128MB")
  -tables int
        Number of tables to insert in the database (default 1)
  -user string
        Username to use to connect with the database
  -caCert string
        Certificates authority(CA) file is used to contains a list of trusted SSL CAs
  -clientCert string
        Server public key certificate file is used to connect encrypted connections
  -clientKey  string
        Server private key certificate file is used to connect encrypted connections
  -requireTLS  bool
        Require-tls is used to client connection is mandatory or not

Build

Build Binary:

go build .

Build Docker Image:

docker build -t emruzhossain/mysql-data-generator . \
&& docker push emruzhossain/mysql-data-generator

Usage

Run Locally:

./mysql-data-generator --user=root --password='m$k&lzwjShBB0LhO' --size=5GB --concurrency=140

or

export USERNAME=<username>
export PASSWORD=<password>
./mysql-data-generator --size=5GB --concurrency=140 # make sure number of concurrency does not exceed "max_connections".

Run Inside Kubernetes Cluster:

apiVersion: batch/v1
kind: Job
metadata:
  name: msysql-data-generator
  namespace: demo
spec:
  backoffLimit: 0
  template:
    spec:
      containers:
        - name: generator
          image: emruzhossain/mysql-data-generator:latest
          imagePullPolicy: Always
          env:
            - name: USERNAME
              valueFrom:
                secretKeyRef:
                  name: my-group-auth
                  key: username
            - name: PASSWORD
              valueFrom:
                secretKeyRef:
                  name: my-group-auth
                  key: password
          args:
            - "--host=my-group.demo.svc"
            - "--port=3306"
            - "--size=5GB"
            - "--concurrency=1000"
            # - "--overwrite=true"
      restartPolicy: Never

kubectl apply -f ./data-generator.yaml

**Run Inside Kubernetes Cluster for SSL encrypted server: **

apiVersion: batch/v1
kind: Job
metadata:
  name: msysql-data-generator
  namespace: demo
spec:
  backoffLimit: 0
  template:
    spec:
      containers:
      - name: generator
        image: suaas21/mysql-data-generator:1.0.0
        imagePullPolicy: IfNotPresent
        env:
        - name: USERNAME
          valueFrom:
            secretKeyRef:
              name: my-group-tls-auth
              key: username
        - name: PASSWORD
          valueFrom:
            secretKeyRef:
              name: my-group-tls-auth
              key: password
        - name: CA_CERT
          valueFrom:
            secretKeyRef:
              name: my-group-tls-client-cert
              key: ca.crt
        - name: CLIENT_CERT
          valueFrom:
            secretKeyRef:
              name: my-group-tls-client-cert
              key: tls.crt
        - name: CLIENT_KEY
          valueFrom:
            secretKeyRef:
              name: my-group-tls-client-cert
              key: tls.key
        volumeMounts:
        - mountPath: /mysql/certs
          name: certs-volume
        args:
        - "--host=my-group-tls.demo.svc"
        # - "--user=x509"
        # - "--password=password"
        - "--port=3306"
        - "--size=200Mi"
        - "--concurrency=30"
        - "--require-tls=true"
        # - "--overwrite=true"
      volumes:
      - name: certs-volume
        emptyDir: {}
      restartPolicy: Never