elasticsearch-broker

Akkeris Elastic Search Broker

An Elastic Search Broker for Akkeris.

Providers

The broker has support for the following providers

• AWS Elastic Search

Installing

1. Create a postgres database
2. Deploy the docker image (both worker and api) akkeris/elasticsearch-broker:latest run start.sh for the api, start-backgrouund.sh for worker. Both should use the same settigs (env) below.

1. Settings

Note almost all of these can be set via the command line as well.

Required

• DATABASE_URL - The postgres database to store its information on what databases its provisioned, this should be in the format of postgres://user:password@host:port/database?sslmode=disable or leave off sslmode=disable if ssl is supported. This will auto create the schema if its unavailable.
• NAME_PREFIX - The prefix to use for all provisioned databases this should be short and help namespace databases created by the broker vs. other databases that may exist in the broker for other purposes. This is global to all of the providers configured.
• AWS_KMS_KEY_ID - The KMS Key Id (The UUID of the key, not the ARN or alias) to use to encrypt buckets. This key must have the IAM account used to create S3 buckets added to its Principal/AWS policy to work.
• AWS_REGION - The AWS region to provision databases in, only one aws provider and region are supported by the database broker.
• AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY to an IAM role that has full access to RDS in the AWS_REGION you specified above.
• AWS_ACCOUNT_ID The account id for AWS
• AWS_SUBNET_ID A comma delimited listed of subnets, for multi az plans, more than one must be present
• AWS_SECURITY_GROUP_ID The security group id to use for the instances.

Note that you can get away with not setting AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY and use EC2 IAM roles or hard coded credentials via the ~/.aws/credentials file but these are not recommended!

Optional

• PORT - This defaults to 8443, setting this changes the default port number to listen to http (or https) traffic on
• RETRY_WEBHOOKS - (WORKER ONLY) whether outbound notifications about provisions or create bindings should be retried if they fail. This by default is false, unless you trust or know the clients hitting this broker, leave this disabled.

2. Deployment

You can deploy the image akkeris/elasticsearch-broker:latest via docker with the environment or config var settings above. If you decide you're going to build this manually and run it you'll need see the Building section below.

3. Plans

The plans table can be modified to adjust plans, at the moment only two exist, versioned and un-versioned. They both are encrypted using the AWS_KMS_KEY_ID environment variable. The default plans can be modified to make them unencrypted.

4. Setup Task Worker

You'll need to deploy one or multiple (depending on your load) task workers with the same config or settings specified in Step 1. but with a different startup command, append the -background-tasks option to the service brokers startup command to put it into worker mode. You MUST have at least 1 worker.

Running

As described in the setup instructions you should have two deployments for your application, the first is the API that receives requests, the other is the tasks process. See start.sh for the API startup command, see start-background.sh for the tasks process startup command. Both of these need the above environment variables in order to run correctly.

Debugging

You can optionally pass in the startup options -logtostderr=1 -stderrthreshold 0 to enable debugging, in addition you can set GLOG_logtostderr=1 to debug via the environment. See glog for more information on enabling various levels. You can also set STACKIMPACT as an environment variable to have profiling information sent to stack impact.

Contributing and Building

1. export GO111MODULE=on
2. make
3. ./servicebroker ...

Testing

Working on it...