Managing databases with Maestro

About deploying databases

We currently support the following databases, with no need for additional configuration after deployment.

When creating a Maestro application, you can add as many databases as you need in your service configuration during the application build.

After you have analyzed your code, ensure that your desired database type is displayed in the About your app section of the analysis results.

Database authentication

When we deploy a database we automatically generate the required users and passwords to allow authentication. You can find these values via your Dashboard in the detail page of any database server. They will be available as environment variables and your application will be configured to use them.

MySQL and PostgreSQL databases managed by Cloud 66 automatically have the following users created:

The Application and Replication users always have the same password. The associated Linux users for these will differ depending on database type.

If you switch to managing your passwords manually, be sure to update all of these users whenever you change passwords. Remember that the Application and Replication users must use the same password.

Connecting your app to your DB in Maestro

Databases in Maestro run as separate components and aren’t containerized. Even though they may be running on the same private network as your cluster servers, you will not be able to connect to them via localhost because of the nature of containers (which are, by definition, abstracted from operating the system).

Instead, we we automatically create a Kubernetes services for each DB that connects out from your cluster to the database server(s). To see these on your cluster, you can list the namespaces and then select your namespace and list the services associated with it with the following commands:

$ kubectl get namespaces
$ kubectl -n <your-namespace> get svc

This will show you all the services running, some of which will be your databases.

Service names for database groups

If your application has two or more database groups, your Kubernetes database services will inherit those names. For example, if you have three MySQL database groups named main, spare and archive then the Kubernetes services will be named:

If one of these groups is set as your “primary” then it will use the default service name (mysql) instead of its group-specific name.

Connection strings in Maestro

A typical connection string might have:

So to connect to a MongoDB server named mongo_production_1 and running in your app namespace as mongodb-spare you would use something like:

$ mongodb://mongodb-spare/mongo_production_1

A similar setup for a Postgres server would look something like this:

$ postgresql://username:password@service_name/database

Connecting your app to your DB in Maestro V1

To connect to a database in Version 1 of Maestro, you should use its ElasticDNS address. Please read our full guide on ElasticDNS for more details.

Database deployment types

No database (external)

This option allows you to deploy your application without a database managed by Cloud 66, and is ideal for externally hosted databases.

You can also configure an external database via your Manifest file by specifying the server node as external.

Please note that if there is no connectivity to your external database, or your external database host is not configured correctly, the deployment will fail.

Local database

This option deploys your chosen database to the same server as your web server - this is intended primarily for development, as running your database locally in production is not advised. In this case, your application database configuration will be amended to target your local database server. If you scale up your web server, these settings will also be amend automatically to reflect your database configuration.

Dedicated database

This option will automatically create a new server for your database and configure your application accordingly.

Upgrading your database

Cloud 66 will not do in-place database upgrades, because this process may cause your application to stop working or may not be possible automatically. To upgrade your database through Cloud 66, we recommend that you create a new application (at which point Cloud 66 will deploy the newer database version).

Once the new application is created, you can migrate data from your old application to your new application.

Customize your database configuration

You can customize the database configuration on your servers using CustomConfig. CustomConfig is available for MySQL, PostgreSQL, Redis and MongoDB.

Editing and committing your database CustomConfig will perform the following steps on every database server in your application, one by one, sequentially:

🚨 A bad database configuration might stop your database from working. Take extra care to make sure the configuration is correct.

Database customization variables

There are a number of variables available for use in your database CustomConfig. Some are general for all database types, while others are database specific.

Global variables

The following variables are available to any database CustomConfig.

Variable Name Type Description
server Hash Hash containing information about your server
cloud string Application cloud
memory integer Server memory size (bytes)
core integer Server core count

MySQL variables

The following variables are only available in the MySQL CustomConfig.

Variable Name Type Description
server_state string Value can be stand_alone, mysql_master or mysql_slave based on your server status
server_id integer An ID used by MySQL replication to identify your server*
db_name string Database name

*It is 0 for standalone servers, 1 for master servers and a number greater than 1 for slave servers

PostgreSQL variables

The following variables are only available in the PostgreSQL CustomConfig.

Variable Name Type Description
server_state string Value can be stand_alone, pg_master or pg_slave based on your server status

Redis variables

The following variables are only available in the Redis CustomConfig.

Variable Name Type Description
server_state string Value can be stand_alone, redis_master or redis_slave based on your server status
master_address string IP address of replication master (empty string if server is stand alone or master)
master_port integer Will be 6379 when server is redis_slave , otherwise it is 0

Migrating to an external database

If you need to migrate a database managed by Cloud 66 to an external provider, you should bear in mind the following:

The exact migration process will differ widely depending on both the database used, and the host to which you are migrating your data, but all of them share the following steps:

  1. Switch off your application (maintenance mode is useful here)
  2. Migrate your data to the new host
  3. Set up authentication credentials and connection details
  4. Add a firewall rule to allow your app to reach the new data host (and vice versa)
  5. Turn your application back on
  6. Delete your defunct Cloud 66 database servers