Automate Terraform Cloud Workflows

The TFE Terraform provider can codify your Terraform Cloud workspaces, teams and processes.

In this tutorial, you will use the TFE provider to automate the creation and configuration of the Terraform Cloud (TFC) workspaces in the Deploy Consul and Vault on Kubernetes with Run Triggers tutorial.

In this tutorial, you use the TFE provider to automate the following:

1. Deploy three version-control backed workspaces in Terraform Cloud
2. Create three Terraform teams to manage their respective workspaces. This is a new addition to the Deploy Consul and Vault on Kubernetes with Run Triggers tutorial.
3. Configure run triggers for each workspace to automate the process.

You will then trigger the deployment of a Consul-backed Vault cluster on Google Kubernetes Engine (GKE).

Prerequisites

This tutorial shows you how to use the TFE provider to automate your Terraform Cloud workflows and assumes that you are familiar with the standard Terraform workflow, Terraform Cloud, run triggers, and provisioning a Kubernetes cluster using Terraform.

If you are unfamiliar with any of these topics, reference their respective tutorials.

• Provision GKE cluster using Terraform — Provision a GKE Cluster (Google Cloud)
• Run Triggers to deploy Consul and Vault on Kubernetes — Deploy Consul and Vault on Kubernetes with Run Triggers

For this tutorial, you will need:

1. a Google Cloud (GCP) account with access to Compute Admin and Kubernetes Engine Admin
2. a Terraform Cloud with the Team plan or Terraform Enterprise account
3. a Terraform Cloud user. Refer to Manage Permissions in Terraform Cloud to learn how to invite a user to a Terraform Cloud organization.
4. a GitHub account
5. Github.com added as a VCS provider to Terraform Cloud. Refer to the Configure GitHub.com Access through OAuth tutorial to learn how to do this.
6. jq

If you do not have your GCP credentials as a JSON document or your credentials do not have access to Compute Admin and Kubernetes Engine Admin, reference the GCP Documentation to generate a new service account with the correct permissions.

If you are using a GCP service account, your account must be assigned the Service Account User role.

Fork workspace repositories

You will need to fork three GitHub repositories, one for each workspace — Kubernetes, Consul, Vault. The Terraform configuration to create your workspaces will reference these repositories.

Fork Kubernetes repository

Fork the learn-terraform-pipelines-k8s repository, which contains example configuration for the GKE cluster.

Fork Consul workspace

Fork the learn-terraform-pipelines-consul repository, which contains Terraform configuration for the Consul Helm release.

The main.tf file contains the configuration for Terraform remote state (to retrieve values from the Kubernetes workspace), the Kubernetes provider, and the Helm provider.

Fork Vault repository

Fork the Learn Terraform Pipelines Vault repository.

The main.tf file contains the configuration for Terraform remote state (to retrieve values from the Kubernetes and Consul workspaces) and the Helm provider.

Clone repository

Clone the Learn Terraform TFE Provider Run Triggers GitHub repository. This repository contains configuration to define and configure your Terraform Cloud workspaces and teams to manage them.

$ git clone https://github.com/hashicorp/learn-terraform-tfe-provider-run-triggers

Review configuration

Navigate to the cloned repository.

$ cd learn-terraform-tfe-provider-run-triggers

This directory contains the configuration to create the Terraform Cloud workspaces and teams needed to deploy and manage a Consul-backed Vault on Kubernetes.

Here, you will find the following files:

• main.tf defines the TFE provider and random provider in required_provider block.
• random.tf contains the configuration to generate a random value to append to your Terraform Cloud team and workspace name. This is to ensure there are no name conflicts.
• variables.tf contains the variables used in the configuration. This file has comments, breaking it into 6 sections — Google, GitHub, TFC organization/team names, and workspace names and variables for the Kubernetes, Consul and Vault workspaces.
• assets/* contains the list of csv files used to populate each workspace's team members. You will add your JSON GCP credentials to this directory. The .gitignore file contains gcp-creds.json and will prevent you from committing your GCP credentials to version control.
• tfc.tf contains the configuration to reference users to the Terraform Cloud organization. If these users are not part of the teams defined above, they won't be able to apply any runs in the Kubernetes, Consul or Vault workspaces. In addition, this configuration defines the run triggers between the Kubernetes and Consul workspaces and the Consul and Vault workspaces.
• admin.tf contains the configuration to create the admin team and gives it admin access to the Kubernetes, Consul and Vault workspaces.

In addition, the workspace-k8s.tf, workspace-consul.tf and workspace-vault.tf define their respective workspaces and do the following:

1. Create a team to manage its particular workspace.
2. Add members listed in assets/*.csv to the team, where * is the workspace.
3. Create the workspace, linking it with its respective forked repository. The workspaces will not queue runs when created. The Kubernetes and Consul workspaces define remote_state_consumer_ids. This allows the Consul and Vault workspaces to access the Kubernetes workspace's remote state, and the Vault workspace to access the Consul workspace's remote state.
4. Grant write permission to workspace's admin team.
5. Define the workspace's Terraform and environment variables.

Customize Configuration

To use this configuration, you must:

• configure input variables
• update the assets/*.csv files with your own email address
• add your Google Cloud credentials to the assets directory.

Update variables

Update the terraform.tfvars file with your values.

• google_project_id - Update the default value with your Google Project ID.

• vcs_oauth_token_id - Update the default value with your Terraform Cloud VCS Provider's OAuth Token ID.

  

• github_username - The Github account under to which you forked the example repositories.

• tfc_org - Update the default value with your Terraform Cloud's organization name.

Update team CSV files

The assets directory contains all.csv, admin.csv, k8s.csv, consul.csv and vault.csv.

all.csv is a superset of *.csv files and should contain email addresses that exists in Terraform Cloud. The admin.csv should contain email addresses that will have access to all three workspaces (Kubernetes, Consul, Vault). The k8s.csv, consul.csv, and vault.csv should contain email addresses that will have access to their respective workspaces.

Update the email address for all the csv files in the assets directory. The following command will replace the existing email address for all files with your email. Replace EMAIL_ADDRESS with your email address. This email address must already be a user in your Terraform Cloud organization.

Alternatively, you can update each file with a different email address to test Terraform Cloud team permissions.

$ sed -i '' 's/test@hashicorp\.com/EMAIL_ADDRESS/g' ./assets/*

Add Google Cloud Credentials

Add your GCP credentials to the assets directory in a file named gcp-creds.json.

You must flatten the JSON (remove newlines) before pasting it into Terraform Cloud. The command below flattens the JSON using jq, removes the trailing newline and writes it to assets/gcp-creds.json.

$ cat <key_file>.json | jq -c | tr -d '\n' > assets/gcp-creds.json

If you do not have your GCP credentials as a JSON or your credentials do not have access to Compute Admin and Kubernetes Engine Admin, reference the GCP Documentation to generate a new service account and with the right permissions.

Apply configuration

Before you can apply your configuration, you need to authenticate to Terraform Cloud.

Go to the Tokens page in Terraform Cloud and generate an API token.

Add the generated API token as an environment variable named TFE_TOKEN.

$ export TFE_TOKEN=

Initialize your configuration.

$ terraform init

Apply your configuration.

$ terraform apply

An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
  + create

Terraform will perform the following actions:

## ...

Plan: 34 to add, 0 to change, 0 to destroy.

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value:

Remember to confirm your apply with a yes.

Deploy Kubernetes cluster

Now that you have successfully configured all three workspaces (Kubernetes, Consul, and Vault), you can deploy your Kubernetes cluster.

Select your Kubernetes workspace and click Start new plan under the Actions menu. If the plan is successful, Terraform Cloud will display a notice that a run will automatically queue a plan in the Consul workspace, and ask you to confirm and apply.

Click "Confirm & Apply" to apply this configuration. This process should take about 10 minutes to complete.

Deploy Consul

Navigate to the Consul workspace, view the run plan, then click "Confirm & Apply". This will deploy Consul onto your cluster using the Helm provider. The plan retrieves the Kubernetes cluster authentication information from the Kubernetes workspace to configure both the Kubernetes and Helm provider.

This process will take about 2 minutes to complete.

Notice that this run will also queue a plan for the learn-terraform-pipelines-vault workspace once the apply completes.

Deploy Vault

Navigate to the Vault workspace, view the run plan, then click "Confirm & Apply". This will deploy Vault onto your cluster using the Helm provider and configure it to use Consul as the backend. The plan retrieves the Kubernetes namespace from the Consul workspace's remote state and deploys Vault to the same workspace.

This process will take about 2 minutes to complete.

Next steps

Congratulations — you have created and configured Terraform Cloud workspaces to deploy a Consul-backed Vault on a GKE cluster using the TFE Provider.

Refer to the Deploy Consul and Vault on Kubernetes with Run Triggers tutorial for instructions on how to verify and view your Consul and Vault deployments.

Clean up resources

To clean up the resources and destroy the infrastructure you have provisioned in this track, go to each workspace in the reverse order you created them in (Vault, Consul, Kubernetes), queue a destroy plan, and apply it.

For a more detailed guide on destroying resources on Terraform Cloud, reference the Clean up Cloud Resources guide.

After you have destroyed your resources, navigate to your TFE provider configuration.

Destroy the resources. This will remove members and destroy the Terraform Cloud workspaces and teams created in this tutorial. Remember to confirm your apply with a yes.

$ terraform destroy

Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols:
  - destroy
  
  Terraform will perform the following actions:
    ##...
    Plan: 0 to add, 0 to change, 36 to destroy.

    Do you really want to destroy all resources?
        Terraform will destroy all your managed infrastructure, as shown above.
        There is no undo. Only 'yes' will be accepted to confirm.

        Enter a value: yes
    
    ##..

Destroy complete! Resources: 36 destroyed.

Helpful Links

To learn more about the TFE provider, reference the TFE Provider Registry page.

To learn how to get started with Consul Service Mesh, visit the Getting Started with Consul Service Mesh Learn track.

To learn how to leverage Vault features on Kubernetes, visit the Vault Kubernetes tutorials.