Partially Implements: Blueprint standard-start

Change-Id: I34b4d96515b4c68d42319b477504abdfe9581bad

Makes use of new gen-source-tar script to provide a source based
keystone image.

This patch introduces a new concept of a .buildinfo file, which provides
variables specific to the image being built which cannot be defaulted in
a generic way, at least until the build script is overhauled. This file
is sourced before the .buildconf which still leaves everything
customisable by the user.

Co-Authored-By: Paul Bourke <paul.bourke@oracle.com>
Change-Id: I0ec6b9cfe6d4173f3192e4ae5833fb0f6d333f1c
Implements: blueprint install-from-source

There are additional depedencies on top of the binary base that are
needed to build and install source components.

This commit moves the base image for source installs from a symlink to
it's own layer, and adds the dependencies that will be needed to install
keystone (more can be added as we add new components).

Partially-Implements: blueprint install-from-source

Change-Id: I56ef6eafb95530e975988dffb62606309dba274e

Partially Implements: Blueprint standard-start

Change-Id: I96342c3bdb99d317ce75e0bbb78bdf469f9d1bf7

Partially Implements: Blueprint standard-start

Change-Id: I9fa5cc8f6f57b46f8af165778388435b91c28447

Add missing oslo dependency.

Closes-bug: #1469891
Change-Id: Ia7b0a5bc0d59f561a1cb6cdb0a50478cad9246d4

Additionally fixed bootstrap issue caused by an ansible bug in some
versions of the docker module.

Closes-Bug: #1472270
Change-Id: Ia5a370db5ab7690854afcd63492ba7dbbea29835

Change-Id: Ie22707faa3513e293200c68caf38b7667e38d081
Closes-Bug: 1471828

Change-Id: Ie6e77a4d45210122746b544a1aa8da563833e395
Partially-Implements: blueprint enable-flake8

This new build script is written entirely in python and supports
multithreading to speed up the builds.

Partially-Implements: blueprint build-script
Change-Id: Ia630e5a83951ec37706a9596427024f3b7c10ba7

Added additional tox test for json / yaml / link /
dockerfile validation. This currently mimics the
existing pep8 test which will be updated to run flake8

Change-Id: Id4657e6d4f4921ab419dc84e8d62468a827aaeb1
Implements: blueprint rename-pep8-validate

A typo exists here which results in the following error:

TASK: [database | Creating haproxy mysql user] ********************************
fatal: [localhost] => One or more undefined variables:
'keystone_internal_address' is undefined

FATAL: all hosts have already failed -- aborting

Change-Id: Ib8e88ca5d755d388a80f06b45e8ea80891f70eb3
Closes-Bug: #1471825

merge_configs can now check if the destination file has the same content
will be written. This information is used to inform ansible no change has
occured

Closes-Bug: 1471514
Change-Id: I78bce04505349d5aafbb027fd3f7d76ab6eccf6a

Partially Implements: Blueprint standard-start

Change-Id: I8a88572a4390824787c663014e6eae52dbb04648

Due to a few issue that exist between keystone v3 and v2.0 the endpoint
needs to be created as v2.0. If it is created as v3, v2.0 queries will not
see the endpoint.

https://bugs.launchpad.net/keystone/+bug/1470635

Change-Id: Ie7ff88b8cbb23b3ca149cb6e8d5a18a427d22038
Partially-Implements: blueprint ansible-service

Sets the restart policy to 'no' for bootstrap containers

Change-Id: I1044fdc70a6b7d50396fd923b6be67bd7c47faa2
Closes-Bug: 1471536

Change-Id: I7711e9ee597184e34c88c0deeaf916fb1547b704
Implements: blueprint add-min-env-vars-gate

The script generating docs/minimal-environment-vars.md now sorts
variables alphabetically per service and remove duplicates.

Update minimal-environment-vars.md.

Change-Id: I30cc674b6e9834f2a6c771bd30539a21af39b228
Closes-Bug: #1470504

We had different issues here.

First, sort command used to sort variables and services names is
dependent on the local, so fix it to C to have consistent
results. C local is available on all systems.

Second, awk doesn't recognize \s escape char for space on OSX. This
resulted in indented check_required_vars calls being ignored. In fact,
all variables checked via indented check_required_vars calls (i.e. in
a fuction or conditional block) are actually *optional* variables, so
I changed the behavior to ignore those.

Change-Id: I6fc4cca9567cb712609d0fe0a20dfe21ed6df151
Closes-Bug: #1470683

Change-Id: I46ffa01d0097916055857c3f968e716e0229795f
Partially-implements: blueprint add-min-env-vars-gate