horizon is a key service and need to be test in the gate.

Change-Id: I89fc1a32b54483c4331c31fb6349dee317c1bc2a

OpenStack requirements constrains is well tested. Use it in case of
installing upstream broken package.

This also fixes latest requests 2.12.2 break docker-py, which makes
kolla gate red.

Change-Id: I3e4ec4af2a6e1280313733e8f31f2eea7669dbc1

Change-Id: I6f9190eccb2e1a1c5bd450ba63833f35f5d09aac

* Build kolla image by using kolla project's code
* bump openstack_release to 4.0.0
* Remove tox deploy related env, it is useless now.

Depends-On: I132ee005bce993cbadf411697817c2e95548dc81
Change-Id: Id899eb39d476b95130fbeb43adf4fd49ef32be32

ARA 0.9.2 was released which deprecates the previous callback location
in favor of a new one. The deprecated location still works but let's
move to the new one right away.

Change-Id: I8a10d5855ab6f813e52cc6efce5bcfe91d9c3f92

The next release of ARA (0.10.0) contains a change to the callback
plugin location that /should/ be backwards compatible but let's
control the update to the newer version to be safe and avoid
breaking the gate needlessly.

Change-Id: I32176166e8ebcbfdf0baa8bd7ec30e5ec6d795a5

The gate jobs are using Xenial as the base OS so it seems we should be
using the same non-infra repos as our base image.

TrivialFix

Change-Id: I6e5d27364054c474c16120a3195cae819861c8a1

We bumped the Kibana version from 4.4 to 4.6 with
Ia18cb89e0951359226add5cbd96d3a91c7fcfd8a. This version should be
used on the gates as well.

Change-Id: I21ccac9a12e4b604d3cf336c6263f2e4cd925524
Closes-bug: #1634049

* use become instead of sudo
* use file instead of shell to change file modes
* rename setup_nodes.yml to playbook-setup-nodes.yml

Change-Id: I69eda1f034b97d13be76efc91458b6d762c76baf

TrivialFix

Change-Id: Id2a13be9c04920b5326534005750286f842aa731
Signed-off-by: Jeffrey Zhang <zhang.lei.fly@gmail.com>

This patch changes version of ceph from hammer to jewel. Also removed
versionlock as it seems we don't use it in ubuntu, and actually might be
risky if we miss security patch on ceph.

Change-Id: Ib8f88c2f914a4b635e59a509fa0194605eb73165
Implements: blueprint upgrade-ceph-to-jewel

use different a docker namespace name in case it pull image from
hub.docker.io when deplying in gate

TrivialFix

Change-Id: I643000e5d9e597a254a4f12c0c10186d4eb20429
Signed-off-by: Jeffrey Zhang <zhang.lei.fly@gmail.com>

In CI environment, MySQL-python wheel package has a wrong _mysql.so
file, which is not compatible with Ubuntu.

Disable wheel index in the CI for pip.

Closes-Bug: #1615231
Change-Id: I127ebb017e09a5bf245e0fdad9bf052203e68e55

Change-Id: I75962ec416a8e4bedb0ad85c93b46cdcd80e8a72
Partially-Implements: blueprint mirrors

DocImpact

Change-Id: I3cdfbf84919de80f535c030bd146787ecda40dec
partial-Implements: blueprint ansible2

this is a wordround fix for the rabbitmq failed when deploy on CentOS in
the CI gate. the ideal fix should set the hostname in setup_gate.sh
script. But it do not work as expect with unknown reason

Partial-Bug: #1581301
Change-Id: Ia692794aadf11d3ebe75e4e2bf6b42d9a5f3996f

* enable the openstack logging debug in the gate
* copy the /etc/kolla files out
* copy the /var/log files out

TrivialFix

Change-Id: I9cf5fa773ec5f41c6ea93325076a64dd24ce22da

Change-Id: I8372df9869df6e83b7a176184ce93da633525cbd
Closes-Bug: #1574134

Sed and check the length of the IP addresses in the private list.
If none found, copy the public to the private.

Change-Id: I05e4798aa301e022de7d5097d503d8213f2b66a8
Closes-Bug: #1571275

This will allow ansible to output to the console log in realtime.

Closes-Bug: #1569769

Change-Id: If4e4ccd9911d9fa9031eed8419bb5a1367c99e49
Signed-off-by: Paul Belanger <pabelanger@redhat.com>

TrivialFix

Change-Id: I21f51811ec4256d9b6b2e219de6201e4811dfc5a

It isn't always possible to get a rax-ord gate. Last patch wasn't
correct.

TrivialFix

Change-Id: Id94264166e0914f038f32f3f9b68e463aa15ccd3

As with all tools, this is a first pass at the generation. Perhaps we
even want to move this into kolla/kolla/cmd and be generated with tox
itself in the future.

This tool, when run, will only populate empty fields that have no
values meaning that it is safe to run repeatedly on the same file.

Of note, there is no way to preserve comments in the file after it has
been processed by the yaml parser in python. Comments and sections
will remain in the passwords.yml template for additional documentation
if the user wishes to populate the file themselves.

Use SystemRandom and clean up the docs a bit to not use pronouns.

Co-Authored-By: Steven Dake <stdake@cisco.com>

Closes-Bug: #1559266
Change-Id: I2932d592df8871f1b7811059206d0b4d0553a687

Change-Id: I169647999b313def30c0605172cf188ef4518cdb
Related-Id: Id9ea8c5e402f3a06b9064a939ad4b2e168cd6223

Test results of this patch set are at
http://paste.openstack.org/show/490450/.

Change-Id: I2957cc70fcca34706ec50a630d785f0630c3f5c0
Closes-Bug: #1553203

The rabbitmq-server package is upgraded to 3.5.7 in cloud-archive
so we update centos to match

The xen-utils package now needs an explict version, xen-utils-4.6 is
what is provided by cloud-archive mitaka

Libvirt 1.3 is in the ubuntu cloud-archive. This has a new daemon for
logging that needs further implementation in newton. For now, it has
been disabled within the qemu.conf

Co-Authored-By: Jeffrey Zhang <jeffrey.zhang@99cloud.net>
TrivialFix
Change-Id: I84217824817c484b6800a64cbd7767b127a3098e

Heka logs almost done. When testing, The collected logs can copy
to the /tmp/logs folder, which will be handle by the gate. This
will be very useful for our gate debug.

TrivialFix

Change-Id: I06ca8ebd13933bfd15cb2fb5e53fc3038b17b8c3

TrivialFix

Change-Id: I0f083654df901fb765e9517308ac94316859d971

Change-Id: I18b1015ca62a352e193ef01bd49cd6d6f9372193
Partially-Implements: blueprint functional-testing-gate

It was run before ansible was installed and did not properly fail.
This prevented the mirrors for apt from being properly used.

TrivialFix

Change-Id: I5331020993b62c8635a4a97dc3a3d2e01e3d4360

Both apt and pip mirrors are added here

Related-Id: I26f5fc5cec224cf4f4ea361e0f71cecbf320fbb0
TrivialFix

Change-Id: Ib3cb1d2c6fb27887e3ea819d277e21ea3a530f56

The existing gate partitioned a disk for use with docker, depending
on the gate it would use the swap disk (RAX) or a spare disk (HP).
However, with the new gates (Bluebox + OVH) there is neither a spare
disk nor a swap disk. This leaves us with one choice: File based loop
device.

This patch creates a file at /swapfile to ensure we have swap. It
creates a file at /docker to ensure we have a loop device for Docker.

Right now the /docker file is 10GB and the /swapfile is 4GB due to
size limitations in the gate across all servers and types. This has
proven to be enough space for all our current tests.

Additionally, reduce the number of threads the gate uses to 4 to
prevent the lockup and hour timeout we have been seeing as more
recently in the gate.

The scripts that setup the gate are moved to the tools directory
rather than the tests directory to match the structure of the other
projects.

Partially-Implements: blueprint functional-testing-gate

Change-Id: I3e370f2382b6df36103d8b2ceda9b21d9b4229d5

TrivialFix

Change-Id: Idb0447a94a730fbcd822a855c865074817dd11b3

This info won't affect gate output as all info is logged to a file.

TrivialFix

Change-Id: Id92c1ebc60937fb376c69541d2f308a9d711c85e

use tox -e genconfig to generate this file

DocImpact

Closes-Bug: #1531202
Change-Id: I3a6e57c3cc48aeb3a45a055b173207ea6e214960

Change-Id: I407793db93ce002cb88bb04193b46869e26d63bc

Docker and docker-py can now be unpinned since Kolla has been
converted to using the kolla_docker module and we no longer rely on
upstream to unblock us.

Change-Id: I6ee2b78c31ef0447da6154b75db381d5cdd55ab6
Partially-Implements: blueprint kolla-docker-module

Change-Id: I25d957a2368fa4e52b5fa9253d7ea5ec4046d830
Closes-Bug: #1521949

To support multinode we must now distribute our setup to multiple
hosts. Instead of making special rules for this, we are going to
convert our existing setup to Ansible. This way both setup proceedures
take place in the exact same fashion.

Partially-Implements: blueprint multinode-gate
Change-Id: I43ece298bba994e9b5083403ef3cf6d4245cda6d

We need to create a directory to allow publishing of logs.

Change-Id: Ieeac5d236b698bedaccb8b5f0bb16f0de9df9386
Backport: Liberty
Partially-Implements: blueprint multinode-gate