When using XenAPI as the virt driver, we need some XenAPI
specific configure options. This commit is to ensure nova's
configuration can be generated correctly for XenAPI. It
includes the folowing changes:
* Add XenAPI as one of the valid options for nova_compute_virt_type;
* Configure some options when XenAPI is chosen as the virt type.

This commit does NOT include the host and [vnc] configurations which
will be covered by a following commit.

References:
* XenServer (and other XAPI based Xen variants):
  https://docs.openstack.org/nova/pike/admin/configuration/hypervisor-xen-api.html
* XenCenter HIMN plugin (adding HIMN network which is used by XenAPI driver to
  communicate with XenServer):
  https://github.com/citrix-openstack/xencenter-himn-plugin
* nova configuration options:
  https://docs.openstack.org/nova/pike/configuration/config.html

Change-Id: Id34d247ab78976627f8e70685f27470b254cd418
blueprint: xenserver-support

- remove useless *_url, which can be auto discovery
- use internalURL instead of publicURL which make it works when
  using self-signed SSL certification.
- configure network_driver to Neutron
- add network_label_regex to match all network name

Change-Id: I5654dbf391db7076c82aede5c2a4f8b7530b8381
Closes-Bug: #1734039

Change-Id: Ibfa777065291c2e9c2ae00db5288afc8db91e055
Closes-Bug: #1735095

Added ``horizon_keystone_domain_choices`` hash. It can be used to set the
available domains to choose from on the horizon login page. This feature
was introduced in pike release.

Change-Id: Ia7d2bc45e518848a04ce78e7833e1cf9a0ef21ce

There are corresponding image changes to go with these ansible
changes - changes in rsyncd template, and add
environment settings for RSYNC_CONNECT_PROG (i.e. nc)

nc allows for rsync replication to easily target {{ swift_rsync_port }}

update the lock file and chroot settings in template - see bug
for more details.

Change-Id: Ic81b7de8fad8aec9416e4e27e8ffda6d03be293c
Closes-Bug: #1733851

Nova network has been fully removed from the OpenStack codebase.
As such, all instances of switches on use_neutron should be removed,
as the functionality will never be meaningful.

Change-Id: I6af9af897b5a4416082307e01dca951c9b7026ad
Depends-On: Ib9d87dd339d637b69fb27315d92228cbc523c8eb

Cinder backends that utilize iSCSI protocol require iscsid on
compute and storage nodes to handle volumes and their backups.

Change-Id: I1c735d2abace4b46879be99731ead47d578335ea
Closes-Bug: #1725258

Close-Bug: 1732846

Change-Id: I6489599453ae56a60281ecbae9ce85aa59b1162a

This commit separates the messaging rpc and notify transports in order
to support separate and different oslo.messaging backends

This patch:
* add rpc and notify variables
* update service role conf templates
* add example to globals.yaml
* add release note

Implements: blueprint hybrid-messaging
Change-Id: I34691c2895c8563f1f322f0850ecff98d11b5185

Make sure at least one Cinder backend is enabled if enable_cinder=True

Change-Id: Ie40f4832f7860fcbc7074b61df9f49fcaed2471b

This patch introduces inner-compute and external-compute nodes
group to distinguish compute nodes which do not have external
reachability from compute nodes which can reach outside.

Co-Authored-By: jinke <jin.ke@99cloud.net>
Co-Authored-By: yong sheng gong <gong.yongsheng@99cloud.net>

Change-Id: I45b945f7885e8243b017cf8607cbd7f9827cb6e9
Closes-bug: #1722026

Previously the glance ceph backend was only being configured during
the deploy and reconfigure commands. This change ensures that it is
configured during the upgrade and genconfig commands as well.

Some of the related host/group selection logic has been cleaned up,
as it was a little tautolgous.

Change-Id: Ibfc2bfaaf2e24fb3a0697925e7723794046787fa
Closes-Bug: #1728060

The current syntax of Ubuntu fluentd rewrite rules are not supported
anymore, reference to this commit[1].
According to the build of this patch[2], The Centos has no such isuue.
Only Ubuntu needs to be upgrade to use the <rule> section.

* Centos use 01-rewrite-0.12.conf.j2
* Ubuntu use 01-rewrite-0.14.conf.j2

backport: pike

[1] https://github.com/fluent/fluent-plugin-rewrite-tag-filter/commit/248ed8e97def0a60121199c0d0e2fa8785f0d076
[2] https://review.openstack.org/#/c/517907

Depends-on: I47985113fe732569d640a262ca832c6edc8c2bb6
Change-Id: I0b131c2f65652cf3c61b33d8162097b047603923
Closes-Bug: #1730664

  1- Expand and migrate database in first keystone node
  2- Upgrade all nodes sequentially along with updation of each node's
     configuration file with latest release version
  3- Last keystone node, contract database

With this patch, there is small downtime when all containers are
restarted. It will be fixed in other patch.

[1] http://docs.openstack.org/developer/keystone/upgrading.html#upgrading-without-downtime



Co-Authored-By: Surya Prakash Singh <surya.singh@nectechnologies.in>
Co-Authored-By: Eduardo Gonzalez <dabarren@gmail.com>
Co-Authored-By: Duong Ha-Quang <duonghq@vn.fujitsu.com>

Partially-Implements: blueprint ks-rolling-upgrade-role

Change-Id: I2159af567c40848840ff5e483e7d1f6de760b435

Endpoints are updated in pike upgrade,  queens and later
dont need such action.

Change-Id: I13723bafc4bf09c24d9bcd2ec7b4e002ae83aec0

Now that the "openstack_auth" in defined in all.yml,
the freezer should better use it.

Change-Id: Ibe799ce6bb1656994b1e9b6642d1011d9dcf30a7

dns-integration extension should be enable when
vmware is used.

Change-Id: I31943146e139108a913b9b5e9a0b0283b8ae4830

We should not assume the VIP is accessible from the deploy node.

Change-Id: I39640f98b4adddb9cb8dfdd09d9fb7ecba15a820
Closes-Bug: #1730651

In the following config:
enable_cinder=False
enable_cinder_backend_iscsi=True

Iscsi and tgt containers are deployed but should not.
This patch fix it.

Change-Id: I1d66627b9979b5dc570bbc3e1e865311dd7e7bb0
Closes-Bug: #1715618

Change-Id: I4cf1716c94e4fd808b66169348b07fa42e5b242e
Depends-on: I8fbef57b99122b8a093150f6ca1efdd33e032917

In case of external router internal VIP and external VIP are the
same. External router manages port/address redirection from
public network to OpenStack API. The address of the router is
set via 'kolla_external_fqdn'. Currently Murano configuration
that is handed over to Murano application instance uses
'kolla_external_vip_address'. This leads to the instance trying
to connect to internal API network. Correct address should be
'kolla_external_fqdn' which will work in both cases - either with
double VIP setup or with single VIP + external router.

Change-Id: I78c38ae0af1cecd2be2b1c6cc86bcfc51b847082
Closes-Bug: #1729611

Object versioning is necessary to pass DefCore test suite,
i.e. allows Kolla version of OpenStack to be certified
as "OpenStack Powered Platform".

Change-Id: Id5003f7fe2aebdeffe1cf7ce1b6177a6bca8f5b6
Co-Authored-By: Alexander Reunov <alexander.reunov@oracle.com>
Closes-Bug: #1729583

backport: pike

Closes-Bug: #1729564
Change-Id: If6db5fad1f23e0afaadcad97b4f37a13e34de9fa

When deploying on debian, it reports error:
stat /usr/bin/ansible: no such file or directory

That's because on Debian and Ubuntu pip install ansible to
/usr/local/bin/ansible, whereas on CentOS the location is
/usr/bin/ansible.

Change to ansible to handle both cases.

Closes-Bug: #1729216
Depends-On: I2b57403128bc103148ae696c219df52590214adc

Change-Id: I025037cf48596450e6479ab7ff6425c48ac73aad
Signed-off-by: Xinliang Liu <xinliang.liu@linaro.org>

Add become to only neccesary tasks in roles:
- glance
- heat
- horizon
- keystone
- neutron
- nova
- openvswitch

Gate is also updated to use 'become' feature

Change-Id: I2f3f27306e9f384148e1ad4d54d8da2ebef34d00
Partial-Implements: blueprint ansible-specific-task-become

Become option is missed in patch #398682, this patchset fix this issue.

Change-Id: I228c31486210ef1de76601d3ea4ee955a628ca73
Partial-Implements: blueprint ansible-specific-task-become

When using external Ceph cluster, glance_api container is only running
on one controller instead of running on all of them.

But when an external Ceph cluster is used, enable_ceph is false so
glance_backend_file is true

Using "not glance_backend_ceph | bool" instead of "not enable_ceph |
bool" should be enough.

Change-Id: I191e5ea7a0d51b0e19ed58a819c3ade5070f623d
Closes-Bug: #1722905

HyperV support disables tunneling for entire environment. This
should not be the case since tunneling can be used for KVM in mix
env. In this case, HyperV VMs can only use flat/vlan networks.

Change-Id: I6237c42918442625acd946b7455d236612ba19cc
Closes-Bug: #1725417

This reverts commit c618dbcd.

Pike is already released

Change-Id: Id54a90e1c1d60f2be02ff4af3b648671d053c6a6

Change-Id: Ia691eb7ea315f60259473bd624ee72c4c2bbe89f

Iscsi containers on compute and storage nodes in
restarting mode w/o config files

Closes-Bug: #1727785

Change-Id: I1c2b1db791dc9be76e60425e4752d64ffba34f1b

the auth is used for registry, but the horizon not need, so the
openstack_horizon_auth should be remove.
refer to https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/nova/tasks/register.yml#L13

Change-Id: Ibd8985651bd64cba3e30c15596f0ae6d692b973b

This reverts commit c85e0464.

Closes-Bug: #1720481
Change-Id: I4c11f81b0241dfd35d40d7ce2d4513dc0f4a7d4d

panko.conf depends on "service_name" variable, but when generating
panko.conf in ceilometer, this variable is not set.

Panko is a single process service, no need add such test. So simple
remove the if clause.

Change-Id: I5ba41046e35cd3fa00b8c22e1b4435acfaff5279
Closes-Bug: #1725159

Change-Id: Ib0512481aebf56b26f93955e682ea0cb80cb5bc4

By default the syslog input plugin won't extract the
log level from a syslog message. By setting the priority
key, the log level is extracted.

Partial-Bug: #1725240
Change-Id: I9ad5f5e1c875ef62b39fbbba7b271d98cee68dd6

Change-Id: I27508cb182bc3d3e2a0cbd7d429fe65d2271b2ea

Number of workers for Watcher api service can not be configure, this
patch to fix it.

refer to https://github.com/openstack/watcher/blob/master/watcher/conf/api.py#L43

Change-Id: I2763b8e225ceb4b8e067d53b8d5f0ffba31563a6

flat network type is not mandatory. There are two cases,

1. ironic with flat network: we can use neutron vlan network to
   provision baremetal nodes, as long as the interface of the baremetal
   nodes are configured to use the same vlan.

2. ironic with neutron network: all provision and cleaning_network can
   be vlan type and no flat is needed at all.

So we should remove the task.

Change-Id: I176ded6d2a8b14e350f665f63bc37eb488d32679
Closes-Bug: #1725170

This applications package is useful to have in place,
import io.murano.applications along with the core package.

Change-Id: I819eebe2deae2d1ff0375a2dd39a33f50817bb83