add monitoring of zookeeper

Change-Id: I1db23b67dd8f83f9341a376d9cd2d9a49abd4427

add monitoring of redis

Change-Id: Ic6becef0c528083d48458c8dcaa10a2ca6c238a9

Some Monasca services support sending StatsD metrics to
allow monitoring those services. This commit connects
these services to the StatsD service provided by the
Monasca Agent.

Partially-Implements: blueprint monasca-roles
Change-Id: I1da376384a31b89fea1b8a6f907aea35282909a4

This allows storm worker and nimbus services to be deployed on
separate hosts.

Change-Id: Icb990d289fbfb4d8f782c255fc50d092964384f7

The concept of splitting the compute group into external/internal just
to specify agent_mode for Neutron DVR was deemed to be heavy handed, and
depreacated in the Pike cycle.

Now that Rocky has been released we can remove these completely for Stein.

Change-Id: I28a1eba7f40fee55a7ec41c27451e39e4d7fd8f0

Closes-Bug: 1786741
Change-Id: Ic217f3f8194cdcb5e28045e771a0160c1f12280e

Coordination is required for active-active cinder volume.

Change-Id: I9b26831fd951a24c483840a55824fae06ccbbf81
Closes-Bug: #1796615

The Monasca Grafana fork allows users to log into Grafana with their
OpenStack user credentials and see metrics associated with their
OpenStack project. The long term goal is to enable Keystone support
in upstream Grafana, but this work seems to have stalled.

Partially-Implements: blueprint monasca-grafana
Change-Id: Icc04613b2571c094ae23b66d0bcc38b58c0ee4e1

This changes allows the user to configure a Monasca database
which may be different from the default database.

Partially-Implements: blueprint monasca-roles
Change-Id: Ia905190b8037ecb1782a758c0b65581fe9024bf6

TrivialFix
Change-Id: Iaf216016a6acf0e9c87fdb6b8902416f4849efa3

Monasca uses Kibana for viewing and searching logs. A future commit
will add support for the Monasca Kibana plugin to provide tenant
scoped access to logs.

Partially-Implements: blueprint monasca-roles
Change-Id: I42b6a35f9a526ef41ff3d7cfac140fbc5596a524

Before this change the HAProxy configuration for Monasca printed:
  "Copying over haproxy haproxy config".
This change fixes the message.

TrivialFix
Change-Id: I2823775f6fa5b0be919b567f311c671f1469d19f

Make it easy to override the Keystone endpoints to support deploying
stand-alone Monasca which can integrate with an externally provided
Keystone instance.

Partially-Implements: blueprint monasca-roles
Change-Id: I9ae3b243c792ef88075702b47b62f164a1705c2e

This commit adds some filters which format logs so that they
can be correctly sent to the Monasca Log API by the Monasca
Fluentd plugin. In the future the Fluentd plugin could be
extended and this config could be removed.

Partially-Implements: blueprint monasca-roles
Change-Id: I87b6dfb3052d03f87349d30b66078c39d625195d

Partially-Implements: blueprint monasca-roles
Change-Id: I19db9396bb53b6db77cf97d7969ca24a55d8db0e

The Monasca Agent collects metrics and in this change is deployed
across the control plane. These metrics are collected into an OpenStack
project. It supports configuring a small number of plugins, which can
be extended in later commits. It also makes the Monasca Agent credentials
available to other roles, such as the common role to allow forwarding
logs to Monasca.

Partially-Implements: blueprint monasca-roles
Change-Id: I76b34fc5e1c76407a45fcf272268d5798b473ca2

Currently, the serial consoles as accessed through Horizon,
timeout after the haproxy_client_timeout (default: 1m) of
inactivity. This change allows you to set a larger timeout.

Change-Id: I2a9923cb69d5db976395146685aded83922c4120
Closes-Bug: #1800643

This patchset implements Neutron rolling upgrade logic as described
in [1].

Due to only neutron, vpnass and fwaas have supported for rolling upgrade
database migration, so I used the list "neutron_rolling_upgrade_services"
in neutron/default/main.yml for contain there services.

[1] https://docs.openstack.org/neutron/latest/contributor/internals/upgrade.html

Co-author: Ha Manh Dong <donghm@vn.fujitsu.com>
Change-Id: I2ed2f941d30d4df0d0f42c0d10e7ca03ec1c166a
Implements: blueprint apply-service-upgrade-procedure

move the merge_yaml and merge_config module's DOCUMENTATION and
EXAMPLES into action_plugins.

Change-Id: I84c5b94afb870fc9a25838782389f7b1f8b882fd
Closes-Bug: #1799236

Trivial-Fix
Change-Id: Iea123c32981309698bd644229dc1525fa671a487

A small number of services set the recurse flag when they create
their config directory. This can change permission of files within
the directory, which are later set back to the original state. The
side effect is that the service is then restarted, even though the
net change to the config files amounts to nothing. The expected
behaviour is that a service only restarts if the config *has*
changed. This patch fixes this issue.

Change-Id: Ib6f1ca7b416247f8d455fb25892f4a3b27de03ba
Closes-Bug: 1800480

Vitrage config is missing keystone_authtoken, it leads to CRITICAL
bug when deploy [1]

[1] http://paste.openstack.org/show/733507/

Change-Id: Ia89befed16bef5dbf0f542ea1a843b6b448079e9

That's because instead of start_container we need to
use recreate_or_restart_container in handler.

Change-Id: I3bb0a4c38b9024b2e2e26bfc06cb143bb5d35317
Signed-off-by: Pavel Glushchak <pglushchak@virtuozzo.com>

This small change prevents the deployment group from being mandatory.

Change-Id: I5693fbad0d5677ae341121619b6ec2e8738cffb7

Change-Id: I0cbc51eedb218f6b2f7d5c50372ad7a8be9bdcc0

All other project names are lowercase.

Change-Id: I7046d3f6b610a46a69504a283c933d83f266a3db

Change-Id: I4d409e052c00d83b451a2a13917f89531a88457f

Two new parameters (migration_interface, migration_interface_address) to make
the use of a dedicated migration network possible.

Change-Id: I723c9bea9cf1881e02ba39d5318c090960c22c47

Closes-bug: #1799348

Change-Id: I4c43076795d28ea36f9e1d165e56abb110c5b544

Change-Id: Iedfad564f834504fa1f4bfd935cd735d1d9ee65f

Change-Id: I114c582181e0c58fc5b3ce5b1735fb54a0fdd93e

Change-Id: I0412c4d15fea97cf466287a5bed62427b43df7ea
Closes-Bug: #1799243

zun-wsproxy group is used in multinode[1], but it missing from
site.yml this PS to fix this.

[1]: https://github.com/openstack/kolla-ansible/blob/master/ansible/inventory/multinode#L676

Change-Id: I3b06f15dba5b6569202b038a28fb1a2728cffd25
Closes-Bug: #1799234

Introduce a job 'kolla-ansible-ubuntu-source-zun' to test kolla
with Zun enabled. To reduce CI resource, this job will be triggered
only if there are changes on the Zun's ansible roles.

Change-Id: I0ba207e1d3761da2d6992c5834d4f59e7e1d6628

Fix the path of fernet cron for centos images

Change-Id: Iedf3a8630bc3c25fd05f580980d499023bf974fa

Change-Id: I5631fd12d8cd1815ba0045f3fad272066265e3f5
Closes-Bug: #1798971

Change-Id: I288fa5ea202376d481de6966150e7e050e390f03
Partially-implements: blueprint better-reconfigure
Co-Authored-By: caoyuan <cao.yuan@99cloud.net>
Closes-Bug: #1796219

By adding 'become' element, you can set ceilometer as non root user.

Change-Id: I146f3aec6b1270d40c02f4f7883c169aaa796239
Closes-Bug: #1798035

Alarm service has been moved to Aodh for a long time [1].
Therefore, we should define evaluation_interval in
aodh.conf rather than ceilometer.conf. The interval value
should be configurable as well because we can use a
custom polling config now [2]

[1] https://review.openstack.org/#/c/200593/
[2] https://review.openstack.org/#/c/572013/

Change-Id: I7adeff2dff5d6d6ae4c621e84857347995e9203a

When Monasca is enabled disable direct logging to ElasticSearch and
send all logs harvested by Fluentd to the Monasca Log API.

This change also cleans up output files which may be left behind when
the various log forwarding options are enabled / disabled.

Partially-Implements: blueprint monasca-roles
Change-Id: I7197966c5117176407d60c86c08d3bcea5e8131a