Fluentd repo/packages are changed in depends changes below.
Rpm distros need changes in their config for properly
start and deploy fluentd containers.

Change-Id: I474c4d20c407717c6da973383bbbd5539be480f1
Depends-On: I4802618373cfa53d67d1dfe65be7abe1950b3d04

Change-Id: I43fec45a49198daedddbb7c5d477690bbe3864e8

http://paste.openstack.org/show/617484/

Change-Id: I1c771b8012c12300adb611b85898bbf2ef2fe67f
Closes-Bug: #1708449

for example: the placement-api regular match
will override placement-api-access

Change-Id: I80ed896b2477709599be0ce73e00d03da1858349
Closes-Bug: #1708468

kolla-kubernetes is using its own configuration generation[0], so it is
time for kolla-ansible to remove the related code to simplify the
logical.

[0] https://github.com/openstack/kolla-kubernetes/tree/master/ansible

Change-Id: I7bb0b7fe3b8eea906613e936d5e9d19f4f2e80bb
Implements: blueprint clean-k8s-config

* remove ceilometer-api and ceilometer-collector service
* use ceilometer-notification to publish message to proper backend
* remove useless ceilometer_database_type and ceilometer_event_type
  variables
* sync event_definitions.yaml, event_pipeline.yaml and pipeline.yaml
  file with upstream

Change-Id: Ib39053cb5f70bd11ee61d3f26d5b28accecd7190

Zun-api is using app.wsgi as log filename.
This change forzes zun-api.log to ease identification.
Also changes group owner of log dir to kolla group.
Remove glance version as is in zun's defaults
Set state_path, this is where zun will store catched images,
similar as nova cache. No need HA or volume as is only
cached data.

Change-Id: I20f8d311bfde1c0a07d7d35e9f1412c71efa8504

Logrotate configuration is missing for ironic-inspector. Prior to [1],
ironic-inspector logs were stored in
kolla_logs/ironic/ironic-inspector.log. After [1], the logs
are stored in kolla_logs/ironic-inspector/ironic-inspector.log
but the logrotate config was not updated.

[1]
https://github.com/openstack/kolla-ansible/commit/07453f346094b184a209380e375f6311987675be

Change-Id: I7e78faea361cd67069c1a96aaf0a2ffffc0e8666
Closes-Bug: #1701578

change api.log and registry.log to glance-api.log and glance-registry.log

Closes-bug: #1700718

Change-Id: Ifcde8699fa9537fa06445f79c4bd14b4ee0df32c

Certain services such as Murano and trove require access to a rabbitmq
instance from tenant networks. [0]

Exposing the internal rabbitmq to end users is a security hole, hence
there are two options, 1) use vhosts in the existing rabbitmq, or two a
separate rabbitmq instances. Given the importance of rabbitmq to the
OpenStack deployment, we have decided to go with a separate instance.
Refer to [1] for more detail on the various options.

This change makes the rabbitmq role generic so that it can be reused, in
this case to start 'outward_rabbitmq'. It needs to be exposed via
haproxy both for network isolation and also because this is what Murano
configuration requires.

Follow on patches will be added to add a vhost in this outward instance
for Murano and other services which require access.

Based on the original work by bdaca[2]

[0] http://murano.readthedocs.io/en/stable-liberty/intro/architecture.html
[1] http://lists.openstack.org/pipermail/openstack-dev/2016-December/109091.html
[2] https://review.openstack.org/#/c/374525



Change-Id: Ib2bcc7ed4bf4f883a7cd1dfad3db89201e3cfd8d
Partial-Bug: #1620374
Depends-On: I020eb6219f89a310451becde41f6f1c7f54baadd
Co-Authored-By: Bartłomiej Daca <bartek.daca@gmail.com>

Missing config options in kuryr.conf
Missing kuryr logging
Remove useless bootstrap task, justs create a directory
Wrong user permissions in config.json file.
Missing volumes
Missing container capabilities

Depends-On: I4c08a21df263fdefe1fe991cb7ad41cfee65019d
Change-Id: Id4577a78ebf3f1cda5ee36d14e2cc017f38e0f07
Closes-bug: #1697480

Zun rule number causes conflict with rule 24,
it should be updated to the next free number.

Change-Id: Idbe346bda4ca5dc50f6b5e63818b12af33d532a3

Change-Id: I929587720c622833764c61543cac7675360ccdcb

There is a typo in cron.json making cron to fail
when mongodb is enabled.
Only affect master.

```MissingRequiredSource:
/var/lib/kolla/config_files/logrotate/mongdb.conf file is not found```

Change-Id: I79d41e94ee3361f2b4d831d17b1bb34a1964f580

Many of the templates use 600, remove unnecessary permission
on these templates to bring them in line with the others.

Change-Id: I30fe1b3822b9c7bb6ab98729fc519dc1d603db27

Useful api_interface_address variable has been define here:
https://github.com/openstack/kolla-ansible/blob/master/ansible/group_vars/all.yml#L57
In order to simplify codebase we must use it as much as possible.

Change-Id: I18fec19bf69e05a22a4142a9cd1165eccd022455

This changes moves cinder-api to make use of apache to
launch its processes.
Ubuntu binary removed support in Ocata for cinder-api
system services [1]. At this moment cinder in Ocata branch
is not working at all due this issue.

This changes aims to fix cinder in master only for ubuntu
binary with the purpose of make a clean backport to stable/ocata
without do any other change on the backport process.
A follow up change will migrate other OS/install_type to make use
of Apache but only changing master branch.

[1] http://lists.openstack.org/pipermail/openstack-dev/2017-January/111069.html

Change-Id: I9885d6acadbac1da46844f583e7cd37785505ae0
Closes-Bug: #1676751

As the logrotate will create new filename with timestamp, fluentd
with symlink will staled when restart fluentd and can not set
permission on the old file.

Remove symlink from the global conf.

Change-Id: I404868d5b5077b9f2135e37605421bc84717f9d3
Closes-Bug: #1685170

This patch fix log rotation issue on the following services/program:
- ceph
- chrony
- collectd
- congress
- etcd
- influxdb
- ironic
- kibana
- kuryr
- mongodb
- rally
- tempest
- trove

Change-Id: I1246c071b7340b3267226cefb64a04da1cce9f26
Closes-Bug: #1688649

When Kibana interface is opened for the first time, it requires creating
a default index pattern. To view, analyse and search logs, at least one
index pattern has to be created.
This patch automate "flog-*" default index pattern creation and set it
has default config.

Partially-implements: blueprint default-kibana-dashboard
Change-Id: Ie36696f9ad38ba7e49e65e0793a3b98d9f03ee8d

Change-Id: I6c769e5231e9d0e327ef6b9928666369d694f5fe
Closes-Bug: #1685692

Issue seems not fixed, it requires more work

This reverts commit 4f6470bb.

Change-Id: I308ea4e0d5ace60cf730944e1883966fc6f8f8ce

Fluentd actually parse all files in /var/log/kolla/*/*.log as Openstack
services files.
Dnsmasq file /var/log/kolla/neutron/dnsmasq.log, must be add to
exclude_path to avoid this warning message:
"/var/log/kolla/neutron/dnsmasq.log unreadable. It is excluded and would
be examined next time."

Change-Id: I8dc5320b9ed299200c4f1e6ee52d34a918e2f110
Closes-Bug: #1678530

Change-Id: I13cf03d6a97fb94dd7cb309e99a417ad101dc21a
Co-Authored-By: Mauricio Lima <mauriciolimab@gmail.com>
Partially-implements: bp add-zun-ansible-role

Haproxy binds the elasticsearch service to kolla_internal_vip_address but
the output templates for fluentd (td-agent) point to a non-existent
kolla_external_vip_address.

Output should also be able to be sent to an external elasticsearch
instance (as per the documentation regarding overriding
elasticsearch_address)

Change these settings so that fluentd outputs to either
the default elasticsearch_address (i.e. kolla_internal_vip_address) or to
the external elasticsearch instance.

Closes-Bug: #1673990
Change-Id: I081533ae8ea9aad186e9c44e1dee069729931453

Fluent rewrite_tag_filter output plugin must be updated for the
following services:

* Congress
* Designate
* Freezer
* Manila
* Murano
* Octavia
* Senlin
* Trove
* Watcher

Change-Id: I5329002c99f5c940921dff107f2120bafb158168
Closes-Bug: #1673208

Nova placement api, cinder api, volume logs along with mistral logs
are missing from the filter which will allow elastic search to fetch it
from the fluentd

Fixes the issue

Change-Id: I7899ce6e010bfc6534a88f0a2117dc0a9e60c7c7
Closes-Bug: #1673002

Services config files are missing in cron command.
Cron Jinja template has been adapted in order to take it into account.

Change-Id: I5aef67b774ddaf83afdfe03d099b91e68a11ae1d
Closes-Bug: #1673163
Closes-Bug: #1673193

In some case, public interface may not reachable in internal.

Change-Id: Ibcdef571a6814e6626216fe33028e5e69889b4f2
Closes-Bug: #1670259

Change-Id: Id7be86955b357199fde2ab57a9b24e1f49ecebcd
Closes-Bug: #1667671

Change-Id: Icddd27ef0f5041ace848eec75e732143635c1001
Closes-Bug: #1665005

Change-Id: I93fe8141a88d6e0600a1f44fe49d96d7816fae87
Closes-Bug: #1664868

Depends-On: 810fcdd28669bbd317c290d498d590ddb2c32f65
Change-Id: I88eff57448cc29ddff0f301f210623b2309e6b4d
Closes-Bug: #1663126

Change-Id: If77663306e68e7a35f3e6772490a5622b7a8d32f

maxsize do exist and is better than size. need another approach to
solve the issue.

This reverts commit c4107ed7.

Change-Id: I76eb00a9771907b071d974db33c15accd404e9ec
(cherry picked from commit becbee122c194b2c7d4acd084c60ee07c897c2b8)

This PS fixes some bugs that causes trunk not to work for
kolla-kubernetes.

Change-Id: I4eaba87c9c75a85ac16823a77ab197e62254e66e

Co-Authored-By: caoyuan <cao.yuan@99cloud.net>
Co-Authored-By: zhubingbing <zhubingbing10@gmail.com>

Change-Id: I419f7ceb219ea9643cfd225c130018f967ddd860
Partially-implements: bp freezer-ansible-role

* add fluentd role
* remove heka configure

Co-Authored-By: yangzb09 <yangzb09@qq.com>

Partially-Implements: blueprint add-fluentd-role

Change-Id: Ica804a99f5bb8b157f406299c5982b7b6283b3e3

Implement ansible role to deploy designate
and dependencies. The backend used is bind9.

Co-Authored-By: zhubingbing <zhubingbing10@gmail.com>
Co-Authored-By: Eduardo Gonzalez <dabarren@gmail.com>

Depends-On: 6d0dc3e0f931c7c50b64a4659900cc50b0d860a2
Implements: blueprint ansible-designate
Change-Id: I34d8126e0cd8d71d5ced9b62f3776cc354fbb549

Co-Authored-By: zhubingbing <zhubingbing10@gmail.com>
Co-Authored-By: zhangshuai <446077695@qq.com>
Co-Authored-By: Mauricio Lima <mauriciolimab@gmail.com>

Change-Id: I7aebe544e3495767d6389dbf220d633a98c137da
Partially-implements: bp karbor-ansible-role