- Dec 30, 2024
-
-
Michal Nasiadka authored
Add global_request_id according to oslo.log defaults [1], also support lines like: 2024-12-23 20:48:29.905 2 ERROR oslo_service.periodic_task ['Traceback (most recent call last):\\n' [1]: https://docs.openstack.org/oslo.log/latest/configuration/#DEFAULT.logging_context_format_string Closes-Bug: #2044370 Change-Id: I80c3e20de0b7503de6331b55879e85892323b3d6 (cherry picked from commit 5a3fb2b4)
-
- Aug 09, 2024
-
-
Christian Berendt authored
By default, the watch timer in Fluentd is set to True. To save CPU and I/O consumption this can be set to False, which kolla-ansible has been hardcoding so far. When the watch timer is disabled, in_tail relies entirely on inotify. In certain constellations, this may not work reliably. In these cases, the watch timer needs to be activated, so this change adds a variable to make the setting configurable. Change-Id: Ic8ce6fbc3ed8f31d5d090e114b35703532679729
-
- Jul 25, 2024
-
-
Michal Nasiadka authored
Also stop using the old config name (td-agent.conf) Change-Id: Ied2736b891cd8c6dfcc509a8fd6b1fc8bfe21cb4
-
- Nov 28, 2023
-
-
Michal Nasiadka authored
Depends-On: https://review.opendev.org/c/openstack/kolla/+/901508 Change-Id: I8c7d3de95d0f1f8e57a993b8c3417d90459e19be
-
- May 24, 2023
-
-
lishuliang authored
The default value of logging_context_format_string and logging_user_identity_format has changed [1][2][3]. This is to correct fluentd to use the same format. [1]https://opendev.org/openstack/oslo.log/commit/ebdee7f39920ad5b4268ee296952432b0d41a375 [2]https://opendev.org/openstack/oslo.log/commit/7ed065f38df0595881d07eb91cec9e5c07cb38be [3]https://review.opendev.org/c/openstack/oslo.log/+/838185 Closes-Bug: #1872220 Change-Id: Ide0079ef4d28e3a3fa60288a74b936531c52ce60
-
- Nov 11, 2022
-
-
Doug Szumski authored
Kolla Ansible is switching to OpenSearch and is dropping support for deploying ElasticSearch. This is because the final OSS release of ElasticSearch has exceeded its end of life. Monasca is affected because it uses both Logstash and ElasticSearch. Whilst it may continue to work with OpenSearch, Logstash remains an issue. In the absence of any renewed interest in the project, we remove support for deploying it. This helps to reduce the complexity of log processing configuration in Kolla Ansible, freeing up development time. Change-Id: I6fc7842bcda18e417a3fd21c11e28979a470f1cf
-
- Apr 16, 2022
-
-
LinPeiWen authored
In fluentd v1.0, "format" became a deprecated parameter, replaced by "<parse>" Change-Id: I0825e81fcd90fbc7f64c8df3ea9ae199ad79294a
-
- Mar 23, 2022
-
-
Michal Nasiadka authored
In Xena [1] we removed Monasca Grafana service, but some components were left to support cleanup operations. [1]: https://review.opendev.org/c/openstack/kolla-ansible/+/788228 Change-Id: Iccc7bc3628bb7cbab1ac28f41c7b7dc7695894c6
-
- Dec 28, 2021
-
-
Radosław Piliszek authored
We no longer have to support multiple fluentd versions and rely on the workaround. Change-Id: Id4083a9f07317fc04467e52176850f3909703169
-
- Oct 12, 2021
-
-
Maksim Malchuk authored
This change adds the dnsmasq.log for the ironic-dnsmasq container and also enables more verbose logging when debug logging enabled. This can be triggered globbaly via 'openstack_logging_debug' or per service via 'ironic_logging_debug' or 'neutron_logging_debug'. Change-Id: I0e6b089beb88827effbcc365625eb2df902f5470 Signed-off-by:
Maksim Malchuk <maksim.malchuk@gmail.com>
-
- May 23, 2020
-
-
Doug Szumski authored
The Monasca Log API has been removed and in this change we switch to using the unified API. If dedicated log APIs are required then this can be supported through configuration. Out of the box the Monasca API is used for both logs and metrics which is envisaged to work for most use cases. In order to use the unified API for logs, we need to disable the legacy Kafka client. We also rename the Monasca API config file to remove a warning about using the old style name. Depends-On: https://review.opendev.org/#/c/728638 Change-Id: I9b6bf5b6690f4b4b3445e7d15a40e45dd42d2e84
-
- Mar 18, 2020
-
-
Radosław Piliszek authored
Fluentd cannot accept empty 'path' parameter. I refactored the service list following the general pattern we have. Change-Id: I83d820efcc7e86bac9f8bda26a8f8bece72159e6 Closes-bug: #1867953
-
- Dec 09, 2019
-
-
Mark Goddard authored
WSGI log files use a different input configuration than OpenStack log files. Currently this depends on log files matching either *-access.log or *-error.log. Some services use *_access.log or *_error.log, so are not parsed correctly. This change modifies the fluentd configuration to accept an underscore or hyphen for WSGI log file names. Change-Id: I566d6cac0b6749054fd5422ec8f36f99dacb1db7 Closes-Bug: #1720371
-
- Aug 22, 2019
-
-
Michal Nasiadka authored
In order to orchestrate smooth transition to fluentd 0.14.x aka 1.0 stable branch aka td-agent 3 from td-agent repository - use image labels (fluentd_version and fluentd_binary). Depends-On: https://review.opendev.org/676411 Change-Id: Iab8518c34ef876056c6abcdb5f2e9fc9f1f7dbdd
-
- Aug 15, 2019
-
-
Kien Nguyen authored
Masakari provides Instances High Availability Service for OpenStack clouds by automatically recovering failed Instances. Depends-On: https://review.openstack.org/#/c/615469/ Change-Id: I0b3457232ee86576022cff64eb2e227ff9bbf0aa Implements: blueprint ansible-masakari Co-Authored-By:
Gaëtan Trellu <gaetan.trellu@incloudus.com>
-
- Jun 18, 2019
-
-
Doug Szumski authored
Monasca Python service logs prior to this change were being dropped due to missing entries in the Fluent record_transformer config file. This change adds support for ingesting those logs, and explicitly removes support for ingesting Monasca Log API logs to reduce the risk of feedback, for example if debug logging is turned on in the Monasca Log API. Change-Id: I9e3436a8f946873867900eed5ff0643d84584358
-
Doug Szumski authored
Presently, errors can appear in Fluentd and Monasca Log API logs due to log output from some Monasca services, which do not use Oslo log, being processed alongside other OpenStack logs which do. This change parses these log files separately to prevent these errors. Change-Id: Ie3cbb51424989b01727b5ebaaeba032767073462
-
- Jun 05, 2019
-
-
Cody Hammock authored
If Blazar is enabled, ensure that fluentd processes its logs. Change-Id: If71d5c056c042667388dae8e4ee6d51a5ecab46e
-
- May 31, 2019
-
-
Gaetan Trellu authored
Qinling is an OpenStack project to provide "Function as a Service". This project aims to provide a platform to support serverless functions. Change-Id: I239a0130f8c8b061b531dab530d65172b0914d7c Implements: blueprint ansible-qinling-support Story: 2005760 Task: 33468
-
- Mar 08, 2019
-
-
Bai Yongjun authored
Because kolla-ansible not have cyborg so should add it. Implements: blueprint add-cyborg-to-kolla-ansible Depend-On: I497e67e3a754fccfd2ef5a82f13ccfaf890a6fcd Change-Id: I6f7ae86f855c5c64697607356d0ff3161f91b239
-
- Feb 22, 2019
-
-
Pedro Alvarez authored
For other architectures, fluentd is not installed using the td-agent package. Change-Id: I508bf16a54dcadac4b5cba03e184b4f620a2b395 Depends-On: https://review.openstack.org/638692
-
- Nov 20, 2018
-
-
Eduardo Gonzalez authored
OpenDaylight logs have different format than openstack, is a karaf log with java error traces. This PS add required config to make fluentd parse properly ODL logs. Change-Id: I34fb96c8a424679b3b618f2ff6a840b8dc165bec
-
- Jul 10, 2018
-
-
Stanislaw Bogatkin authored
There are cases when we can lost original timestamp field given from logs, like when we send our logs to the next fluentd forwarder in chain of forwarders, it will rewrite our timestamp by default. Save `Timestamp` field explicitly to avoid such situation and be able to reconstruct messages date and time. Closes-Bug: #1781046 Change-Id: I2b4486aedacbe16dc4c0fb2e4e4984bd80e59f2d
-
- May 21, 2018
-
-
Doug Szumski authored
Deploys the Monasca API with mod_wsgi + Apache. Co-Authored-By:
Mark Goddard <mark@stackhpc.com> Partially-Implements: blueprint monasca-roles Change-Id: I3e03762217fbef1fb0cbff6239abb109cbec226b
-
- Dec 29, 2017
-
-
Mark Goddard authored
Previously ironic inspector logs were not being collected, as they are stored in /var/log/kolla/ironic-inspector/ rather than /var/log/kolla/ironic/. This change modifies the fluentd input configuration to use the correct directory. Also adds the ironic-inspector service to the fluentd programname rewrite rule. Change-Id: Ie5d67f395e4c32fef992e674f2d53dbd6a17f238
-
- Sep 18, 2017
-
-
Bertrand Lallau authored
Disable the additional watch timer (enable_watch_timer). Setting this parameter to false will significantly reduce CPU and I/O consumption when tailing a large number of files on systems with inotify support. Change-Id: Ib432e6cdece01dbb94b3d2f3d7fbdd04b81d25fa
-
- Sep 04, 2017
-
-
Bertrand Lallau authored
Actual Fluentd config doesn't manage multiline log pattern like: 2017-08-16 21:41:03.097 7 WARNING oslo_config.cfg [-] Option "firewall_driver" from group "DEFAULT" is deprecated for removal ( nova-network is deprecated, as are any related configuration options. ). Its value may be silently ignored in the future. This log will generate 1 Fluentd event for each line (in previous example 3 events). This is really a wrong behaviour and made Kibana interface not friendly. This patch uses a multiline parser. Change-Id: Iee337645d1dc42876ec79be08ee3715f11a53d87 Closes-Bug: #1711399
-
- Aug 29, 2017
-
-
Bertrand Lallau authored
Actually a unique 'tail' source is used for all logs files in kolla/*/*.log. So log files from services like: chrony, elasticsearch, etcd, grafana, influxdb, kibana, mongodb... are actually processed by our Fluentd config, but should not cause all following config will failed to parse them. It just uses CPU for nothing cause they will never match the following filters: * record_transformer => add Hostname, Logger, programname field * rewrite_tag_filter => rewrite 'programname' TAG if needed Hence these filters should only be applied to Openstack services logs to avoid CPU usage. Furthermore WGI and Apache logs files must be treated differently. Change-Id: I425979160291e1123e3775e39243bca06ed22c2f Closes-Bug: #1711390
-
- Aug 21, 2017
-
-
Eduardo Gonzalez authored
Fluentd repo/packages are changed in depends changes below. Rpm distros need changes in their config for properly start and deploy fluentd containers. Change-Id: I474c4d20c407717c6da973383bbbd5539be480f1 Depends-On: I4802618373cfa53d67d1dfe65be7abe1950b3d04
-
- Apr 05, 2017
-
-
Bertrand Lallau authored
Issue seems not fixed, it requires more work This reverts commit 4f6470bb. Change-Id: I308ea4e0d5ace60cf730944e1883966fc6f8f8ce
-
- Apr 02, 2017
-
-
Bertrand Lallau authored
Fluentd actually parse all files in /var/log/kolla/*/*.log as Openstack services files. Dnsmasq file /var/log/kolla/neutron/dnsmasq.log, must be add to exclude_path to avoid this warning message: "/var/log/kolla/neutron/dnsmasq.log unreadable. It is excluded and would be examined next time." Change-Id: I8dc5320b9ed299200c4f1e6ee52d34a918e2f110 Closes-Bug: #1678530
-
- Jan 24, 2017
-
-
zhubingbing authored
* add fluentd role * remove heka configure Co-Authored-By:
yangzb09 <yangzb09@qq.com> Partially-Implements: blueprint add-fluentd-role Change-Id: Ica804a99f5bb8b157f406299c5982b7b6283b3e3
-