Traditionally, Fluentd has used memory buffers for buffering data. While memory buffers are fast and efficient, they come with the risk of losing data in case of a system failure. In order to mitigate this risk, we have decided to switch to file buffers.
Since a Platform Operator possibly collects a lot of log messages from different sources, like service instances and framework components, the default cluster template will eventually not suffice. To meet these special requirements from a Platform Operator, it is possible to use the cluster template to create a special service plan that can be used for this purpose.
Normally only one instance with such a plan should exist in a platform.
Scale OpenSearch Nodes
The following changes to the cluster template should only be made in the context of a specific Platform Operator plan and are not recommended for Application Developer plans.
Since it can be very useful to scale the number of OpenSearch nodes based on the load of the platform, the Platform
Operator can use the default placeholder value
the cluster template to scale the OpenSearch nodes. If it is not explicitly set, 3 nodes will be used. Although it is
possible to increase the number of OpenSearch nodes to over 10, this is not recommended.