Why am I seeing duplicate metrics or logs being sent from my clusters?
You are seeing duplicate log entries for your clusters.
The most common cause for this issue is that you have multiple logging agents installed in your cluster.
Remove the unsupported observability plug-in resources from your cluster.
-
Check for the unsupported agents.
oc get daemonsets -n ibm-observe
-
If there is a
logdna-agent
or asysdig-agent
, remove them.Example output that shows the resources which need to be removed.
NAME DESIRED CURRENT READY UP-TO-DATE AVAILABLE NODE SELECTOR AGE logdna-agent 9 9 9 9 9 <none> 4d sysdig-agent 9 9 9 9 9 <none> 4d
-
Delete the resources.
oc delete daemonset logdna-agent -n ibm-observe oc kubectl delete daemonset sysdig-agent -n ibm-observe
-
Verify the daemonset and its pods were deleted.
oc get daemonset logdna-agent -n ibm-observe oc get pods -l app=logdna-agent -n ibm-observe oc get daemonset sysdig-agent -n ibm-observe oc get pods -l app=sysdig-agent -n ibm-observe