google-fluentd container as a k8s pod sidecar error: labels is incomplete #284
Description
When running a google-fluentd container as a Kubernetes pod sidecar with image gcr.io/stackdriver-agents/stackdriver-logging-agent:1.7.1 and emptyDir: {} mounted to scrape logs I'm getting this error:
Unable to export to Monitoring service because: GaxError RPC failed, caused by 3:One or more TimeSeries could not be written: The set of resource labels is incomplete. Missing labels: (container_name namespace_id pod_id).: timeSeries[0-2]. debug_error_string:{"created":"@1597236685.224168876","description":"Error received from peer ipv4:[REDACTED]:443","file":"src/core/lib/surface/call.cc","file_line":1055,"grpc_message":"One or more TimeSeries could not be written: The set of resource labels is incomplete. Missing labels: (container_name namespace_id pod_id).: timeSeries[0-2]","grpc_status":3}
Full log, including current Google-fluentd configuration, is here:
https://gist.githubusercontent.com/voxmaster/93fba5ec0912dbc1e150d0bb165eef92/raw/254f46f402e7d6fe7f1c6ce7fd0b81d39d585aec/google-fluentd%2520sidecar
Appreciate any advice. Thanks!