Gnocchi with no data from ceilometer although all configurations are setup as per official documentation (ROCKY, Ubuntu 18.04)?

asked 2019-08-10 09:40:05 -0500

sagargurung gravatar image

Openstack version: Rocky, Ubuntu 18.04 Currently working on Ceilometer and Gnocchi integration. After several road blocks, I believe all configurations are correctly configured, however, no data is populated onto gnocchi database because when I ran "gnocchi status" below is the output: +-----------------------------------------------------+-------+ | Field | Value | +-----------------------------------------------------+-------+ | metricd/processors | None | | storage/number of metric having measures to process | 0 | | storage/total number of measures to process | 0 | +-----------------------------------------------------+-------+ and when I also tried gnocchi resource list --type image, output is blank.

I have following config files:

pipeline.yaml(manually created the file and added config details as per documentation https://docs.openstack.org/ceilometer/rocky/install/install-base-ubuntu.html (https://docs.openstack.org/ceilometer...))

publishers: - gnocchi://?filter_project=service&archive_policy=low

polling.yaml sources: - name: some_pollsters interval: 300 meters: - cpu - cpu_l3_cache - memory.usage - network.incoming.bytes - network.incoming.packets - network.outgoing.bytes - network.outgoing.packets - disk.device.read.bytes - disk.device.read.requests - disk.device.write.bytes - disk.device.write.requests - hardware.cpu.util - hardware.memory.used - hardware.memory.total - hardware.memory.buffer - hardware.memory.cached - hardware.memory.swap.avail - hardware.memory.swap.total - hardware.system_stats.io.outgoing.blocks - hardware.system_stats.io.incoming.blocks - hardware.network.ip.incoming.datagrams - hardware.network.ip.outgoing.datagrams

Not sure what's the cause of this issue? Do I need to configure more on pipeline.yamlfile as shown on this link https://github.com/openstack/ceilometer/blob/stable/pike/ceilometer/pipeline/data/pipeline.yaml (https://github.com/openstack/ceilomet...) Official documentation hasn't mentioned in detail so wondering if it's missing more there. Any help or suggestions would be kindly appreciated. Thanks.

Some log outputs from "ceilometer-agent-notification":

2019-08-10 14:30:29.069 24076 DEBUG ceilometer.agent [-] Config file: {'publishers': ['gnocchi://?filter_project=service&archive_policy=low']} load_config /usr/lib/python2.7/dist-packages/ceilometer/agent.py:70 2019-08-10 14:30:29.069 24076 ERROR stevedore.extension [-] Could not load 'meter': Pipeline {'publishers': ['gnocchi://?filter_project=service&archive_policy=low']}: Both sources & sinks are required: PipelineException: Pipeline {'publishers': ['gnocchi://?filter_project=service&archive_policy=low']}: Both sources & sinks are required 2019-08-10 14:30:29.069 24076 ERROR ceilometer.notification [-] Could not load the following pipelines: set(['meter']) 2019-08-10 14:30:29.071 24076 DEBUG ceilometer.pipeline.event [-] Loading event definitions __init__ /usr/lib/python2.7/dist-packages/ceilometer/pipeline/event.py:36 2019-08-10 14:30:29.072 24076 DEBUG ceilometer.declarative [-] No Definitions configuration file found! Using default config. load_definitions /usr/lib/python2.7/dist-packages/ceilometer/declarative.py:154 2019-08-10 14:30:29.072 24076 DEBUG ceilometer.declarative [-] Loading definitions configuration file: /usr/lib/python2.7/dist-packages/ceilometer/pipeline/data/event_definitions.yaml load_definitions /usr/lib/python2.7/dist-packages/ceilometer/declarative.py:159 2019-08-10 14:30:29.153 24076 INFO ceilometer.declarative [-] Definitions: [{'traits': {'disk_gb': {'fields': 'payload.disk_gb', 'type': 'int'}, 'resource_id': {'fields': 'payload.instance_id'}, 'os_distro': {'fields': "payload.image_meta.'org.openstack__1__os_distro'"}, 'ephemeral_gb': {'fields': 'payload.ephemeral_gb', 'type': 'int'}, 'instance_type_id': {'fields': 'payload.instance_type_id', 'type': 'int'}, 'host': {'fields': 'publisher_id.split(., 1, 1)'}, 'os_architecture': {'fields': "payload.image_meta.'org.openstack__1__architecture'"}, 'display_name': {'fields': 'payload.display_name'}, 'deleted_at': {'fields': 'payload.deleted_at', 'type': 'datetime'}, 'cell_name': {'fields': 'payload.cell_name ... (more)

edit retag flag offensive close merge delete

Comments

The error message indicates an incorrect pipeline.yaml. publishers must be under a sinksdeclaration; see https://docs.openstack.org/ceilometer....

Bernd Bausch gravatar imageBernd Bausch ( 2019-08-10 13:39:25 -0500 )edit

Thank you @Bernd Bausch. Yah, it was that pipeline.yaml file being configured incorrectly. Much appreciated :)

sagargurung gravatar imagesagargurung ( 2019-08-10 18:31:52 -0500 )edit