How get some kind of Metrics/Utilization of VM's to working?

[maly-glod]

Hi Guys,

I need Your support or some hints, how to get utilization data working.

1. Describe your environment:
   ManageIQ: official Petrosian OpenStack version deployed on 4 VMs:

• 2x Appliance (HA based on high_availability_guide)

Welcome to the ManageIQ Virtual Appliance.

To modify the configuration, use a web browser to access the management page.

Hostname:                miq-app-1
IPv4 Address:            10.1.1.11/255.255.255.0
IPv4 Gateway:            10.1.1.1
IPv6 Address:            
IPV6 Gateway:            
Primary DNS:             10.1.1.4
Secondary DNS:           10.1.1.15
Search Order:            os.local
MAC Address:             fa:16:3e:60:af:ff
Timezone:                Europe/Warsaw
Local Database Server:   not initialized
ManageIQ Server:         running
ManageIQ Database:       miq-app-4-db
Database/Region:         vmdb_production / 0
External Auth:           xxxxx
ManageIQ Version:        petrosian-1


Press any key to continue.

• 2x DB

Cloud: OpenStack AIO Caracal (stable/2024.1) version deployed on BareMetal host (based on OpenStack-Ansible Quickstart: AIO

• additional services installed (all defaults):

• aodh,
• gnocchi,
• ceilometer,
• skyline

root@aio1:~# lxc-ls -1
aio1-aodh-container-a6cb8233
aio1-ceilometer-central-container-659eb991
aio1-cinder-api-container-06fe7a7d
aio1-galera-container-b1cef400
aio1-glance-container-3f5cee8e
aio1-gnocchi-container-96ed7d75
aio1-horizon-container-46a9f212
aio1-keystone-container-f6ace861
aio1-memcached-container-cc13f0fa
aio1-neutron-ovn-northd-container-88a13785
aio1-neutron-server-container-ae752fb3
aio1-nova-api-container-8bd289e6
aio1-placement-container-e4c84a90
aio1-rabbit-mq-container-7de2a18d
aio1-repo-container-3055fb15
aio1-skyline-container-353bc610
aio1-utility-container-3502e319

On fresh installation ceilometer is no longer registered as endpoint (replaced by Gnocchi??):

root@aio1-utility-container-3502e319:~# openstack endpoint list
+----------------------------------+-----------+--------------+--------------+---------+-----------+---------------------------------------------+
| ID                               | Region    | Service Name | Service Type | Enabled | Interface | URL                                         |
+----------------------------------+-----------+--------------+--------------+---------+-----------+---------------------------------------------+
| 054d0f0fd6cb4d6b87060f7e801f7792 | RegionOne | neutron      | network      | True    | admin     | http://172.29.236.101:9696                  |
| 19c4c049d9e049b184246c03dd5bb15a | RegionOne | aodh         | alarming     | True    | internal  | http://172.29.236.101:8042                  |
| 1a45ce6fd6c24d2b9f7a89699a070652 | RegionOne | keystone     | identity     | True    | public    | https://10.13.16.75:5000                    |
| 32f4b61cd22c4b61958f65ce93897fd2 | RegionOne | keystone     | identity     | True    | internal  | http://172.29.236.101:5000                  |
| 402de5191f684fc98f97d9e197a040fb | RegionOne | glance       | image        | True    | internal  | http://172.29.236.101:9292                  |
| 46804c3f45f74a7da417aac5faf4ceb2 | RegionOne | gnocchi      | metric       | True    | public    | https://10.13.16.75:8041                    |
| 55d4821d32bc49bab815e811b3504913 | RegionOne | gnocchi      | metric       | True    | admin     | http://172.29.236.101:8041                  |
| 66810784a976497da3fcfaba8a78c76f | RegionOne | aodh         | alarming     | True    | admin     | http://172.29.236.101:8042                  |
| 6770094704704b9ca48454b6f23b5404 | RegionOne | cinderv3     | volumev3     | True    | public    | https://10.13.16.75:8776/v3/%(tenant_id)s   |
| 6eb561a8732e49ac85a01062b012f301 | RegionOne | glance       | image        | True    | admin     | http://172.29.236.101:9292                  |
| 72141164b2c34bee971a34bdd1423973 | RegionOne | placement    | placement    | True    | admin     | http://172.29.236.101:8780                  |
| 7419110fd63f4153bd649063db2a6245 | RegionOne | gnocchi      | metric       | True    | internal  | http://172.29.236.101:8041                  |
| 79f2721b6c5c4f7eb272150e32a0b6b5 | RegionOne | neutron      | network      | True    | internal  | http://172.29.236.101:9696                  |
| 945b6d7eb0644ecdb3d59111b7e67bd6 | RegionOne | neutron      | network      | True    | public    | https://10.13.16.75:9696                    |
| 9896ccc1d63e4414aae52ef8bc3619d9 | RegionOne | nova         | compute      | True    | admin     | http://172.29.236.101:8774/v2.1             |
| b025f49381914fec83a9e3c9058d3a65 | RegionOne | placement    | placement    | True    | public    | https://10.13.16.75:8780                    |
| bda878d794b9475eb6a958046e095c07 | RegionOne | glance       | image        | True    | public    | https://10.13.16.75:9292                    |
| c55b0f3a4c42434f8d606255515a2a86 | RegionOne | placement    | placement    | True    | internal  | http://172.29.236.101:8780                  |
| d0e7bab95bcc417b872dbb9f86236932 | RegionOne | nova         | compute      | True    | public    | https://10.13.16.75:8774/v2.1               |
| dfa08bf18de848589f741107ec023ef6 | RegionOne | aodh         | alarming     | True    | public    | https://10.13.16.75:8042                    |
| e70634f894694947b4ebf03cdf88e072 | RegionOne | keystone     | identity     | True    | admin     | http://172.29.236.101:5000                  |
| ef2967a06e374f0baa7d1d5de61b8a80 | RegionOne | nova         | compute      | True    | internal  | http://172.29.236.101:8774/v2.1             |
| f919f4e402e04a2ba33c83f5deb5f99a | RegionOne | cinderv3     | volumev3     | True    | internal  | http://172.29.236.101:8776/v3/%(tenant_id)s |
| fc9c74f364fa4c37ae7bafce493a5ae9 | RegionOne | cinderv3     | volumev3     | True    | admin     | http://172.29.236.101:8776/v3/%(tenant_id)s |
+----------------------------------+-----------+--------------+--------------+---------+-----------+---------------------------------------------+

2. Describe the issue you are having and what you expected to happen.
   I'm having trouble getting/displaying any metrics showing current resource usage (CPU, memory, etc.) on running VM. Can I ask for some advice on how to start collecting this data and get it working? All "tutorials/tips" concern old versions of OpenStack (e.g. Pike) where telemetry was based on a ceilometer and it was registered as OS endpoint.
   
   

3. Describe the steps to reproduce, including any log snippets and stack traces that will help diagnose.
   As originally posted by @dikonoor in ManageIQ does not have support for secure communication with OpenStack message queue #199 (comment)

and official documentation:

Ceilometer previously provided a storage and API solution. As of Newton, this functionality is officially deprecated and discouraged. For efficient storage and statistical analysis of Ceilometer data, [Gnocchi](https://gnocchi.osci.io/) is recommended.

I couldn't validate cloud with Ceilometer as events source:

So I decided to try with AMQP:
I had to make DNAT rule on aio1 host to get into rabbitmq-server 5672 port (because it doesn't normally expose it to a "public" ip):

root@aio1:~# iptables -nv -L -t nat
Chain PREROUTING (policy ACCEPT 0 packets, 0 bytes)
 pkts bytes target     prot opt in     out     source               destination         
    5   300 DNAT       tcp  --  *      *       0.0.0.0/0            10.13.16.75          tcp dpt:5672 to:172.29.239.196:5672

Unfortunately, connecting directly to Rabbit did not change anything.

And one more thing, based on #295 which refers to this thread, there should be 2 AMQP fallback ip fields and there aren't:

Merge is from 2019, shouldn't this be included in the official version of Petrosian?

@miq-bot add-label "help wanted"

Regards
Borys

[remo233]

Hi Maly,

Is the ceilometer generated the metrics ? check it using command openstack metric list and openstack metric resource show

[maly-glod]

Hi @remo233

Yes ceilometer on my AIO is generating the metrics.

[falencastro]

@maly-glod This stopped working on Stein as some metrics were deprecated and the new ones aren't yet collected by this provider: #879