[BUG] Observability / Metrics / Source No index to be selected

[itsmjeu]

Describe the bug

There are no index to be selected at Otel Index selection box on (/app/observability-metrics)
The box appear empty

To Reproduce
Steps to reproduce the behavior:

1. Go to '/app/observability-metrics#/'
2. Click on 'Metrics source OpenTelemetry'
3. Click on Otel Index and on dropdown try to select any possible available index
4. The list is empty

Expected behavior
Was expected to appear a list of indexes that could be selected

OpenSearch Version
Opensearch 2.15.0

Dashboards Version
Opensearch Dashboard 2.15.0

Plugins

name component version
mvp-masters-1 opensearch-alerting 2.15.0.0
mvp-masters-1 opensearch-anomaly-detection 2.15.0.0
mvp-masters-1 opensearch-asynchronous-search 2.15.0.0
mvp-masters-1 opensearch-cross-cluster-replication 2.15.0.0
mvp-masters-1 opensearch-custom-codecs 2.15.0.0
mvp-masters-1 opensearch-flow-framework 2.15.0.0
mvp-masters-1 opensearch-geospatial 2.15.0.0
mvp-masters-1 opensearch-index-management 2.15.0.0
mvp-masters-1 opensearch-job-scheduler 2.15.0.0
mvp-masters-1 opensearch-knn 2.15.0.0
mvp-masters-1 opensearch-ml 2.15.0.0
mvp-masters-1 opensearch-neural-search 2.15.0.0
mvp-masters-1 opensearch-notifications 2.15.0.0
mvp-masters-1 opensearch-notifications-core 2.15.0.0
mvp-masters-1 opensearch-observability 2.15.0.0
mvp-masters-1 opensearch-performance-analyzer 2.15.0.0
mvp-masters-1 opensearch-reports-scheduler 2.15.0.0
mvp-masters-1 opensearch-security 2.15.0.0
mvp-masters-1 opensearch-security-analytics 2.15.0.0
mvp-masters-1 opensearch-skills 2.15.0.0
mvp-masters-1 opensearch-sql 2.15.0.0
mvp-masters-1 repository-s3 2.15.0
mvp-nodes-0 opensearch-alerting 2.15.0.0
mvp-nodes-0 opensearch-anomaly-detection 2.15.0.0
mvp-nodes-0 opensearch-asynchronous-search 2.15.0.0
mvp-nodes-0 opensearch-cross-cluster-replication 2.15.0.0
mvp-nodes-0 opensearch-custom-codecs 2.15.0.0
mvp-nodes-0 opensearch-flow-framework 2.15.0.0
mvp-nodes-0 opensearch-geospatial 2.15.0.0
mvp-nodes-0 opensearch-index-management 2.15.0.0
mvp-nodes-0 opensearch-job-scheduler 2.15.0.0
mvp-nodes-0 opensearch-knn 2.15.0.0
mvp-nodes-0 opensearch-ml 2.15.0.0
mvp-nodes-0 opensearch-neural-search 2.15.0.0
mvp-nodes-0 opensearch-notifications 2.15.0.0
mvp-nodes-0 opensearch-notifications-core 2.15.0.0
mvp-nodes-0 opensearch-observability 2.15.0.0
mvp-nodes-0 opensearch-performance-analyzer 2.15.0.0
mvp-nodes-0 opensearch-reports-scheduler 2.15.0.0
mvp-nodes-0 opensearch-security 2.15.0.0
mvp-nodes-0 opensearch-security-analytics 2.15.0.0
mvp-nodes-0 opensearch-skills 2.15.0.0
mvp-nodes-0 opensearch-sql 2.15.0.0
mvp-nodes-0 repository-s3 2.15.0
mvp-nodes-2 opensearch-alerting 2.15.0.0
mvp-nodes-2 opensearch-anomaly-detection 2.15.0.0
mvp-nodes-2 opensearch-asynchronous-search 2.15.0.0
mvp-nodes-2 opensearch-cross-cluster-replication 2.15.0.0
mvp-nodes-2 opensearch-custom-codecs 2.15.0.0
mvp-nodes-2 opensearch-flow-framework 2.15.0.0
mvp-nodes-2 opensearch-geospatial 2.15.0.0
mvp-nodes-2 opensearch-index-management 2.15.0.0
mvp-nodes-2 opensearch-job-scheduler 2.15.0.0
mvp-nodes-2 opensearch-knn 2.15.0.0
mvp-nodes-2 opensearch-ml 2.15.0.0
mvp-nodes-2 opensearch-neural-search 2.15.0.0
mvp-nodes-2 opensearch-notifications 2.15.0.0
mvp-nodes-2 opensearch-notifications-core 2.15.0.0
mvp-nodes-2 opensearch-observability 2.15.0.0
mvp-nodes-2 opensearch-performance-analyzer 2.15.0.0
mvp-nodes-2 opensearch-reports-scheduler 2.15.0.0
mvp-nodes-2 opensearch-security 2.15.0.0
mvp-nodes-2 opensearch-security-analytics 2.15.0.0
mvp-nodes-2 opensearch-skills 2.15.0.0
mvp-nodes-2 opensearch-sql 2.15.0.0
mvp-nodes-2 repository-s3 2.15.0
mvp-coordinators-0 opensearch-alerting 2.15.0.0
mvp-coordinators-0 opensearch-anomaly-detection 2.15.0.0
mvp-coordinators-0 opensearch-asynchronous-search 2.15.0.0
mvp-coordinators-0 opensearch-cross-cluster-replication 2.15.0.0
mvp-coordinators-0 opensearch-custom-codecs 2.15.0.0
mvp-coordinators-0 opensearch-flow-framework 2.15.0.0
mvp-coordinators-0 opensearch-geospatial 2.15.0.0
mvp-coordinators-0 opensearch-index-management 2.15.0.0
mvp-coordinators-0 opensearch-job-scheduler 2.15.0.0
mvp-coordinators-0 opensearch-knn 2.15.0.0
mvp-coordinators-0 opensearch-ml 2.15.0.0
mvp-coordinators-0 opensearch-neural-search 2.15.0.0
mvp-coordinators-0 opensearch-notifications 2.15.0.0
mvp-coordinators-0 opensearch-notifications-core 2.15.0.0
mvp-coordinators-0 opensearch-observability 2.15.0.0
mvp-coordinators-0 opensearch-performance-analyzer 2.15.0.0
mvp-coordinators-0 opensearch-reports-scheduler 2.15.0.0
mvp-coordinators-0 opensearch-security 2.15.0.0
mvp-coordinators-0 opensearch-security-analytics 2.15.0.0
mvp-coordinators-0 opensearch-skills 2.15.0.0
mvp-coordinators-0 opensearch-sql 2.15.0.0
mvp-coordinators-0 repository-s3 2.15.0
mvp-masters-0 opensearch-alerting 2.15.0.0
mvp-masters-0 opensearch-anomaly-detection 2.15.0.0
mvp-masters-0 opensearch-asynchronous-search 2.15.0.0
mvp-masters-0 opensearch-cross-cluster-replication 2.15.0.0
mvp-masters-0 opensearch-custom-codecs 2.15.0.0
mvp-masters-0 opensearch-flow-framework 2.15.0.0
mvp-masters-0 opensearch-geospatial 2.15.0.0
mvp-masters-0 opensearch-index-management 2.15.0.0
mvp-masters-0 opensearch-job-scheduler 2.15.0.0
mvp-masters-0 opensearch-knn 2.15.0.0
mvp-masters-0 opensearch-ml 2.15.0.0
mvp-masters-0 opensearch-neural-search 2.15.0.0
mvp-masters-0 opensearch-notifications 2.15.0.0
mvp-masters-0 opensearch-notifications-core 2.15.0.0
mvp-masters-0 opensearch-observability 2.15.0.0
mvp-masters-0 opensearch-performance-analyzer 2.15.0.0
mvp-masters-0 opensearch-reports-scheduler 2.15.0.0
mvp-masters-0 opensearch-security 2.15.0.0
mvp-masters-0 opensearch-security-analytics 2.15.0.0
mvp-masters-0 opensearch-skills 2.15.0.0
mvp-masters-0 opensearch-sql 2.15.0.0
mvp-masters-0 repository-s3 2.15.0
mvp-coordinators-1 opensearch-alerting 2.15.0.0
mvp-coordinators-1 opensearch-anomaly-detection 2.15.0.0
mvp-coordinators-1 opensearch-asynchronous-search 2.15.0.0
mvp-coordinators-1 opensearch-cross-cluster-replication 2.15.0.0
mvp-coordinators-1 opensearch-custom-codecs 2.15.0.0
mvp-coordinators-1 opensearch-flow-framework 2.15.0.0
mvp-coordinators-1 opensearch-geospatial 2.15.0.0
mvp-coordinators-1 opensearch-index-management 2.15.0.0
mvp-coordinators-1 opensearch-job-scheduler 2.15.0.0
mvp-coordinators-1 opensearch-knn 2.15.0.0
mvp-coordinators-1 opensearch-ml 2.15.0.0
mvp-coordinators-1 opensearch-neural-search 2.15.0.0
mvp-coordinators-1 opensearch-notifications 2.15.0.0
mvp-coordinators-1 opensearch-notifications-core 2.15.0.0
mvp-coordinators-1 opensearch-observability 2.15.0.0
mvp-coordinators-1 opensearch-performance-analyzer 2.15.0.0
mvp-coordinators-1 opensearch-reports-scheduler 2.15.0.0
mvp-coordinators-1 opensearch-security 2.15.0.0
mvp-coordinators-1 opensearch-security-analytics 2.15.0.0
mvp-coordinators-1 opensearch-skills 2.15.0.0
mvp-coordinators-1 opensearch-sql 2.15.0.0
mvp-coordinators-1 repository-s3 2.15.0
mvp-nodes-1 opensearch-alerting 2.15.0.0
mvp-nodes-1 opensearch-anomaly-detection 2.15.0.0
mvp-nodes-1 opensearch-asynchronous-search 2.15.0.0
mvp-nodes-1 opensearch-cross-cluster-replication 2.15.0.0
mvp-nodes-1 opensearch-custom-codecs 2.15.0.0
mvp-nodes-1 opensearch-flow-framework 2.15.0.0
mvp-nodes-1 opensearch-geospatial 2.15.0.0
mvp-nodes-1 opensearch-index-management 2.15.0.0
mvp-nodes-1 opensearch-job-scheduler 2.15.0.0
mvp-nodes-1 opensearch-knn 2.15.0.0
mvp-nodes-1 opensearch-ml 2.15.0.0
mvp-nodes-1 opensearch-neural-search 2.15.0.0
mvp-nodes-1 opensearch-notifications 2.15.0.0
mvp-nodes-1 opensearch-notifications-core 2.15.0.0
mvp-nodes-1 opensearch-observability 2.15.0.0
mvp-nodes-1 opensearch-performance-analyzer 2.15.0.0
mvp-nodes-1 opensearch-reports-scheduler 2.15.0.0
mvp-nodes-1 opensearch-security 2.15.0.0
mvp-nodes-1 opensearch-security-analytics 2.15.0.0
mvp-nodes-1 opensearch-skills 2.15.0.0
mvp-nodes-1 opensearch-sql 2.15.0.0
mvp-nodes-1 repository-s3 2.15.0

Screenshots

Additional context

Prometheus metrics are also not appearing

[ashwin-pc]

@opensearch-project/admin can you route this to the observability plugin?

[YANG-DB]

@tsmjeu
These metrics visualizations are depended on the existence of Otel compliant metrics in Prometheus or local index in openSearch with a simple schema naming convention

See additional instructions for setting up otel collector with opensearch

[dblock]

[Catch All Triage - 1, 2]

[itsmjeu]

the propose doesnt seems to work

@tsmjeu These metrics visualizations are depended on the existence of Otel compliant metrics in Prometheus or local index in openSearch with a simple schema naming convention

See additional instructions for setting up otel collector with opensearch

Doesn't seems to work with 2.15

[glelarge]

Hi, I met the same issue, index exists but not displayed in the select box.

Digging the YANG-DB's answer, I understand that by convention only indexes respecting the pattern ss4o_metrics-*-* are displayed in the Observability Metrics page.
I just renamed the index as ss4o_metrics-otel-%{yyyy.MM.dd} and now the index is displayed :

But metrics are not displayed due to #2172 .