LOG/POMBA healthcheck OK on 5/6 for RC0 pairwise testing


Michael O'Brien <frank.obrien@...>
 

 

 

From: Michael O'Brien <Frank.Obrien@...>
Date: Tuesday, May 7, 2019 at 07:24
To: "onap-discuss@..." <onap-discuss@...>
Cc: "Jim Baker (Confluence)" <noreply@...>
Subject: LOG/POMBA healthcheck OK on 5/6 for RC0 pairwise testing

 

   Logging and Pomba Healtcheck are OK – I deployed my own system on a 256g Azure VM and get positive results.  The results on onapci.org look to be intermittent to that particular undercloud and not to the pods themselves

 

For example on http://onapci.org/grafana/d/8cGRqBOmz/daily-summary?orgId=1

Pomba-ca failed only on 5/6

Pomba-nd failed only on 5/2

Pomba-aai-cb failed only on 5/6

  • Even though nothing went in around those days

 

But yesterday on 5/5 all passed on a separate system

Therefore healthcheck results can be intermittent depending on how the system is deployed.

My particular method is to sequence the indidual helm deployments based on dependency order and waiting for 90% of module pods to be up between deploys

https://git.onap.org/logging-analytics/tree/deploy/cd.sh#n220

          DEPLOY_ORDER_POD_NAME_ARRAY=('consul msb dmaap dcaegen2 aaf robot aai esr multicloud oof so sdc sdnc vid policy portal log vfc uui vnfsdk appc clamp cli pomba contrib sniro-emulator')

 

 

https://jira.onap.org/browse/LOG-1041

 

Executing robot tests at log level TRACE

==============================================================================

Testsuites                                                                    

==============================================================================

Testsuites.Health-Check :: Testing ecomp components are available via calls. 

==============================================================================

Basic A&AI Health Check                                               | FAIL |

Test timeout 10 seconds exceeded.

------------------------------------------------------------------------------

Basic AAF Health Check                                                | PASS |

------------------------------------------------------------------------------

Basic AAF SMS Health Check                                            | PASS |

------------------------------------------------------------------------------

Basic APPC Health Check                                               | FAIL |

404 != 200

------------------------------------------------------------------------------

Basic CLI Health Check                                                | PASS |

------------------------------------------------------------------------------

Basic CLAMP Health Check                                              | PASS |

------------------------------------------------------------------------------

Basic DCAE Health Check                                               | FAIL |

500 != 200

------------------------------------------------------------------------------

Basic DMAAP Data Router Health Check                                  | PASS |

------------------------------------------------------------------------------

Basic DMAAP Message Router Health Check                               | PASS |

------------------------------------------------------------------------------

Basic DMAAP Bus Controller Health Check With Basic Auth               | PASS |

------------------------------------------------------------------------------

Basic External API NBI Health Check                                   [ WARN ] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4e810a4610>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v3/status

[ WARN ] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4e7fabbb50>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v3/status

[ WARN ] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4e7faab190>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v3/status

| FAIL |

ConnectionError: HTTPConnectionPool(host='nbi.onap', port=8080): Max retries exceeded with url: /nbi/api/v3/status (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4e7faab110>: Failed to establish a new connection: [Errno -2] Name or service not known',))

------------------------------------------------------------------------------

Basic Log Elasticsearch Health Check                                  | PASS |

------------------------------------------------------------------------------

Basic Log Kibana Health Check                                         | PASS |

------------------------------------------------------------------------------

Basic Log Logstash Health Check                                       | PASS |

------------------------------------------------------------------------------

Basic Microservice Bus Health Check                                   | PASS |

------------------------------------------------------------------------------

Basic Multicloud API Health Check                                     | FAIL |

504 != 200

------------------------------------------------------------------------------

Basic Multicloud-ocata API Health Check                               | FAIL |

504 != 200

------------------------------------------------------------------------------

Basic Multicloud-pike API Health Check                                | FAIL |

504 != 200

------------------------------------------------------------------------------

Basic Multicloud-starlingx API Health Check                           | PASS |

------------------------------------------------------------------------------

Basic Multicloud-titanium_cloud API Health Check                      | FAIL |

504 != 200

------------------------------------------------------------------------------

Basic Multicloud-vio API Health Check                                 | FAIL |

504 != 200

------------------------------------------------------------------------------

Basic Multicloud-thinkcloud API Health Check                          | FAIL |

502 != 200

------------------------------------------------------------------------------

Basic OOF-Homing Health Check                                         | PASS |

------------------------------------------------------------------------------

Basic OOF-SNIRO Health Check                                          | PASS |

------------------------------------------------------------------------------

Basic OOF-CMSO Health Check                                           | FAIL |

400 != 200

------------------------------------------------------------------------------

Basic Policy Health Check                                             | PASS |

------------------------------------------------------------------------------

Basic Pomba AAI-context-builder Health Check                          | PASS |

------------------------------------------------------------------------------

Basic Pomba SDC-context-builder Health Check                          | PASS |

------------------------------------------------------------------------------

Basic Pomba Network-discovery-context-builder Health Check            | PASS |

------------------------------------------------------------------------------

Basic Pomba Service-Decomposition Health Check                        | PASS |

------------------------------------------------------------------------------

Basic Pomba Network-Discovery-MicroService Health Check               | PASS |

------------------------------------------------------------------------------

Basic Pomba Pomba-Kibana Health Check                                 | PASS |

------------------------------------------------------------------------------

Basic Pomba Elastic-Search Health Check                               | PASS |

------------------------------------------------------------------------------

Basic Pomba Sdnc-Context-Builder Health Check                         | PASS |

------------------------------------------------------------------------------

Basic Pomba Context-Aggregator Health Check                           | PASS |

------------------------------------------------------------------------------

Basic Portal Health Check                                             | FAIL |

500 != 200

------------------------------------------------------------------------------

Basic SDC Health Check                                                | FAIL |

Test timeout 10 seconds exceeded.

------------------------------------------------------------------------------

Basic SDNC Health Check                                               | FAIL |

Test timeout 10 seconds exceeded.

------------------------------------------------------------------------------

Basic SO Health Check                                                 | FAIL |

Test timeout 10 seconds exceeded.

------------------------------------------------------------------------------

Basic UseCaseUI API Health Check                                      | PASS |

------------------------------------------------------------------------------

Basic VFC catalog API Health Check                                    | PASS |

------------------------------------------------------------------------------

Basic VFC emsdriver API Health Check                                  | PASS |

------------------------------------------------------------------------------

Basic VFC gvnfmdriver API Health Check                                | PASS |

------------------------------------------------------------------------------

Basic VFC huaweivnfmdriver API Health Check                           | PASS |

------------------------------------------------------------------------------

Basic VFC jujuvnfmdriver API Health Check                             | PASS |

------------------------------------------------------------------------------

Basic VFC multivimproxy API Health Check                              | PASS |

------------------------------------------------------------------------------

Basic VFC nokiav2driver API Health Check                              | PASS |

------------------------------------------------------------------------------

Basic VFC nslcm API Health Check                                      | PASS |

------------------------------------------------------------------------------

Basic VFC resmgr API Health Check                                     | PASS |

------------------------------------------------------------------------------

Basic VFC vnflcm API Health Check                                     | PASS |

------------------------------------------------------------------------------

Basic VFC vnfmgr API Health Check                                     | PASS |

------------------------------------------------------------------------------

Basic VFC vnfres API Health Check                                     | PASS |

------------------------------------------------------------------------------

Basic VFC workflow API Health Check                                   | PASS |

------------------------------------------------------------------------------

Basic VFC ztesdncdriver API Health Check                              | PASS |

------------------------------------------------------------------------------

Basic VFC ztevnfmdriver API Health Check                              | PASS |

------------------------------------------------------------------------------

Basic VID Health Check                                                | PASS |

------------------------------------------------------------------------------

Basic VNFSDK Health Check                                             | PASS |

------------------------------------------------------------------------------

Basic Holmes Rule Management API Health Check                         | PASS |

------------------------------------------------------------------------------

Basic Holmes Engine Management API Health Check                       | PASS |

------------------------------------------------------------------------------

Basic Multicloud-fcaps API Health Check                               | FAIL |

502 != 200

------------------------------------------------------------------------------

Testsuites.Health-Check :: Testing ecomp components are available ... | FAIL |

60 critical tests, 44 passed, 16 failed

60 tests total, 44 passed, 16 failed

==============================================================================

Testsuites                                                            | FAIL |

60 critical tests, 44 passed, 16 failed

60 tests total, 44 passed, 16 failed

==============================================================================

Output:  /share/logs/0002_ete_health/output.xml

Log:     /share/logs/0002_ete_health/log.html

Report:  /share/logs/0002_ete_health/report.html

 

For

ubuntu@a-cd1-master:~$ sudo helm list

NAME                   REVISION       UPDATED                        STATUS          CHART                  NAMESPACE

onap                   27             Mon May  6 18:01:51 2019       DEPLOYED        onap-4.0.0             onap    

onap-aaf               22             Mon May  6 18:01:53 2019       DEPLOYED       aaf-4.0.0                  onap    

onap-aai               20             Mon May  6 18:02:00 2019       DEPLOYED       aai-4.0.0                  onap    

onap-appc              6              Mon May  6 18:02:11 2019       DEPLOYED        appc-4.0.0             onap    

onap-clamp             5              Mon May  6 18:02:18 2019       DEPLOYED        clamp-4.0.0            onap    

onap-cli               4              Mon May  6 18:02:22 2019       DEPLOYED       cli-4.0.0                  onap    

onap-consul            26             Mon May  6 18:02:24 2019       DEPLOYED        consul-4.0.0           onap    

onap-contrib           2              Mon May  6 18:02:27 2019       DEPLOYED        contrib-4.0.0          onap    

onap-dcaegen2          23             Mon May  6 18:02:31 2019       DEPLOYED        dcaegen2-4.0.0         onap    

onap-dmaap             1              Mon May  6 12:14:32 2019       FAILED          dmaap-4.0.1            onap    

onap-esr               19             Mon May  6 18:02:37 2019       DEPLOYED       esr-4.0.0                  onap    

onap-log               10             Mon May  6 18:02:40 2019       DEPLOYED       log-4.0.0                  onap    

onap-msb               25             Mon May  6 18:02:46 2019       DEPLOYED       msb-4.0.0                  onap    

onap-multicloud        18             Mon May  6 18:02:49 2019       DEPLOYED        multicloud-4.0.0       onap    

onap-nfs-provisioner   27             Mon May  6 18:02:55 2019       DEPLOYED       nfs-provisioner-4.0.0      onap    

onap-oof               17             Mon May  6 18:02:57 2019       DEPLOYED       oof-4.0.0                  onap    

onap-policy            12             Mon May  6 18:03:05 2019       DEPLOYED        policy-4.0.0           onap    

onap-pomba             3              Mon May  6 18:03:12 2019       DEPLOYED        pomba-4.0.0            onap    

onap-portal            11             Mon May  6 18:03:18 2019       DEPLOYED        portal-4.0.0           onap    

onap-robot             21             Mon May  6 18:03:23 2019       DEPLOYED        robot-4.0.0            onap    

onap-sdc               15             Mon May  6 18:03:25 2019       DEPLOYED       sdc-4.0.0                  onap    

onap-sdnc              14             Mon May  6 18:03:31 2019       DEPLOYED        sdnc-4.0.0             onap    

onap-sniro-emulator    1              Mon May  6 18:03:37 2019       DEPLOYED        sniro-emulator-4.0.0   onap    

onap-so                1              Mon May  6 14:00:15 2019       FAILED         so-4.0.0                  onap    

onap-uui               8              Mon May  6 18:03:42 2019       DEPLOYED       uui-4.0.0                  onap    

onap-vfc               9              Mon May  6 18:03:44 2019       DEPLOYED       vfc-4.0.0                  onap    

onap-vid               13             Mon May  6 18:03:50 2019       DEPLOYED       vid-4.0.0                  onap    

onap-vnfsdk            7              Mon May  6 18:03:53 2019       DEPLOYED        vnfsdk-4.0.0           onap

 

ubuntu@a-cd1-master:~$ kubectl get pods --all-namespaces

NAMESPACE     NAME                                                           READY     STATUS             RESTARTS   AGE

kube-system   heapster-7b48b696fc-6bs7f                                      1/1       Running            0          14h

kube-system   kube-dns-6655f78c68-5q2bk                                      3/3       Running            0          14h

kube-system   kubernetes-dashboard-6f54f7c4b-zdzkc                           1/1       Running            0          14h

kube-system   monitoring-grafana-7877679464-gt44b                            1/1       Running            0          14h

kube-system   monitoring-influxdb-64664c6cf5-hs5dr                           1/1       Running            0          14h

kube-system   tiller-deploy-6f4745cbcf-ghsdc                                 1/1       Running            0          14h

onap          dep-dcae-dashboard-54f56cd7b8-f2n9l                            1/1       Running            0          6h

onap          dep-dcae-hv-ves-collector-5ccbd4b5c9-w99cf                     2/2       Running            0          6h

onap          dep-dcae-prh-67cc7c9c97-rqwvd                                  2/2       Running            0          6h

onap          dep-dcae-snmptrap-collector-68c96c788c-4m2p2                   1/1       Running            0          6h

onap          dep-dcae-tca-analytics-5559dcf5bb-xhw8t                        2/2       Running            0          6h

onap          dep-dcae-ves-collector-797647879b-rqpnv                        2/2       Running            0          6h

onap          dep-holmes-engine-mgmt-84b8bccfd4-zxb6c                        1/1       Running            0          6h

onap          dep-holmes-rule-mgmt-5fc79496d8-r777b                          1/1       Running            0          6h

onap          onap-aaf-aaf-cass-64b977bb95-nb8rq                             1/1       Running            0          6h

onap          onap-aaf-aaf-cm-7c7bb9fb57-fd9q4                               1/1       Running            0          6h

onap          onap-aaf-aaf-fs-5747c797d7-8n9fz                               1/1       Running            0          6h

onap          onap-aaf-aaf-gui-99d866c5-zxkqd                                1/1       Running            0          6h

onap          onap-aaf-aaf-locate-5b78cdc64d-s7kkr                           1/1       Running            0          6h

onap          onap-aaf-aaf-oauth-6868c5b886-7fg86                            1/1       Running            0          6h

onap          onap-aaf-aaf-service-6dd45db6d6-zz6ht                          1/1       Running            0          6h

onap          onap-aaf-aaf-sms-5f859f5d47-b8sns                              1/1       Running            0          6h

onap          onap-aaf-aaf-sms-preload-l9kk2                                 0/1       Completed          0          6h

onap          onap-aaf-aaf-sms-quorumclient-0                                1/1       Running            0          6h

onap          onap-aaf-aaf-sms-quorumclient-1                                1/1       Running            0          6h

onap          onap-aaf-aaf-sms-quorumclient-2                                1/1       Running            0          6h

onap          onap-aaf-aaf-sms-vault-0                                       2/2       Running            1          6h

onap          onap-aaf-aaf-sshsm-distcenter-fztng                            0/1       Completed          0          6h

onap          onap-aaf-aaf-sshsm-testca-zmxpk                                0/1       Completed          0          6h

onap          onap-aai-aai-5fddd4b796-jtkn5                                  0/1       Init:0/1           4          50m

onap          onap-aai-aai-babel-7b9bdcf9c6-8cwm2                            2/2       Running            0          6h

onap          onap-aai-aai-champ-db9f9cccf-vjg96                             0/2       Init:0/1           36         6h

onap          onap-aai-aai-data-router-7498795cd4-5t6qg                      2/2       Running            0          6h

onap          onap-aai-aai-elasticsearch-75d65dff94-9dkr6                    1/1       Running            0          6h

onap          onap-aai-aai-gizmo-7cf876476-s88kw                             2/2       Running            0          6h

onap          onap-aai-aai-graphadmin-65557988cb-2q6md                       0/2       Init:0/1           36         6h

onap          onap-aai-aai-graphadmin-create-db-schema-59sv4                 0/1       Init:Error         0          2h

onap          onap-aai-aai-graphadmin-create-db-schema-5dkvz                 0/1       Init:Error         0          2h

onap          onap-aai-aai-graphadmin-create-db-schema-5pr55                 0/1       Init:Error         0          3h

onap          onap-aai-aai-graphadmin-create-db-schema-82dj9                 0/1       Init:Error         0          4h

onap          onap-aai-aai-graphadmin-create-db-schema-8gsnq                 0/1       Init:Error         0          3h

onap          onap-aai-aai-graphadmin-create-db-schema-8gvwz                 0/1       Init:Error         0          6h

onap          onap-aai-aai-graphadmin-create-db-schema-bb875                 0/1       Init:Error         0          5h

onap          onap-aai-aai-graphadmin-create-db-schema-cphmm                 0/1       Init:Error         0          4h

onap          onap-aai-aai-graphadmin-create-db-schema-dvfbs                 0/1       Init:Error         0          5h

onap          onap-aai-aai-graphadmin-create-db-schema-jrz62                 0/1       Init:Error         0          3h

onap          onap-aai-aai-graphadmin-create-db-schema-l5zv2                 0/1       Init:Error         0          5h

onap          onap-aai-aai-graphadmin-create-db-schema-lgpww                 0/1       Init:Error         0          2h

onap          onap-aai-aai-graphadmin-create-db-schema-lk7sz                 0/1       Init:Error         0          4h

onap          onap-aai-aai-graphadmin-create-db-schema-smtx7                 0/1       Init:Error         0          5h

onap          onap-aai-aai-graphadmin-create-db-schema-tgrfd                 0/1       Init:Error         0          3h

onap          onap-aai-aai-graphadmin-create-db-schema-vgmgm                 0/1       Init:Error         0          6h

onap          onap-aai-aai-modelloader-8b659f647-vjwz7                       2/2       Running            0          6h

onap          onap-aai-aai-resources-664f4f8f7f-zzxdg                        0/2       Init:0/1           36         6h

onap          onap-aai-aai-schema-service-5f665475b8-b4npt                   2/2       Running            0          6h

onap          onap-aai-aai-search-data-7dbb99df5f-zbdp7                      2/2       Running            0          6h

onap          onap-aai-aai-sparky-be-75fbccb9b-f5sbg                         0/2       Init:0/1           0          6h

onap          onap-aai-aai-spike-5d94584978-wd887                            2/2       Running            0          6h

onap          onap-aai-aai-traversal-bf4448d76-2rwm6                         0/2       Init:0/1           36         6h

onap          onap-aai-aai-traversal-update-query-data-g9nb4                 0/1       Init:0/1           36         6h

onap          onap-appc-appc-0                                               2/2       Running            0          1h

onap          onap-appc-appc-ansible-server-0                                1/1       Running            0          1h

onap          onap-appc-appc-cdt-84d65c7b7c-gkffr                            1/1       Running            0          1h

onap          onap-appc-appc-db-0                                            1/1       Running            0          1h

onap          onap-appc-appc-db-1                                            1/1       Running            0          1h

onap          onap-appc-appc-db-2                                            1/1       Running            1          1h

onap          onap-appc-appc-dgbuilder-546b4897bb-8ws2w                      1/1       Running            0          1h

onap          onap-clamp-clamp-c497679c-4s2bj                                2/2       Running            0          1h

onap          onap-clamp-clamp-dash-es-774684c89f-9rc7h                      1/1       Running            0          1h

onap          onap-clamp-clamp-dash-kibana-748877ff4d-rhc72                  1/1       Running            0          1h

onap          onap-clamp-clamp-dash-logstash-678bd4d5bb-ln7cb                1/1       Running            0          1h

onap          onap-clamp-clampdb-5787b6c689-9k4nt                            1/1       Running            0          1h

onap          onap-cli-cli-8f5dc65d5-nxrtf                                   1/1       Running            0          1h

onap          onap-consul-consul-849447d678-sqxrl                            1/1       Running            0          6h

onap          onap-consul-consul-server-0                                    1/1       Running            0          6h

onap          onap-consul-consul-server-1                                    1/1       Running            0          6h

onap          onap-consul-consul-server-2                                    1/1       Running            0          6h

onap          onap-contrib-netbox-app-58b66f479c-kmtzk                       1/1       Running            2          59m

onap          onap-contrib-netbox-app-provisioning-wjcp2                     0/1       Completed          0          59m

onap          onap-contrib-netbox-nginx-7555fb7f5-mnklx                      1/1       Running            0          59m

onap          onap-contrib-netbox-postgres-79568cf77-gr9c2                   1/1       Running            0          59m

onap          onap-dcaegen2-dcae-bootstrap-68b4ff6cf8-pk7qg                  1/1       Running            0          6h

onap          onap-dcaegen2-dcae-cloudify-manager-67c6965cc9-7bqnt           1/1       Running            0          6h

onap          onap-dcaegen2-dcae-config-binding-service-7586b7b574-2qwkn     2/2       Running            0          6h

onap          onap-dcaegen2-dcae-db-0                                        1/1       Running            0          6h

onap          onap-dcaegen2-dcae-db-1                                        1/1       Running            0          6h

onap          onap-dcaegen2-dcae-deployment-handler-8545cf89bb-zh9td         2/2       Running            0          6h

onap          onap-dcaegen2-dcae-healthcheck-6bf85ffffb-c7q4l                1/1       Running            0          6h

onap          onap-dcaegen2-dcae-inv-pg-0                                    1/1       Running            0          6h

onap          onap-dcaegen2-dcae-inv-pg-1                                    1/1       Running            0          6h

onap          onap-dcaegen2-dcae-inv-pgpool-5cbd6467b4-brffb                 1/1       Running            0          6h

onap          onap-dcaegen2-dcae-inv-pgpool-5cbd6467b4-mkspt                 1/1       Running            0          6h

onap          onap-dcaegen2-dcae-inventory-api-64c6774b6b-ddjlg              1/1       Running            0          6h

onap          onap-dcaegen2-dcae-pgpool-696c95c8b-9r4mx                      1/1       Running            0          6h

onap          onap-dcaegen2-dcae-pgpool-696c95c8b-dhs2d                      1/1       Running            0          6h

onap          onap-dcaegen2-dcae-policy-handler-5cc664b4bb-t2kjk             2/2       Running            0          6h

onap          onap-dcaegen2-dcae-redis-0                                     1/1       Running            0          6h

onap          onap-dcaegen2-dcae-redis-1                                     1/1       Running            0          6h

onap          onap-dcaegen2-dcae-redis-2                                     1/1       Running            0          6h

onap          onap-dcaegen2-dcae-redis-3                                     1/1       Running            0          6h

onap          onap-dcaegen2-dcae-redis-4                                     1/1       Running            0          6h

onap          onap-dcaegen2-dcae-redis-5                                     1/1       Running            0          6h

onap          onap-dcaegen2-dcae-servicechange-handler-64749c57c7-djqmw      0/1       Init:0/1           0          6h

onap          onap-dmaap-dbc-pg-0                                            1/1       Running            0          6h

onap          onap-dmaap-dbc-pg-1                                            1/1       Running            0          6h

onap          onap-dmaap-dbc-pgpool-d865b8fdd-mzznn                          1/1       Running            0          6h

onap          onap-dmaap-dbc-pgpool-d865b8fdd-ztv22                          1/1       Running            0          6h

onap          onap-dmaap-dmaap-bc-5cbb8588c-rs7qw                            1/1       Running            0          6h

onap          onap-dmaap-dmaap-bc-post-install-zkp27                         0/1       Completed          0          6h

onap          onap-dmaap-dmaap-dr-db-0                                       1/1       Running            0          6h

onap          onap-dmaap-dmaap-dr-db-1                                       1/1       Running            0          6h

onap          onap-dmaap-dmaap-dr-node-0                                     2/2       Running            0          6h

onap          onap-dmaap-dmaap-dr-prov-64d678785d-2rmhb                      2/2       Running            0          6h

onap          onap-dmaap-message-router-0                                    1/1       Running            0          6h

onap          onap-dmaap-message-router-kafka-0                              1/1       Running            0          6h

onap          onap-dmaap-message-router-kafka-1                              1/1       Running            0          6h

onap          onap-dmaap-message-router-kafka-2                              1/1       Running            0          6h

onap          onap-dmaap-message-router-mirrormaker-588cb796d7-rsphf         0/1       CrashLoopBackOff   79         6h

onap          onap-dmaap-message-router-zookeeper-0                          1/1       Running            0          6h

onap          onap-dmaap-message-router-zookeeper-1                          1/1       Running            0          6h

onap          onap-dmaap-message-router-zookeeper-2                          1/1       Running            0          6h

onap          onap-esr-esr-gui-f57b4875f-v6x2b                               1/1       Running            0          5h

onap          onap-esr-esr-server-b595b6dc6-4dzvq                            2/2       Running            0          5h

onap          onap-log-log-elasticsearch-9798b655f-lk4bc                     1/1       Running            0          2h

onap          onap-log-log-kibana-6b89fd4858-fnnkc                           1/1       Running            0          2h

onap          onap-log-log-logstash-8676887cd4-mgfcz                         1/1       Running            0          2h

onap          onap-msb-kube2msb-7c55d474ff-f4nxs                             1/1       Running            0          6h

onap          onap-msb-msb-consul-7547dd6464-5rvb2                           1/1       Running            0          6h

onap          onap-msb-msb-discovery-6797d4f545-dxlpf                        2/2       Running            0          6h

onap          onap-msb-msb-eag-56954754d6-gwx62                              2/2       Running            0          6h

onap          onap-msb-msb-iag-c57959dc9-tmnpm                               2/2       Running            0          6h

onap          onap-multicloud-multicloud-56b8f97869-6qpjp                    1/2       ImagePullBackOff   0          5h

onap          onap-multicloud-multicloud-azure-5678854877-fvjv2              2/2       Running            0          5h

onap          onap-multicloud-multicloud-ocata-589f4d44d8-w2p9d              1/2       ImagePullBackOff   0          5h

onap          onap-multicloud-multicloud-pike-67f9df799c-vc9h5               1/2       ImagePullBackOff   0          5h

onap          onap-multicloud-multicloud-starlingx-79bf6df8b8-9xm26          2/2       Running            0          5h

onap          onap-multicloud-multicloud-vio-98bf8fb69-9fssg                 1/2       ImagePullBackOff   0          5h

onap          onap-multicloud-multicloud-windriver-9d8c7467d-4s6kg           1/2       ErrImagePull       0          5h

onap          onap-nfs-provisioner-nfs-provisioner-564b76fb59-vq622          1/1       Running            0          6h

onap          onap-oof-cmso-db-0                                             1/1       Running            0          5h

onap          onap-oof-music-cassandra-0                                     1/1       Running            2          5h

onap          onap-oof-music-cassandra-1                                     1/1       Running            0          4h

onap          onap-oof-music-cassandra-2                                     1/1       Running            0          4h

onap          onap-oof-music-cassandra-job-config-qg9xh                      0/1       Completed          0          5h

onap          onap-oof-music-tomcat-c7b8f6488-g4nqn                          1/1       Running            0          5h

onap          onap-oof-music-tomcat-c7b8f6488-svlk6                          1/1       Running            0          5h

onap          onap-oof-music-tomcat-c7b8f6488-zcz5x                          1/1       Running            0          5h

onap          onap-oof-oof-5b8c698f4d-2zdzb                                  1/1       Running            0          5h

onap          onap-oof-oof-cmso-optimizer-f4569b84c-vbdrk                    1/1       Running            0          5h

onap          onap-oof-oof-cmso-service-d746bdbcf-hnc28                      1/1       Running            0          5h

onap          onap-oof-oof-cmso-ticketmgt-7b4b489bfb-c4xr9                   1/1       Running            0          5h

onap          onap-oof-oof-cmso-topology-5655b885d6-7ktfv                    1/1       Running            0          5h

onap          onap-oof-oof-has-api-79d8bff9b7-j4hhw                          1/1       Running            0          5h

onap          onap-oof-oof-has-controller-8599f4f464-xpqjd                   1/1       Running            0          5h

onap          onap-oof-oof-has-data-77c5d5fccb-qzvl4                         1/1       Running            0          5h

onap          onap-oof-oof-has-healthcheck-xz6wd                             0/1       Completed          0          5h

onap          onap-oof-oof-has-onboard-cqltm                                 0/1       Completed          0          5h

onap          onap-oof-oof-has-reservation-6b4448bd64-zcfpk                  1/1       Running            0          5h

onap          onap-oof-oof-has-solver-7d6cdb957f-fkz6d                       1/1       Running            0          5h

onap          onap-oof-zookeeper-0                                           1/1       Running            0          5h

onap          onap-oof-zookeeper-1                                           1/1       Running            0          4h

onap          onap-oof-zookeeper-2                                           1/1       Running            0          4h

onap          onap-policy-brmsgw-6c9d4dd45b-gr4wv                            1/1       Running            0          2h

onap          onap-policy-drools-0                                           1/1       Running            0          2h

onap          onap-policy-nexus-6fcddd6c6b-48bgh                             1/1       Running            0          2h

onap          onap-policy-pap-6745b8b7b9-zfwpl                               2/2       Running            0          2h

onap          onap-policy-pdp-0                                              2/2       Running            0          2h

onap          onap-policy-policy-apex-pdp-0                                  1/1       Running            0          2h

onap          onap-policy-policy-api-84f88cb4cf-rl2xc                        1/1       Running            0          2h

onap          onap-policy-policy-distribution-9f7b4f44b-6m7pm                1/1       Running            0          2h

onap          onap-policy-policy-pap-68bcb6cbfd-zmtxp                        1/1       Running            0          2h

onap          onap-policy-policy-xacml-pdp-6db679b756-pj25s                  1/1       Running            0          2h

onap          onap-policy-policydb-f5c7d8f55-xnnpq                           1/1       Running            0          2h

onap          onap-pomba-pomba-aaictxbuilder-65c4db467f-jbz6r                2/2       Running            0          1h

onap          onap-pomba-pomba-contextaggregator-65c66d7d4b-hms5l            2/2       Running            0          1h

onap          onap-pomba-pomba-data-router-565d5cfdd7-7r95c                  1/2       CrashLoopBackOff   14         1h

onap          onap-pomba-pomba-elasticsearch-84f46dfbf8-j88m2                1/1       Running            0          1h

onap          onap-pomba-pomba-kibana-77cc84f769-gl4xf                       1/1       Running            0          1h

onap          onap-pomba-pomba-networkdiscovery-dcfd46dfc-mlg9z              2/2       Running            0          1h

onap          onap-pomba-pomba-networkdiscoveryctxbuilder-687bb98bb9-6nstp   2/2       Running            0          1h

onap          onap-pomba-pomba-sdcctxbuilder-68bf9b98d-fjmvs                 2/2       Running            0          1h

onap          onap-pomba-pomba-sdncctxbuilder-57954fd59d-b5sj9               2/2       Running            0          1h

onap          onap-pomba-pomba-search-data-ff6d4fc94-mpcvj                   2/2       Running            0          1h

onap          onap-pomba-pomba-servicedecomposition-fb6d87dd4-ccmjw          2/2       Running            0          1h

onap          onap-pomba-pomba-validation-service-86bcb7f689-gkfkd           2/2       Running            0          1h

onap          onap-portal-portal-app-7d5c9558c6-96rd5                        2/2       Running            0          2h

onap          onap-portal-portal-cassandra-6f997cd8fd-gpshs                  1/1       Running            0          2h

onap          onap-portal-portal-db-cc4768995-f6r7c                          1/1       Running            0          2h

onap          onap-portal-portal-db-config-hbt2w                             0/2       Completed          0          2h

onap          onap-portal-portal-sdk-7586d756d4-m75gr                        2/2       Running            0          2h

onap          onap-portal-portal-widget-594489dbc4-9pr88                     1/1       Running            0          2h

onap          onap-portal-portal-zookeeper-5969678cb7-4qfwz                  1/1       Running            0          2h

onap          onap-robot-robot-548bb494dc-5wr24                              1/1       Running            0          6h

 

onap          onap-sdc-sdc-be-765cb5b6dd-rxkw4                               0/2       Init:0/2           23         4h
onap          onap-sdc-sdc-be-config-backend-4mmrr                           0/1       Init:Error         0          1h
onap          onap-sdc-sdc-be-config-backend-57czf                           0/1       Init:Error         0          2h
onap          onap-sdc-sdc-be-config-backend-7l59x                           0/1       Init:Error         0          2h
onap          onap-sdc-sdc-be-config-backend-8mmh8                           0/1       Init:Error         0          1h
onap          onap-sdc-sdc-be-config-backend-cdbgr                           0/1       Init:0/1           0          16m
onap          onap-sdc-sdc-be-config-backend-hkwqg                           0/1       Init:Error         0          2h
onap          onap-sdc-sdc-be-config-backend-hxt7j                           0/1       Init:Error         0          38m
onap          onap-sdc-sdc-be-config-backend-lbfhk                           0/1       Init:Error         0          4h
onap          onap-sdc-sdc-be-config-backend-pg7q4                           0/1       Init:Error         0          3h
onap          onap-sdc-sdc-be-config-backend-rr7vd                           0/1       Init:Error         0          3h
onap          onap-sdc-sdc-be-config-backend-sztq5                           0/1       Init:Error         0          3h
onap          onap-sdc-sdc-be-config-backend-vn7zv                           0/1       Init:Error         0          2h
onap          onap-sdc-sdc-be-config-backend-vsgqx                           0/1       Init:Error         0          3h
onap          onap-sdc-sdc-be-config-backend-x89rb                           0/1       Init:Error         0          59m
onap          onap-sdc-sdc-cs-config-cassandra-7rrm9                         0/1       Init:Error         0          28m
onap          onap-sdc-sdc-cs-config-cassandra-9f8h9                         0/1       Init:Error         0          4h
onap          onap-sdc-sdc-cs-config-cassandra-bjmld                         0/1       Init:Error         0          3h
onap          onap-sdc-sdc-cs-config-cassandra-c9tzw                         0/1       Init:Error         0          52m
onap          onap-sdc-sdc-cs-config-cassandra-f4vb5                         0/1       Init:Error         0          3h
onap          onap-sdc-sdc-cs-config-cassandra-g2cqp                         0/1       Init:Error         0          2h
onap          onap-sdc-sdc-cs-config-cassandra-jssr8                         0/1       Init:Error         0          1h
onap          onap-sdc-sdc-cs-config-cassandra-kcpgj                         0/1       Init:0/1           0          5m
onap          onap-sdc-sdc-cs-config-cassandra-m7thm                         0/1       Init:Error         0          3h
onap          onap-sdc-sdc-cs-config-cassandra-s6nbn                         0/1       Init:Error         0          3h
onap          onap-sdc-sdc-cs-config-cassandra-vr46x                         0/1       Init:Error         0          2h
onap          onap-sdc-sdc-cs-config-cassandra-vtznz                         0/1       Init:Error         0          1h
onap          onap-sdc-sdc-cs-config-cassandra-xhs42                         0/1       Init:Error         0          1h
onap          onap-sdc-sdc-cs-config-cassandra-z6vdz                         0/1       Init:Error         0          2h
onap          onap-sdc-sdc-dcae-be-5f66c9cf85-4nrjs                          0/2       Init:0/2           23         4h
onap          onap-sdc-sdc-dcae-be-tools-2trcl                               0/1       Init:Error         0          43m
onap          onap-sdc-sdc-dcae-be-tools-4lmtd                               0/1       Init:Error         0          1h
onap          onap-sdc-sdc-dcae-be-tools-6sg65                               0/1       Init:Error         0          3h
onap          onap-sdc-sdc-dcae-be-tools-78ncf                               0/1       Init:Error         0          1h
onap          onap-sdc-sdc-dcae-be-tools-7rl7m                               0/1       Init:Error         0          21m
onap          onap-sdc-sdc-dcae-be-tools-8ptsm                               0/1       Init:Error         0          3h
onap          onap-sdc-sdc-dcae-be-tools-9gr2x                               0/1       Init:Error         0          1h
onap          onap-sdc-sdc-dcae-be-tools-hw6sx                               0/1       Init:Error         0          2h
onap          onap-sdc-sdc-dcae-be-tools-jmw2g                               0/1       Init:Error         0          4h
onap          onap-sdc-sdc-dcae-be-tools-jzflp                               0/1       Init:Error         0          3h
onap          onap-sdc-sdc-dcae-be-tools-k4vsn                               0/1       Init:Error         0          2h
onap          onap-sdc-sdc-dcae-be-tools-l7t9z                               0/1       Init:Error         0          3h
onap          onap-sdc-sdc-dcae-be-tools-q4sl5                               0/1       Init:Error         0          2h
onap          onap-sdc-sdc-dcae-be-tools-rxxm2                               0/1       Init:0/1           0          3m
onap          onap-sdc-sdc-dcae-be-tools-w972p                               0/1       Init:Error         0          3h
onap          onap-sdc-sdc-dcae-dt-cbf6747db-6rwl8                           0/2       Init:0/2           23         4h
onap          onap-sdc-sdc-dcae-fe-754554bc7d-pzsnc                          0/2       Init:0/2           23         4h
onap          onap-sdc-sdc-dcae-tosca-lab-5f9cdfc484-kgj5s                   0/2       Init:0/1           23         4h
onap          onap-sdc-sdc-es-58f9876566-wpd4j                               1/1       Running            0          4h
onap          onap-sdc-sdc-es-config-elasticsearch-s7zb2                     0/1       Completed          0          4h
onap          onap-sdc-sdc-fe-77859d45d-x8mf6                                0/2       Init:1/2           23         4h
onap          onap-sdc-sdc-kb-67986d4fdb-rhfb9                               1/1       Running            0          4h
onap          onap-sdc-sdc-onboarding-be-5d4d9fdbf5-pccpg                    0/2       Init:0/1           23         4h
onap          onap-sdc-sdc-onboarding-be-cassandra-init-666pt                0/1       Init:Error         0          2h
onap          onap-sdc-sdc-onboarding-be-cassandra-init-7854p                0/1       Init:Error         0          50m
onap          onap-sdc-sdc-onboarding-be-cassandra-init-829f6                0/1       Init:0/1           0          6m
onap          onap-sdc-sdc-onboarding-be-cassandra-init-8nmc7                0/1       Init:Error         0          4h
onap          onap-sdc-sdc-onboarding-be-cassandra-init-9t9tj                0/1       Init:Error         0          2h
onap          onap-sdc-sdc-onboarding-be-cassandra-init-fvsfr                0/1       Init:Error         0          3h
onap          onap-sdc-sdc-onboarding-be-cassandra-init-gs5vq                0/1       Init:Error         0          3h
onap          onap-sdc-sdc-onboarding-be-cassandra-init-hvd58                0/1       Init:Error         0          1h
onap          onap-sdc-sdc-onboarding-be-cassandra-init-j4xls                0/1       Init:Error         0          1h
onap          onap-sdc-sdc-onboarding-be-cassandra-init-lbkwq                0/1       Init:Error         0          1h
onap          onap-sdc-sdc-onboarding-be-cassandra-init-rxcsf                0/1       Init:Error         0          28m
onap          onap-sdc-sdc-onboarding-be-cassandra-init-tf5p2                0/1       Init:Error         0          2h
onap          onap-sdc-sdc-onboarding-be-cassandra-init-xmpft                0/1       Init:Error         0          3h
onap          onap-sdc-sdc-onboarding-be-cassandra-init-z5vjq                0/1       Init:Error         0          3h
onap          onap-sdc-sdc-wfd-be-674598449-h84qn                            0/1       Init:0/1           23         4h
onap          onap-sdc-sdc-wfd-be-workflow-init-2fnts                        0/1       Init:Error         0          3h
onap          onap-sdc-sdc-wfd-be-workflow-init-46mpp                        0/1       Init:Error         0          3h
onap          onap-sdc-sdc-wfd-be-workflow-init-4q2c7                        0/1       Init:Error         0          4h
onap          onap-sdc-sdc-wfd-be-workflow-init-9lnfn                        0/1       Init:Error         0          2h
onap          onap-sdc-sdc-wfd-be-workflow-init-b7sp9                        0/1       Init:Error         0          1h
onap          onap-sdc-sdc-wfd-be-workflow-init-dc8rt                        0/1       Init:Error         0          24m
onap          onap-sdc-sdc-wfd-be-workflow-init-gk2t7                        0/1       Init:Error         0          51m
onap          onap-sdc-sdc-wfd-be-workflow-init-h4fwk                        0/1       Init:Error         0          2h
onap          onap-sdc-sdc-wfd-be-workflow-init-nsrx8                        0/1       Init:0/1           0          5m
onap          onap-sdc-sdc-wfd-be-workflow-init-qrw8s                        0/1       Init:Error         0          1h
onap          onap-sdc-sdc-wfd-be-workflow-init-qtns4                        0/1       Init:Error         0          3h
onap          onap-sdc-sdc-wfd-be-workflow-init-tvpfx                        0/1       Init:Error         0          3h
onap          onap-sdc-sdc-wfd-be-workflow-init-vgxd9                        0/1       Init:Error         0          2h
onap          onap-sdc-sdc-wfd-be-workflow-init-w5cqp                        0/1       Init:Error         0          1h
onap          onap-sdc-sdc-wfd-fe-65b77d5dc-lnkkv                            0/2       Init:0/1           23         4h
onap          onap-sdnc-cds-blueprints-processor-6868768c89-thm5r            1/1       Running            0          3h
onap          onap-sdnc-cds-command-executor-5467db8b48-gvnsw                1/1       Running            0          3h
onap          onap-sdnc-cds-controller-blueprints-c8b94687c-9md5v            1/1       Running            0          3h
onap          onap-sdnc-cds-db-0                                             1/1       Running            0          3h
onap          onap-sdnc-cds-ui-7b77b474d-dk9dp                               1/1       Running            0          3h
onap          onap-sdnc-nengdb-0                                             1/1       Running            0          3h
onap          onap-sdnc-network-name-gen-59b5d6f9f7-w85fp                    1/1       Running            0          3h
onap          onap-sdnc-sdnc-0                                               0/2       Init:0/1           19         3h
onap          onap-sdnc-sdnc-ansible-server-86dd694f67-xnh4r                 0/1       Init:0/1           19         3h
onap          onap-sdnc-sdnc-dgbuilder-86c48586c6-kzfqg                      0/1       Init:0/1           20         3h
onap          onap-sdnc-sdnc-dmaap-listener-6c4456d4d-h4pc9                  0/1       Init:0/1           19         3h
onap          onap-sdnc-sdnc-ueb-listener-c4dc65dbd-6gdd2                    0/1       Init:0/1           19         3h
onap          onap-sniro-emulator-sniro-emulator-59d5c5796b-q57bt            1/1       Running            0          49m
onap          onap-so-so-745c8f78f7-bvmgr                                    0/1       Init:Error         27         4h
onap          onap-so-so-bpmn-infra-5888b588cf-jwf5s                         0/1       Init:0/1           27         4h
onap          onap-so-so-catalog-db-adapter-667c887d-ctcmv                   0/1       Init:0/1           27         4h
onap          onap-so-so-mariadb-config-job-7gzc9                            0/1       Init:Error         0          4h
onap          onap-so-so-mariadb-config-job-8tlsp                            0/1       Init:Error         0          29m
onap          onap-so-so-mariadb-config-job-cn9v5                            0/1       Init:Error         0          2h
onap          onap-so-so-mariadb-config-job-d6bgl                            0/1       Init:Error         0          2h
onap          onap-so-so-mariadb-config-job-djcn9                            0/1       Init:Error         0          2h
onap          onap-so-so-mariadb-config-job-g5p6v                            0/1       Init:Error         0          4h
onap          onap-so-so-mariadb-config-job-gfwfn                            0/1       Init:Error         0          3h
onap          onap-so-so-mariadb-config-job-gx86m                            0/1       Init:Error         0          1h
onap          onap-so-so-mariadb-config-job-mptrr                            0/1       Init:Error         0          3h
onap          onap-so-so-mariadb-config-job-p2c64                            0/1       Init:Error         0          4h
onap          onap-so-so-mariadb-config-job-pnv8d                            0/1       Init:0/2           0          3m
onap          onap-so-so-mariadb-config-job-q2zrg                            0/1       Init:Error         0          49m
onap          onap-so-so-mariadb-config-job-qxs76                            0/1       Init:Error         0          4h
onap          onap-so-so-mariadb-config-job-r8jln                            0/1       Init:Error         0          1h
onap          onap-so-so-mariadb-config-job-r8mcq                            0/1       Init:Error         0          1h
onap          onap-so-so-mariadb-config-job-s65kn                            0/1       Init:Error         0          3h
onap          onap-so-so-monitoring-6c68654f8b-hwfjq                         1/1       Running            0          4h
onap          onap-so-so-openstack-adapter-59697c5878-6pfbp                  0/1       Init:0/1           27         4h
onap          onap-so-so-request-db-adapter-69f6f57d56-8lp6h                 0/1       Init:0/1           27         4h
onap          onap-so-so-sdc-controller-567cb8f7d-ht5hg                      0/1       Init:0/1           27         4h
onap          onap-so-so-sdnc-adapter-5798d4f798-59dh6                       1/1       Running            0          4h
onap          onap-so-so-vfc-adapter-86dbb685b9-ld57d                        0/1       Init:0/1           27         4h
onap          onap-so-so-vnfm-adapter-5b4d7496d7-8t4tl                       1/1       Running            0          4h
onap          onap-uui-uui-f4c65b785-cz6ft                                   1/1       Running            0          1h
onap          onap-uui-uui-server-85c74899bf-7f4gg                           1/1       Running            0          1h
onap          onap-vfc-vfc-catalog-546585f6cc-trkbk                          2/2       Running            0          2h
onap          onap-vfc-vfc-db-68ff9f85d6-tfpfm                               1/1       Running            0          2h
onap          onap-vfc-vfc-ems-driver-b6cd75885-86c6g                        1/1       Running            0          2h
onap          onap-vfc-vfc-generic-vnfm-driver-f79b4bdcb-nk9d5               2/2       Running            0          2h
onap          onap-vfc-vfc-huawei-vnfm-driver-895fd4c89-zm5db                2/2       Running            0          2h
onap          onap-vfc-vfc-juju-vnfm-driver-974cd88d6-xh8n9                  2/2       Running            0          2h
onap          onap-vfc-vfc-mariadb-0                                         1/1       Running            1          2h
onap          onap-vfc-vfc-mariadb-1                                         1/1       Running            1          2h
onap          onap-vfc-vfc-mariadb-2                                         1/1       Running            1          1h
onap          onap-vfc-vfc-multivim-proxy-575dd79c57-42wcx                   1/1       Running            0          2h
onap          onap-vfc-vfc-nokia-v2vnfm-driver-588f84fdf6-g8tjz              1/1       Running            0          2h
onap          onap-vfc-vfc-nslcm-6f49f849fd-ghjp9                            2/2       Running            0          2h
onap          onap-vfc-vfc-resmgr-6d56f7dc-qjww8                             2/2       Running            0          2h
onap          onap-vfc-vfc-vnflcm-6b768f99b7-ltjq4                           2/2       Running            0          2h
onap          onap-vfc-vfc-vnfmgr-859bd47795-s2ltd                           2/2       Running            0          2h
onap          onap-vfc-vfc-vnfres-6f8df9ccdb-fm79j                           2/2       Running            0          2h
onap          onap-vfc-vfc-workflow-engine-78d9897f5-f8dkw                   1/1       Running            0          2h
onap          onap-vfc-vfc-workflow-f8948f578-l8khv                          1/1       Running            0          2h
onap          onap-vfc-vfc-zte-sdnc-driver-6795bb4cf6-5jqbj                  1/1       Running            0          2h
onap          onap-vfc-vfc-zte-vnfm-driver-c79b9dc97-842rt                   2/2       Running            0          2h
onap          onap-vid-vid-767bd6bc59-l4xvf                                  2/2       Running            0          2h
onap          onap-vid-vid-galera-config-qczbx                               0/1       Completed          0          2h
onap          onap-vid-vid-mariadb-galera-0                                  1/1       Running            0          2h
onap          onap-vnfsdk-vnfsdk-84bd9f956-r94vb                             1/1       Running            0          1h
onap          onap-vnfsdk-vnfsdk-init-postgres-rcn76                         0/1       Completed          0          1h
onap          onap-vnfsdk-vnfsdk-pgpool-57899fc8fc-9wcjx                     1/1       Running            0          1h
onap          onap-vnfsdk-vnfsdk-pgpool-57899fc8fc-xg8ll                     1/1       Running            0          1h
onap          onap-vnfsdk-vnfsdk-postgres-0                                  1/1       Running            0          1h
onap          onap-vnfsdk-vnfsdk-postgres-1                                  1/1       Running            0          1h

 

 

 

 

 

This email and the information contained herein is proprietary and confidential and subject to the Amdocs Email Terms of Service, which you may review at https://www.amdocs.com/about/email-terms-of-service

Join onap-discuss@lists.onap.org to automatically receive all group messages.