jiocloud-devops team mailing list archive
-
jiocloud-devops team
-
Mailing list archive
-
Message #00047
[Bug 1435822] Re: Intermittent connectivity issues on production enviornment
Got the logs, thanks to Soren :
root@ocdb1-production:/tmp# grep -inr 543202ca-d9f4-4db3-bd67-16073e59238b nova-api.log.7
2264091:2015-05-25 05:28:43.430 46603 DEBUG nova.api.openstack.wsgi [req-543202ca-d9f4-4db3-bd67-16073e59238b da21f592cebe4c29b6c27951cf57cfb6 89c1cb74a3ef40829a767f6bb618eed6] Calling method '<bound method Controller.detail of <nova.api.openstack.compute.servers.Controller object at 0x7f205e782c10>>' (Content-type='None', Accept='application/json') _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:947
2264092:2015-05-25 05:28:43.431 46603 DEBUG nova.api.openstack.compute.servers [req-543202ca-d9f4-4db3-bd67-16073e59238b da21f592cebe4c29b6c27951cf57cfb6 89c1cb74a3ef40829a767f6bb618eed6] Removing options '' from query remove_invalid_options /usr/lib/python2.7/dist-packages/nova/api/openstack/compute/servers.py:1513
2264093:2015-05-25 05:28:43.431 46603 DEBUG nova.compute.api [req-543202ca-d9f4-4db3-bd67-16073e59238b da21f592cebe4c29b6c27951cf57cfb6 89c1cb74a3ef40829a767f6bb618eed6] Searching by: {'deleted': False, 'project_id': u'89c1cb74a3ef40829a767f6bb618eed6'} get_all /usr/lib/python2.7/dist-packages/nova/compute/api.py:1854
2264142:2015-05-25 05:28:44.574 46603 ERROR nova.api.openstack [req-543202ca-d9f4-4db3-bd67-16073e59238b da21f592cebe4c29b6c27951cf57cfb6 89c1cb74a3ef40829a767f6bb618eed6] Caught error: Request Failed: internal server error while processing your request.
2264200:2015-05-25 05:28:44.577 46603 INFO nova.api.openstack [req-543202ca-d9f4-4db3-bd67-16073e59238b da21f592cebe4c29b6c27951cf57cfb6 89c1cb74a3ef40829a767f6bb618eed6] http://127.0.0.1:18774/v2/89c1cb74a3ef40829a767f6bb618eed6/servers/detail returned with HTTP 500
2264201:2015-05-25 05:28:44.577 46603 DEBUG nova.api.openstack.wsgi [req-543202ca-d9f4-4db3-bd67-16073e59238b da21f592cebe4c29b6c27951cf57cfb6 89c1cb74a3ef40829a767f6bb618eed6] Returning 500 to user: The server has either erred or is incapable of performing the requested operation. __call__ /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:1217
2264202:2015-05-25 05:28:44.578 46603 INFO nova.osapi_compute.wsgi.server [req-543202ca-d9f4-4db3-bd67-16073e59238b da21f592cebe4c29b6c27951cf57cfb6 89c1cb74a3ef40829a767f6bb618eed6] 10.140.192.30,127.0.0.1 "GET /v2/89c1cb74a3ef40829a767f6bb618eed6/servers/detail HTTP/1.1" status: 500 len: 359 time: 1.1986530
--
You received this bug notification because you are a member of Reliance
Jio DevOps, which is a bug assignee.
https://bugs.launchpad.net/bugs/1435822
Title:
Intermittent connectivity issues on production enviornment
Status in Jio:
New
Bug description:
We are still facing issues
ERROR: Unable to delete any of the specified volumes.
jas@st7:~$ date
Thu Apr 16 15:57:53 IST 2015
jas@st7:~$
Cinder connectivity issue is observed multiple times on prod env .
Nova Connectivity issue
jas@st7:~$ nova list
ERROR (ClientException): The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-1fc3235d-55d0-4c95-bb4d-ccbea5ffcac8)
jas@st7:~$
-------------------------------------------------------------------------------------------------
We are facing intermittent connectivity issues on production environment.
Date and Time - 24/03/2015 5:43 pm
I ran cinder list couple of times and got service available Error
(503), however after few seconds service became available
Please find following screen capture
=======================================================================================
jas@st7:~/tempest$ cinder list
ERROR: Service Unavailable (HTTP 503)
jas@st7:~/tempest$ cinder list
ERROR: Service Unavailable (HTTP 503)
jas@st7:~/tempest$ nova list
+--------------------------------------+----------------------------------------------+--------+------------+-------------+-----------------------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+----------------------------------------------+--------+------------+-------------+-----------------------------------+
| b994ee9a-9287-4dc8-b186-3260a9b6e24e | AttachInterfacesTestJSON-instance-1116015250 | ERROR | - | NOSTATE | |
| 039a2999-c15d-4525-abcf-11663942b42b | AttachInterfacesTestJSON-instance-352017972 | ERROR | - | NOSTATE | |
| 3cb555fe-c8ff-43b6-bcab-45289e1e4ec4 | AttachInterfacesTestJSON-instance-488060500 | ERROR | - | NOSTATE | |
| +--------------------------------------+----------------------------------------------+--------+------------+-------------+-----------------------------------+
jas@st7:~/tempest$ cinder list
+--------------------------------------+-----------+--------------------------+------+-------------+----------+--------------------------------------+
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------------------+------+-------------+----------+--------------------------------------+
| 051177c8-c756-4504-8edb-a301d8606f70 | in-use | vivekvol2 | 5 | None | true | 2ea235b8-681e-4aeb-9697-719b7a8dc6a2 |
| 66da6dfb-e8a9-4f5e-9cc0-f6cc62a235a4 | available | vivekvol3 | 10 | None | true | |
| 9ad96b7d-67e1-4624-baa2-0f5f53ef2bb0 | available | volume-origin-2136419490 | 5 | None | true | |
| b760a666-bb51-4f18-a7f0-7a2a15e4b4c8 | available | imgVol1 | 9 | None | true | |
| b8b5877c-9aa5-4df5-9dc9-743d30f38f6c | in-use | vivekvol1 | 50 | None | true | e9d5f0cc-f780-4047-810e-1ec14ef9c242 |
| ef0cbd93-838b-45d1-89fe-3e12e2e50b99 | error | imgVol1 | 3 | None | false | |
+--------------------------------------+-----------+--------------------------+------+-------------+----------+--------------------------------------+
To manage notifications about this bug go to:
https://bugs.launchpad.net/jio/+bug/1435822/+subscriptions
