Bug 1346621 - topology info: "ID not found" error when running concurrently with volume creation.
Summary: topology info: "ID not found" error when running concurrently with volume cre...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Gluster Storage
Classification: Red Hat Storage
Component: heketi
Version: cns-3.4
Hardware: Unspecified
OS: Unspecified
medium
high
Target Milestone: ---
: CNS 3.4
Assignee: Mohamed Ashiq
QA Contact: Prasanth
URL:
Whiteboard:
: 1395042 (view as bug list)
Depends On:
Blocks: 1385247 1392377 1395216
TreeView+ depends on / blocked
 
Reported: 2016-06-15 06:15 UTC by Neha
Modified: 2019-01-01 14:06 UTC (History)
7 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2017-01-18 21:55:14 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github heketi heketi issues 382 0 'None' closed topology info: "ID not found" error when running concurrently with volume creation. 2020-04-21 18:18:18 UTC
Red Hat Bugzilla 1395042 0 high CLOSED heketi-cli node info fails when server is busy at processing request. 2021-02-22 00:41:40 UTC
Red Hat Product Errata RHEA-2017:0148 0 normal SHIPPED_LIVE heketi bug fix and enhancement update 2017-01-19 02:53:24 UTC

Internal Links: 1395042

Description Neha 2016-06-15 06:15:18 UTC
Description of problem:

heketi-cli topology info
Error: Id not found

Logs:
[negroni] Started GET /volumes/1819834f5be2c3dce81b36e14ea440c0
[negroni] Completed 200 OK in 761.725µs
[negroni] Started GET /nodes/410b2c68b6df188f88a69003cb8a757b
[negroni] Completed 500 Internal Server Error in 6.36837ms

500 when fetching node information.

Version-Release number of selected component (if applicable):


How reproducible:
Always

Steps to Reproduce:
Run volume creation and topology info concurrently

Actual results:
heketi-cli topology info
Error: Id not found

Expected results:
Should list info

Additional info:
Upstream bug https://github.com/heketi/heketi/issues/382

Comment 2 Luis Pabón 2016-06-16 01:01:41 UTC
Weird bug.  Good find.

Comment 3 Neha 2016-06-30 06:42:38 UTC
# heketi-cli node info 3f705907e431acef2cb44991f3e5103c
Error: Id not found

# heketi-cli device info c551a279f983e2ebd8a1bdb3b5478848
Error: Id not found

don;t see this when fetching cluster info

Comment 9 Mohamed Ashiq 2016-11-15 11:45:12 UTC
*** Bug 1395042 has been marked as a duplicate of this bug. ***

Comment 10 Humble Chirammal 2016-11-16 12:18:15 UTC
A miniature version of this bug is documented at https://bugzilla.redhat.com/show_bug.cgi?id=1395042. That said, When Heketi is servicing requests like 'volume create', it fails to respond ( It returns "Err: Id not found) on requests like 'node info', 'device info' , however other requests for ex: 'cluster info' works. 

In 'topology info' (https://github.com/heketi/heketi/pull/285/) we internally call/use 'node info', so RC of this and https://bugzilla.redhat.com/show_bug.cgi?id=1395042 should be same. As this bug existed before bz#1395042, we closed the latest and tracking the fix in this bz.

Comment 11 Mohamed Ashiq 2016-11-16 15:08:17 UTC
Hi,

In progress of RCA, We found that in when volume create is in progress, topology info, node info and device info is failing. During volume create, Brick entries are being added and device info throws "Id not found". If the added Brick Id has no value yet, this issue is hit. Node Info internally calling Device Info causes it to suffer too. As far as i see after discussing with Humble on provisioner bits, Issue affecting provisioner is only the bit where node info is failing. We are working towards brick addition not failing node info because node info is does not use brick information.

-- Ashiq, Rtalur

Comment 12 Mohamed Ashiq 2016-11-16 16:41:56 UTC
Hi,

I have a patch(PR https://github.com/heketi/heketi/pull/575) upstream under review which makes node info work even in volume create progression.

-- Ashiq

Comment 13 Michael Adam 2016-11-21 08:49:45 UTC
https://github.com/heketi/heketi/pull/579

has been merged upstream to address this BZ.

Comment 14 Mohamed Ashiq 2016-11-21 08:52:11 UTC
(In reply to Mohamed Ashiq from comment #12)
> Hi,
> 
> I have a patch(PR https://github.com/heketi/heketi/pull/575) upstream under
> review which makes node info work even in volume create progression.
> 
> -- Ashiq

This PR is deferred and PR(579) is decided as complete solution.

Comment 15 Prasanth 2016-12-02 09:31:10 UTC
Verified as fixed in the latest version. Topology info and volume creation works concurrently now without any issues.

Comment 16 Humble Chirammal 2016-12-02 09:36:35 UTC
(In reply to Prasanth from comment #15)
> Verified as fixed in the latest version. Topology info and volume creation
> works concurrently now without any issues.

Glad to hear DP works perfectly now . Thanks Prasanth for the verification!!!

Comment 18 errata-xmlrpc 2017-01-18 21:55:14 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHEA-2017-0148.html


Note You need to log in before you can comment on or make changes to this bug.