1507816 – [CRI-O] CNI netns leaking in cri-o env

Bug 1507816 - [CRI-O] CNI netns leaking in cri-o env

Summary: [CRI-O] CNI netns leaking in cri-o env

Keywords:
Status:	CLOSED ERRATA
Alias:	None
Product:	OpenShift Container Platform
Classification:	Red Hat
Component:	Containers
Sub Component:
Version:	3.7.0
Hardware:	Unspecified
OS:	Unspecified
Priority:	high
Severity:	high
Target Milestone:	---
Target Release:	3.8.0
Assignee:	Mrunal Patel
QA Contact:	DeShuai Ma
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2017-10-31 08:51 UTC by DeShuai Ma
Modified:	2018-03-28 14:09 UTC (History)
CC List:	8 users (show)
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:	2018-03-28 14:08:55 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)
atomic-openshift-node.log (4.48 MB, application/x-gzip) 2017-10-31 10:03 UTC, DeShuai Ma	no flags	Details
View All

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Red Hat Product Errata	RHBA-2018:0489	0	None	None	None	2018-03-28 14:09:21 UTC

Description DeShuai Ma 2017-10-31 08:51:48 UTC

Description of problem:
When testing openshift with cri-o, the pod failed with "FailedCreatePodSandBox	Failed create pod sandbox", then check the log, find some error log:
Oct 31 04:28:56 qe-ui-yanpzhan-37-nrr-1 runc[23540]: time="2017-10-31 04:28:56.249835537-04:00" level=error msg="Error deleting network: fork/exec /opt/cni/bin/openshift-sdn: too many open files"
Oct 31 04:28:56 qe-ui-yanpzhan-37-nrr-1 runc[23540]: time="2017-10-31 04:28:56.250855951-04:00" level=error msg="Error deleting network: fork/exec /opt/cni/bin/openshift-sdn: too many open files"
Oct 31 04:28:56 qe-ui-yanpzhan-37-nrr-1 runc[23540]: time="2017-10-31 04:28:56.605613296-04:00" level=error msg="Error adding network: pipe2: too many open files"
Oct 31 04:28:56 qe-ui-yanpzhan-37-nrr-1 runc[23540]: time="2017-10-31 04:28:56.605619975-04:00" level=error msg="Error while adding to cni lo network: pipe2: too many open files"

And in "/run/netns" there is many files but actaully in my env don't have so many pods.
[root@qe-ui-yanpzhan-37-nrr-1 netns]# pwd
/run/netns
[root@qe-ui-yanpzhan-37-nrr-1 netns]# ls | wc -l
[root@qe-ui-yanpzhan-37-nrr-1 netns]# ls
cni-00388bb9-7437-da1a-b081-840c01dc72a4  cni-3fb5197d-803e-6520-6cb5-04a6325c3631  cni-73671db6-e03c-6d62-4fd2-0d6fc1f6b312  cni-9d1ea022-f24a-aabb-ed40-131b49b19c01  cni-cd82765e-4e6c-ecbc-a55f-624ba6929379
cni-00e86cb9-a1a7-b361-8ba6-76bfdd3194d3  cni-404828c5-e4c6-a717-d9e3-808f16828c30  cni-73ba8bcf-7377-fc35-36e6-fd1427b64a26  cni-9d46c112-ee94-e1af-fa4f-a60d5dd18738  cni-cdb01bd3-f0d1-67fb-b650-2aff1335addc
cni-010a7a8d-3b54-46df-d9f0-644e832ddd34  cni-406e0cc2-5476-0cca-d806-df1b36bea336  cni-73cb1db0-339c-cc8a-eaa4-3e9872e95051  cni-9dfbf943-41ad-8527-d2de-e4d5f57aedbb  cni-ce15ffc2-9626-40f7-d958-e27abaf577f0
cni-01ac7469-ada3-bc34-9f37-8a0a53a33483  cni-419ad76b-73df-ecea-1040-2306098d4589  cni-73e357b8-ade3-e945-ecf9-ce895d2c5c79  cni-9e5f6536-2b70-33a0-ad83-7cf9b4e3c4ce  cni-ce1d7294-eaa9-f1ca-127b-1779ff83a1e3
cni-027684c9-2524-dfe1-eb76-2641404f0fdd  cni-41ee994a-88cd-f3c3-4636-68ba75ca45a6  cni-7469843b-bfed-9ed5-ff71-49eda3341720  cni-9e822d1f-adf3-9a9f-1daa-1085083f8bfb  cni-ce2c3d32-e936-328a-a607-6fc53e66a534
cni-02989cd3-ee1a-045a-d1c3-9b318eec14e5  cni-42e6a398-7a39-c75a-3cad-e54e487a46c3  cni-7550ba1e-c789-6a6f-23aa-fa81d22bba20  cni-9ec9df8c-20ef-f9c5-2110-a10c4c64cd89  cni-cf3226f9-16fd-1bed-436b-1f42809876d8
cni-03eb1f74-6f4a-f275-badf-5f12d9e353b2  cni-4314c5c4-df3b-166f-666b-693e6cbe6cfe  cni-75730458-db4c-7f9d-2193-685f8fd9ca14  cni-9f321ab8-5521-86ae-678a-52bacee1f8b1  cni-cf912364-5c86-58ff-8466-87508af0a5bc
cni-0467e647-b759-9f4a-f4bd-3b0136fd0c32  cni-435274a8-c21f-0ff3-0d89-ecd57096ab3a  cni-75e1a9c8-be6b-53bd-e7b8-dec7a6ce2d63  cni-9f734995-03bb-e56e-7966-e4672c155d94  cni-cf922b05-c77e-6acb-a62f-1eb15e7c238d
cni-048ce374-9e54-138a-ee91-58561a29e336  cni-436805d7-4093-1a36-edb1-6bc4f1bfe359  cni-765e6e50-9305-3307-c2b2-41efc1a343ff  cni-a0caf916-946c-f75f-16a6-e662f4fd98b9  cni-d091caff-6cf3-cd7a-a5cc-90be1433cac4
cni-04b373f9-45a6-6755-a275-530bb52f3a0d  cni-437bb4e2-fdf2-5cea-bd6e-2f6c3b9a9056  cni-76dba5d9-68cc-977f-3dff-e4dfe1991ce3  cni-a0e1e5da-7b96-a26c-7bbc-bc9e503964a9  cni-d0b026b7-ec69-f857-7857-5aac9b63f2a4
cni-05685ec4-a73d-2f4c-2b80-682e0affda57  cni-43bb8611-d6ae-fa50-0e6f-d31a551d4f70  cni-77243101-6545-4a45-f7ed-2f319050b89e  cni-a0e435be-f167-654e-9737-34e294bc6dde  cni-d0ef88b9-9fe0-430a-9061-1500f76d4644
cni-061067e2-341e-161e-a206-91f9a5356bec  cni-44cb703a-d02f-0184-74ed-9f99c58b1a6a  cni-7724cb7a-66c9-ed33-db0f-36117bd00a21  cni-a1a3cf4b-fca2-3748-a180-f80af5723799  cni-d10cc306-4567-d964-031a-a480371e92c7
cni-069d87d8-b2f7-1080-c3c6-99cb1504feb8  cni-4508e230-778e-0e63-4514-23bc979756cd  cni-775de4d1-0dee-3a5c-9e22-48255b87a847  cni-a27d9381-0f5a-db8a-96cd-cd30cbec46c0  cni-d129e450-da51-eded-10f1-2a86fdeea14f
cni-0740fb14-6ee6-02d4-a33a-355c1df83c18  cni-454ea1c7-ebdb-76fa-0c64-a3084652d952  cni-777d2528-cb20-dcf9-21a1-570d20ac4276  cni-a2891d9b-e2bc-0b06-bc61-ceb09ddc8f75  cni-d12bd701-583f-bd9d-8e4d-aa2dbfc20a58
cni-07759b58-e370-df10-5dd1-f7db652b6a87  cni-45718033-9095-4d0c-3a4d-f8e4785559c7  cni-77d28707-0812-c12b-60b8-2c8ff9b4a0cc  cni-a434b9ff-b86a-bcbf-74c5-7a39f2522398  cni-d16f0b30-450a-4daf-4aa6-b05c84bcfe4e
cni-07a76d01-7ef5-58c8-533a-d56844a1c17b  cni-466037d9-82fa-efed-a080-28604ee83c03  cni-77ef3cff-625e-abb5-1dcc-8ee4b7d78253  cni-a47d080d-ba2b-49bc-7b4b-67c3bd5979d6  cni-d29a8e35-6b06-8286-fc4b-fb714f7d4b50
cni-07a937ba-352a-d549-870b-3c6d2e1abf13  cni-4664fa26-25e5-ec58-750a-23ef0b06d3cf  cni-77f3b474-d2f0-7f84-3773-e1a1c2eefacf  cni-a4a38f0d-2ddc-2c14-ad9d-881fc5223126  cni-d2cd1519-10af-f927-7f2e-56e41eeec84a
cni-081d6105-3534-8a97-f0ec-721b080c73ad  cni-46d97c08-9a29-977e-2c27-d4c4b36d611a  cni-7811fc4f-7279-64a6-b4d3-c9c1657bada1  cni-a4aec13d-0b25-a5d6-a698-1adfe8cde62d  cni-d3052415-84ba-3dc7-850a-71ec74f470bd
cni-08577d88-3910-f524-9e43-6ecc95d6a19c  cni-4762ded6-cab8-a739-9c71-34aeb2d02374  cni-781e6948-cbf2-8294-1886-9e9e96033b72  cni-a4d9a1db-83b3-2160-5754-e1f84acca61e  cni-d3168475-6320-6324-20f8-d9980b52f4a1
cni-086fd034-b835-be30-a625-91a13ec9c658  cni-4784f79a-337b-30ac-7be7-9d3355e46f3b  cni-786f3501-489c-2ae7-0b0d-ebde87e8c65a  cni-a5629c48-ffb7-cf40-2bdc-f4c2b15e487a  cni-d35cfca5-9068-7185-5499-cfca4e082867
cni-08cd6372-1922-1885-b344-b1c5e1548976  cni-47b4af42-c472-6fab-6508-252f0eac5908  cni-78c64f4d-6a22-09f7-5d2e-fc57988f8f1c  cni-a5a678e0-57fa-314d-5196-494f28b61f59  cni-d44e4555-6894-82fa-f6e7-99fa703a6755
cni-08d88ce6-126b-90a7-115d-1bbc79fe6810  cni-47efac1b-12ba-705f-b919-76b1eb3694e8  cni-78f328e5-f257-90b3-9531-97653202f6ae  cni-a5e987e8-6435-ad97-c16b-6b556ed482a5  cni-d47f29eb-3b8c-37c7-4a31-18ae434d476c
cni-0947e3d9-1490-4a4f-bb1f-806b63c14f2e  cni-48180250-ff7b-9e92-2625-d16b2febb901  cni-792f513f-5d46-3aba-6ef5-6ce5a3d9fe46  cni-a613b0b4-f1c1-571b-d29d-1193ee957975  cni-d4ddc122-39c4-b088-00c8-4f36a86395a3
cni-09d583a2-01e8-e5ee-e0ad-87ba9ea63f48  cni-4839d00d-454c-6ff7-04ed-e31aef4abc31  cni-79577172-60e6-5db6-bb38-f6c167141553  cni-a63c9318-fa0d-24b1-09a4-dba2a642c607  cni-d51829c9-e7de-a09b-826a-da548c4c9b5f
cni-09f96aca-6ce9-355d-2b8d-7bc24960b5f7  cni-4850faf9-24fc-fec8-5c8b-03e48aa5c02e  cni-7977a902-54da-f979-26d9-bb78e969dc7a  cni-a6872767-fc27-6a04-4a40-38728e835373  cni-d52f7666-6872-3d7d-6ba6-55b5c2f07f49
cni-0a5d7bbe-a400-4966-292a-6b55f39028ca  cni-4851ac9e-27f8-1037-e4ec-82946021d40c  cni-79d3e104-f7cf-949e-edaf-75509e19a3c7  cni-a6e784f8-8ab0-7525-b054-a70c2dd8d4ee  cni-d5e22ef5-869e-3370-c60b-81c67e38b906
cni-0a6bbe4d-b9d5-b8cc-e056-ebac9d146a83  cni-48c2cc66-ad03-cd2a-dfe8-7716e4dfde92  cni-7a44ad74-12ba-b7d9-dfe2-ab6a402406d3  cni-a7c77ee3-82cf-fbc4-0735-e584d4e46c91  cni-d694a1d6-c1ec-4add-5fd9-011519e0dc7b
cni-0a8c5390-9834-1467-6ffd-0314397bfd85  cni-4918bafb-7c3a-bd54-4aa0-0df4c92719f0  cni-7a85ee4d-cf78-8f7f-ea85-5648b51386bf  cni-a7e9c419-8016-3c09-a35c-38fe490531f3  cni-d6e830be-f8ef-8d16-c1ad-90a36d5bc8e5
cni-0ae5ae8e-34d0-f2e3-177d-090a96e5b4aa  cni-49527d72-b946-c0c0-5c87-7507afb534f5  cni-7a861568-340e-4ab9-e2d7-6174dd0e8b8e  cni-a7eb5792-3e23-4535-23c2-9d072d1c1e73  cni-d7454d3a-6aca-3d79-ca12-e93a458d5b63
cni-0b1b71d2-ec33-2098-46bb-9be809ae4b9d  cni-495d67d2-475e-a0d0-4496-2605ae908d88  cni-7aa4e171-fb79-347f-f06e-5a4b30991478  cni-a9a4e7d3-c42c-7361-ac59-e6cd80dcb2fa  cni-d877ff7b-afd8-db7a-9410-7d22dd2e28a8
cni-0b270c92-c974-7dd6-7d44-575394ae9a3d  cni-4960f488-e7ee-c846-88dc-2bed837daa0f  cni-7b70e0b8-8a43-3ff8-3932-b5cb2d261739  cni-a9ad8286-4508-29ad-cacc-dfe7d8d53563  cni-d8ae3df7-7d2c-c2ae-7db7-6a23fbc00cc2
cni-0b4c59a1-d1f7-9c84-4717-91ce4ca65664  cni-4a19d733-bd71-2250-e1e4-a99632c789ac  cni-7bb6a755-d4e3-7004-79a3-d0ba2f1ecdc1  cni-a9f961f1-7bb3-168b-008e-abd325d0d8b9  cni-d92f58bb-180e-3ed5-7066-3b37ec072ae6
cni-0b8147cd-d6d1-f3f5-8dec-2d0482ef8cf6  cni-4a3eb5e8-0079-ccdc-2ab2-cb858b0683e3  cni-7c52f844-ce16-f47d-5c9f-c063d39e1de4  cni-aa22bac7-8337-abe4-38ae-410228779120  cni-dab361a6-f8a2-8031-8fa3-b332ea0cae9d
cni-0bcfe0c6-e946-69cd-0754-140e1f5367c3  cni-4ac708eb-9b6c-ad42-c106-2a9f42f3a6e0  cni-7cf2f448-3c32-377a-52b5-ef49951ac047  cni-aa292478-55d6-f15c-8bf9-a81a4d753e5c  cni-db091c29-b3c3-b06e-cb28-65badf8661b6
cni-0c29910e-f472-27a8-14ec-35a72126e531  cni-4bbf8981-a7fe-4ddd-34a3-d7d93cd8e3ad  cni-7d5e6bd1-30c0-6f98-65a4-948557d6554b  cni-aa73809f-e839-4fe6-eb64-28aac3c69a54  cni-db622db4-fa4d-aede-5a99-45db78a584dc
cni-0d0b9741-be41-ec62-0f62-5ba787c6f871  cni-4c282cd3-5779-7e7f-1275-769d9457f4f8  cni-7d9f2763-9ae4-f028-cc58-685014a800b9  cni-abde7178-8083-9579-6d6f-9967a9a6df38  cni-dbc38ed7-090a-5b85-3f33-ba9b061dfdca
cni-0e2a503c-7c0e-d78b-288a-db0e2509cd8d  cni-4d12acc8-668a-9558-e85d-f100e90ca735  cni-7e6a3f94-20c0-b2fc-633c-25902b391f30  cni-abe93eb9-a2c3-abc3-57e8-878fbea6ce34  cni-dbdc5e24-541b-df0f-df8e-2f1cda93f56e
cni-0e641e5c-bea6-a861-c265-25dd1ad3cd31  cni-4d174e17-fccc-1acd-a4ab-505651e2ff6a  cni-7eb5d01c-e318-34c7-80a5-cc565adae3c0  cni-abf8d5cc-d547-a068-f7ca-63154f52adf6  cni-dcf1e577-7576-84fa-9cde-de019ff2817f
cni-0fd6e6dc-6b21-893e-31ef-45520c0bb0a9  cni-4d649afe-7105-ae40-0f34-f15151bccd26  cni-7efc1da4-7050-5060-c0e4-4bbcc6df506c  cni-ac010761-6f1b-e0d9-3eee-b28d86ce68f9  cni-dd4539a3-54e4-b934-81be-4c3ca2dbea60
cni-1010607b-d043-a25e-7ee7-92534fe1bbb4  cni-4d986c71-a44c-2797-01f8-bcb534c060ec  cni-7f12ed92-f7d1-7639-9437-888548c60d44  cni-ad1a6393-6cec-d617-9eda-70fa4a616dae  cni-dd979815-ae60-bdac-5c02-5dc32f4dc1d6
cni-11a2cb66-b884-e8f9-a4fe-94ca1f8ae109  cni-4df46bd7-b6c3-08bd-b703-7addd1418d75  cni-7f1d9b21-7c0f-7430-3092-744bf66e2c58  cni-ade5fdbb-8fb6-f7c5-212d-fd687318ff4e  cni-ddbcd939-8294-8d37-b690-08beb4ae5df5
cni-121febdb-53fe-4985-ba11-b7f090955c2f  cni-4e3ae848-12a1-6fd6-c967-a29a6f499ff7  cni-7fb14f1b-6f76-3083-c493-25e376b4d864  cni-ae447cc6-a079-a7da-df91-d69ae3e54473  cni-ddec637f-2fc7-37e1-292e-7f07f61c2171
cni-12397d2d-8135-8112-bb85-f179bb40da94  cni-4efcb24e-b5e0-3bd2-5ae7-5ca93821e42c  cni-7fd2e179-8ad0-bc01-4fa1-06196ae10ec0  cni-ae802256-bfc1-5733-c6b4-ece64cc6ceff  cni-de1b96f7-82f1-4604-af57-80130ee14d0a
cni-126291e3-3600-4f77-cfce-4a6df4bd9e53  cni-4f689a95-e98e-8b7f-561b-5e682c52367b  cni-7ff2bc8b-abff-1872-1d81-0ca685362b6a  cni-aec8391f-d4c3-c622-4e41-850d03d5da01  cni-de627947-9c0f-410e-caf2-64fedc2c09e0
cni-126e40fb-af9c-d377-4a06-36df812aba94  cni-501f471e-3b4e-de54-e7f5-e4d60466eb48  cni-80225522-a294-9176-e1a5-43f440fbe957  cni-aee8e667-0543-c595-6c99-323af6ce614e  cni-def0d97c-baa3-bc42-ba94-8bc27c8ced68
cni-12a5a8b6-3dba-966a-ced0-a6611ee1f781  cni-5216f5ab-c61e-3467-7d1a-765a257569d7  cni-8087484a-8fd2-3985-20d2-91e0b768e8ac  cni-aeefeddd-b242-46a3-e13a-b4134ec35b45  cni-def14399-2280-b20d-7f65-616c634f5134
cni-12c79a42-4036-c1c8-1a95-202020095a40  cni-532790ad-184c-51c7-c87d-87fa3b8e4d5b  cni-80eceb06-6946-d7da-d224-cdbf8199803c  cni-af522212-fd10-440b-1a3c-0e0322b665f3  cni-df2e1cd9-d51d-10d9-d3e7-888b2e99da3a
cni-1345461f-8bdc-c63d-9c1b-4069726206a9  cni-5351705d-7788-d9be-b067-ba98a25a9c4d  cni-818a3097-1c0d-aa1e-968e-7545c30850c2  cni-af717b81-290b-70c2-595e-93727d0e9447  cni-df7d77ca-8207-592a-ae1d-5cc0273301b5
cni-162efaad-567f-3e2f-2fcb-34fcd7b65898  cni-53b80493-0746-adc3-da35-b746d1246dbd  cni-823852f8-68f4-737c-965e-60598cb29e7c  cni-af8a0a61-b8a6-97f3-4c2e-c1f410a655ae  cni-dfccfbde-fc97-ff91-a2bd-8ff1c225b3a1
cni-16efd7f2-53de-562d-6dd4-82c33d427e4b  cni-53df9e66-816f-b6d8-462e-5ced97e6947c  cni-8275125c-68de-585f-c3c6-a77f77a8ba14  cni-b0247fb9-aca4-528c-b71d-f4afa11ceac4  cni-e0481465-afa4-921e-94a1-9ee370917fb5
cni-17313fbb-dae9-9a27-e864-33a571096cdd  cni-53fd3689-8b72-ebf4-c30a-a3f7f391ed49  cni-82af648f-addb-2de8-4ddc-352c7ba46c56  cni-b0b35e74-a0e1-aa37-464c-c90c63b87768  cni-e0693901-f620-6b77-3571-c1a42287f736
cni-1754824d-f948-67f8-69bd-bfe93f1161f5  cni-5422c699-f10e-4802-f238-06b5ee42e7a8  cni-8352108f-8d09-7bf5-4844-54cc1aa21893  cni-b142ed49-da7b-92b7-587b-f08ebf125911  cni-e07aab77-5293-d753-d1f2-a8667355cdb0
cni-17c3621e-6e50-44a9-01fb-fc1b96d0bd18  cni-54ec402f-df96-90b0-4c05-376dff7c9ec4  cni-83603368-4c3c-c48f-5970-7de5a78ab69e  cni-b1a81771-a0ce-eb5b-5656-c8c358788126  cni-e0b44329-e94a-e7d4-561b-2614bfb39e75
cni-17ef2af7-d434-e358-0a01-259173a138bd  cni-551eb988-ddef-2498-8a38-3d0dbe37f6cd  cni-837ae8d7-ba17-cef9-8745-fce8989ee722  cni-b28fb07e-ae15-e503-c71f-8820dda7763b  cni-e0e908cf-a66c-817b-4fd8-038d20c696d5
cni-1802e277-0f9c-0374-e7da-ae045d1c0421  cni-556185c0-30e0-0b5b-5fc3-4e38243607aa  cni-83be301e-6aa6-ea81-9535-746d58e5aefb  cni-b2a52c0b-9c3c-ffee-4b35-58c0e1f38468  cni-e126408f-278b-e779-513b-aa618b985b4e
cni-187ed52c-9a18-d823-bcaa-66316140ea9a  cni-5575e480-594a-2ae5-cafb-7f483c7ef7c7  cni-854b937e-cff4-2267-6947-7a20a1086aee  cni-b300c76b-4480-1131-e02c-577fc2f44c1a  cni-e16bf590-6372-0894-1e2e-df1fdac28c24
cni-18c460d1-e6c3-f643-425f-6533d6d711be  cni-558f5fd3-24b4-6d1b-b41f-3223a11e8a2a  cni-856a7414-39e6-507c-57e6-bbd59e8b068a  cni-b3497119-e610-a443-a079-45150bd25260  cni-e188661d-943d-cf60-e6c6-20c901a5fded
cni-18d40989-28a9-a9d7-3cad-5f74ed4caaa4  cni-55cd78bc-1c61-04bb-0580-a11c09632aba  cni-858c10ae-974d-b632-bff7-ddea7603ec9a  cni-b38f2948-44bc-8553-468d-f862864b9ac2  cni-e1aec52b-a153-ad3f-690f-0844d3ed3b66
cni-190f6da5-876d-e7ed-aa94-8daad7b24dc8  cni-56d6b0a7-523d-76d1-f951-8104d4dcf619  cni-85ae2da2-04ef-1bbf-8a58-2c3882ab63d5  cni-b47f161c-1991-8d64-0464-cda755e47b7a  cni-e1ef1309-8ad7-a948-1870-2fbace86b815
cni-19248b0e-a612-a9cb-55ba-54081684782d  cni-56f817c8-a1c1-462e-abab-50bfb758fe41  cni-85b04223-cd59-8808-017c-84e682ed8da8  cni-b49de057-9dfb-f849-e863-59f25c80c583  cni-e1ef8efe-0549-b381-19e0-7fec9b7260c8
cni-1928cf07-3e07-2e6c-f885-38bfbd3eb66b  cni-5719fc96-4eaa-bb89-58b8-3ac46fd3ba97  cni-860d3375-4f51-4f4e-757c-ba9b9dab18ed  cni-b4d79194-967d-7bcf-558c-efebcaee199b  cni-e27b73ce-870f-48ef-adc1-9c6bb7e0d482
cni-1aba4672-fc78-7141-3bb3-09e426bd6188  cni-58034b39-0d1f-3cba-031a-913f04ebd2ec  cni-86b8aeb4-a8a8-1b98-354c-283448896d6f  cni-b4dcbe9e-6515-21cc-66c0-3057068cc5bd  cni-e2c1744b-9282-38e5-b855-a18642bd418b
cni-1b0bf23c-51e4-ab87-c42a-01c8e8ba5e8e  cni-591fa233-f49d-26fe-4870-24a513a5c395  cni-86d2200e-60a5-7ecb-720d-f40d84ac7156  cni-b5077220-7699-afec-85b7-28282d5e3620  cni-e3e07a91-a567-ef8f-c6a1-91353fa51105
cni-1b857011-708e-26c2-e0c3-0a6fd0864c34  cni-59265643-6895-69e0-4d58-26fafbf8a0a3  cni-872a479b-d9e4-5bc2-bbfb-854eb483350a  cni-b5e2ca16-b04a-9294-e201-058ebfcc7f75  cni-e62cc494-5887-af29-8382-4045350c41a4
cni-1bbe2a73-e8c8-d04b-8a29-9f33bc92543c  cni-59582e02-0a0b-980a-bccc-07c56762c66e  cni-872ff86a-63ee-0dfe-c1b9-524729625a17  cni-b5fad845-dff8-c71b-1513-cd38dcdb3410  cni-e67d1e45-f960-355d-f307-0dacac49b17c
cni-1c5de3c3-4a3d-6a3d-4eae-30937d3c6fbf  cni-596b2813-8c48-9b05-900a-8cbf72da785a  cni-881bd0ac-6b01-3925-4723-5b3e7296ee25  cni-b63f6d5c-bf9b-e903-ac5b-9ece01612186  cni-e698e4da-955b-b6b2-37a9-40a140fdcf1a
cni-1d135b00-c92c-e2ba-48ff-df44d469d2ec  cni-59727e1c-68fc-7db5-eca2-35affe9a3b22  cni-88f25847-ee70-ff9c-d933-407ca71fa0d7  cni-b7795a66-0cef-1a7f-7c28-7403e95dd06a  cni-e6b8079d-b9d1-3243-e2a3-07eb6c8dff41
cni-1d4465dd-287d-cdf5-870c-d62e9d36e568  cni-5adcbbe0-cf2d-9523-1b66-cbc3a037c4fc  cni-88f72484-eab5-e009-7eed-d980dcd42d9a  cni-b84c7eeb-4046-e17c-05b6-6e8043020a9e  cni-e6ce3c79-058b-54a6-7e72-584e0369fd29
cni-1ea6f78f-2d85-315a-1334-1e06daa067bd  cni-5b384edb-c2c4-a255-28cf-9cf5ab5e6d4b  cni-8a41d679-2dc5-0394-5755-57c47c8efd20  cni-b8806b06-3edb-168d-398c-ed1d217605a1  cni-e6f6cc8c-48e5-f549-ec91-1ba39a963951
cni-1ec8b935-2652-de99-0399-255ded8716ac  cni-5c135617-0668-2ffc-2a61-4a480eaed03e  cni-8aae92fc-d75e-e056-abb1-516543a6075c  cni-b9872084-7642-5962-5f06-64220ef2d8a0  cni-e70730ef-76dd-0bb7-804b-c90f72854074
cni-214976bf-dfc6-6a19-5625-b9c011a95935  cni-5c2ad9f5-d6d4-0557-02e5-e653c7c15090  cni-8ac2a65b-be9e-3388-0c97-47491b2eaac6  cni-b9f2c39a-2181-2cc8-c10d-6daaff2bcaa6  cni-e74cfbe2-e302-a61b-ade4-325a2bff7cba
cni-2340cf7b-144d-fb35-377e-d4fcebd3383d  cni-5d0fab8d-dd31-bae3-2b9d-971b2ec649f1  cni-8b4fd1e9-ec21-553f-a5a3-0757d507302a  cni-ba06d30a-f6ba-4512-2afc-e21e24932dd8  cni-e7c1ce05-597c-2350-4b78-42c7febc7f3d
cni-237ca89c-ebb7-3219-a1d5-49286f870428  cni-5fb28c42-3af8-35f2-9bf5-6c02a732af88  cni-8ba79d64-48a3-4679-b13c-9af06e860b63  cni-ba66f0f7-0dd7-76e8-e9de-daa7b5e25a56  cni-e8ef2158-40af-dcab-07c3-4b8e1c18a514
cni-23b1f9c4-2256-1347-954d-a2dd8324e756  cni-601fbfe5-c9a6-d9a4-715c-830bd0ce99aa  cni-8bdd79e2-1649-d32f-ec71-3ad177431799  cni-ba799fec-e26a-b9ad-9d55-162b92bf13d7  cni-e94d80b7-7b97-bf66-57bb-a0596bc1b114
cni-23c2fa79-91a0-3c1e-29e3-792b2c44334d  cni-60314690-5dfa-ca34-7dd5-f8fea6b95db7  cni-8be18edf-ac11-7b5a-51f8-f81e38bb6c48  cni-bb21a9e8-335d-e4a3-87d9-cf51789f268f  cni-e9d3bce3-5dfb-a460-3e4f-6446ba25ba46
cni-23cf3a56-0d12-5fca-544a-181d70135999  cni-603b7bf7-44d0-315c-b595-ce1ce518ad12  cni-8c368285-72fd-d1a3-b709-78dceea0683c  cni-bbccc54c-ac59-97bd-6604-822e813f633f  cni-ea161ded-8e6d-7996-f838-16ec001e1c12
cni-23ea6247-063c-7129-4938-77ee4f353379  cni-606b00fc-c6f0-735f-e01b-e3f6852fbbc9  cni-8cf90e85-1ac5-76e9-63dd-af53991a5f7a  cni-bcc4f929-405f-ad69-5373-fb582a23d87a  cni-ec4e96f6-6f51-33d9-26b1-afb013d82bc9
cni-24cc4805-5c98-db02-db69-06ecded8d96e  cni-613a2f1e-382f-2786-7e2c-96d49351f591  cni-8d4225a2-3d87-910c-b80c-45f64f453310  cni-bceed303-6177-8738-81b9-7a6fceb2675e  cni-ec905129-95f7-0a9d-3706-d969985c0211
cni-24e88ed4-8480-3d7e-e791-7669cc35548d  cni-615c3e92-a71e-9e18-a729-5b824dfdd9c1  cni-8d552bf1-33fc-1e2a-8451-4d05dfb24889  cni-bd6979cb-4d6b-83c8-0db6-e565ec36fe0b  cni-ece294a0-f5e4-9503-ec4a-f19186236596
cni-2605f74a-8775-0d1b-7f2c-d299098b615f  cni-61ad750b-dcc1-5345-a2ac-fb7d78c8c902  cni-8d7a7ac3-5bc6-313a-ead5-16162c991cd8  cni-bd82e2a8-a4fc-3f4f-6d19-71be6a107fa6  cni-ed177c3a-33b3-2ff8-7623-74d4347943a1
cni-261df042-3ae5-dba8-4c3c-78004b76889f  cni-62433e88-c092-c89b-9792-10ab72a71fa4  cni-8d8a0c58-9de0-05e9-ac2b-96e2ddb72bcf  cni-bd8351a6-9d63-bd45-f2a9-d123bdc021ac  cni-ed658b43-a3e4-574c-a212-4b5f9c4bfa8d
cni-266535bd-8ff2-97b3-a317-4c7dac3c5cc9  cni-62ba82c7-98c2-e229-80fd-08dd0a41f307  cni-8d8e237b-9138-b494-f567-d8a7903eac3c  cni-bd868e40-c646-c994-a864-bd6d47b6854a  cni-eda47e36-4584-7ef5-ee7b-de1091edd46c
cni-26e42fba-499e-60e7-7fda-b73143ee1724  cni-634a27d3-df58-04c9-91c3-4e532a5b07a3  cni-8dadbb8b-c887-7c4e-e35e-69cfb7ea6eed  cni-bdcebe3e-4380-2232-91d6-a7e8870f0e09  cni-ee0250a1-6528-a296-c8f7-529d8b1b92ee
cni-284f4e99-57e4-bc2c-1eb7-c6b267409245  cni-634e5e38-6c5b-a2fb-f0e4-bd8c4076ddeb  cni-8df7f0a9-f29b-73c5-5967-1530a7283968  cni-beda9514-83af-15a6-8868-e72b1ff0f74b  cni-ef182729-62b0-fa86-170a-4bd04d2bdb8d
cni-28543ddc-7e68-b6f9-a135-82b17fb85e0c  cni-635cdb6f-3e5a-dfb7-0d40-63524c4a4d76  cni-8e960252-3f27-0b08-3964-d303fa7c53a4  cni-bf02ab78-48f6-9823-8b66-2f7c9abb90d7  cni-ef7db565-1073-c460-baa6-064f3e0238e3
cni-28e27187-58f0-2046-c1da-785c93b1d67c  cni-63acf45f-a699-d1b9-cfbf-02f089fa3252  cni-8ea421dc-f0d2-14bb-d3e3-d25c0813d1dc  cni-bf55ae54-1288-33b9-2497-2b9bc19307a4  cni-ef8ce4aa-86e4-5592-14c0-796c9c560fd8
cni-292a2275-818c-3c82-b138-b29e0ed6146f  cni-63b39f4d-a30e-ce46-8c9e-249baa46983b  cni-8ecce0a2-e811-f8cb-1011-8bec0fad2150  cni-bf64593b-7f5d-b0fa-dbe7-23058702683e  cni-f06a9dd9-d575-abdd-4624-3b821de9b2b7
cni-29b15034-e58d-5556-4bd3-ffbd31b0fdcd  cni-63e1b210-fc8e-4a5d-69ae-121e734153d1  cni-8eceb05f-3de9-3572-1af7-92f5654d66cf  cni-bf95715e-c7ea-320d-d61b-02db1cb90be9  cni-f0986c89-35a0-1075-815d-bf11e3dc7836
cni-2a82808b-b3b5-28f2-915a-7776459c9ddd  cni-645d4ade-aacd-c0b0-10c4-eb23eebed718  cni-8f5d6de5-80ce-128d-d74e-533934e4e4c7  cni-c035e5f6-e5ad-9dd9-3d44-adb05373618b  cni-f108254f-8d0a-8c59-4b5a-1a48db88e94b
cni-2ab29ae2-5a89-10fa-133a-c33460946dd6  cni-6498fa9b-698e-bee7-bdca-6843f4635c1a  cni-8fa41e7c-9b8c-bddc-76ce-2b66f1888743  cni-c047697e-699e-f5d9-b9ee-1b395eebd811  cni-f21e59a2-7d37-3f61-676e-1c50671cfa47
cni-2b5fe1ae-7070-0dc5-5e16-0c763f406dfe  cni-654ec579-6ddd-cbc4-e0f8-4f1e46a8101b  cni-900e493c-3a1b-d733-c95b-a56e731de64c  cni-c0f7bc46-e12a-086f-a17c-a18d4e329f53  cni-f28dedd8-cf6d-82b2-0e42-73d12581f100
cni-2b681273-be8d-1b90-eed3-d7458ed6dc58  cni-6552f561-a8d5-7353-9300-03eb8bc5b977  cni-901193ce-d842-50b3-2af5-6ac37ca28498  cni-c120cb1a-5765-b93a-fae1-cc3dbcfe3db7  cni-f2bd4ad4-f307-3e79-86cb-99ef81c6ca23
cni-2be7cb47-4677-0de4-7c11-d88771c9b6c3  cni-657f4581-7c96-af77-9435-43827ac5fe21  cni-90bbab2c-8e9e-ab63-372a-9e8db4a3b9b1  cni-c1383f70-ee42-08fb-b586-f40677fbea0c  cni-f35cc83d-9ccf-19f8-910f-8515dfcfcf4a
cni-2bfb8990-5450-57a3-b308-629ab475262f  cni-65cc9df6-0440-16a0-2902-176891437953  cni-91ad7318-ba86-43c5-e1cb-7d2c0863a4c2  cni-c15aa29b-1fff-18f4-8086-c51ae2db5b20  cni-f3692011-a7e1-fab8-4610-2927ae9cf62f
cni-2ca0ac7d-24a1-2bca-9a43-474cc7ae5b36  cni-65e7f13a-51a3-745b-54da-04bbe959431f  cni-91eeec04-9a43-e168-d864-f698636ea0d2  cni-c1e78f81-ad03-6951-8e77-4e0876583dd6  cni-f3c637f9-f2af-e361-d47c-27fd47f3b07c
cni-2d02c79b-eda4-b533-0aca-bc716e40dc9e  cni-65eaa309-5b3d-3bf3-b540-1555d1156b04  cni-924999d6-7ed7-eb0c-7078-09b294ca35f5  cni-c1ead397-3e18-20c4-dc63-be6020e55c06  cni-f3cca2dd-cea6-bfeb-f289-ea7048542b07
cni-2d847a10-9f1c-fcc6-dae0-06c2513b3081  cni-66fb13b9-e206-449b-cecb-ba4012d48458  cni-92892f77-e586-27e0-ff4b-e46954159899  cni-c20bd8a0-c564-ddb7-4ff8-c007a02b5bf9  cni-f475cd1a-9027-d927-a40e-1ddea1bd362f
cni-2dd30769-2e0d-f5e3-d9ed-33063f1b7216  cni-670d39d1-4a9c-7afb-d5c9-35daa6458df1  cni-92d32367-b260-5167-4af2-ce3f71b00b74  cni-c227f4e8-5409-6087-2c63-0e3485496f2e  cni-f527f4a3-bef0-307d-c0f3-1eaf239bd4eb
cni-2e9f4be2-4307-e99c-1f31-e55161fc9743  cni-6737e16b-f263-3f21-7334-6868ca2c5572  cni-93ae5f63-141a-7f13-24e4-4c116b7f8fcd  cni-c23fbbc9-1cdf-ca22-c21d-b754733d5717  cni-f54bb175-c229-376c-50ac-962f642e22b3
cni-2ff18783-bdf1-96ff-5452-586671041a2d  cni-69139336-1ef9-2c3f-071d-009c5a40fdac  cni-94086882-1161-e193-aa6e-ffede3f1f091  cni-c2456251-50cf-b73a-3dae-e23c37b4295f  cni-f5f94ebc-8b5e-3e16-7f6e-6bdcf2eee85e
cni-3000b741-0232-f5c4-9b4f-e5448fd2fb62  cni-6921e7da-8113-90e4-1310-ae6918a7bf9e  cni-9493de43-4b50-5cf5-8245-554bd3f5e742  cni-c256107e-b126-99f4-227e-f8728f5a498b  cni-f6065f24-5a1b-b9f1-7659-d4cc680aa0d4
cni-30b0d206-50e4-085e-8195-8128e11ee38a  cni-69df39f4-2641-4c65-95f5-2ca265db049e  cni-9495e3d4-9566-4099-af4e-b5a8dbe811c5  cni-c2a38ccf-3a5f-9ccf-9dc2-9a8df446d59e  cni-f62d9ce0-ba5a-f43d-78df-26bd9a29dbf8
cni-31676b31-c641-66d0-57af-5b7681701f06  cni-6a5cdcd7-c553-38eb-41ab-0b76302331c0  cni-94fc1086-8b03-7fc8-7b30-d33d436b83e0  cni-c2ff7681-4d78-50d7-e93b-71477f923d7d  cni-f640b4ad-b62d-3ebc-f024-32089a058011
cni-318b5eaf-ea7c-16d1-6f52-eb58a4a0d9f8  cni-6a98a864-b304-a402-3136-38a9ae010c12  cni-95078fb0-8a7a-5e33-24c3-1484857d5ca0  cni-c31a3e09-b8d7-7a40-4084-c3fa5f3cd95e  cni-f656fa51-0ec5-7124-51f9-2c5c14f67e20
cni-31b2883f-5fec-eaf8-efaf-cde9d2de7e8a  cni-6aa05b42-9bf1-7799-87b0-e3bb33ab8377  cni-9541d0c0-ab41-5cb3-1dd1-549d678c1db2  cni-c35040ea-8465-c328-179b-da4f9b9bacc4  cni-f75080f6-21fd-21ee-4065-0168795f2432
cni-31e12614-334a-90ec-3808-841bd8055ea4  cni-6ae39355-6664-80d4-7b36-c9a71bdaf567  cni-957e0aa3-6441-c64d-8c83-642c7f2aea4e  cni-c3762efe-a5a9-1027-8ffb-6d6834c13b8a  cni-f7afd684-22fb-7878-280b-04b1554966de
cni-32f45368-c18b-9934-04ac-99b348d5e559  cni-6ae4eeb9-1d08-d67c-1a86-174184df1106  cni-95b42357-476e-e908-8b16-882acd72d89a  cni-c3c14c3e-0039-f66e-5fe3-254b05eb6f63  cni-f7b92c1e-9a38-03b9-2ef1-603264af145e
cni-32f4678e-c0de-1fe0-52d9-17e7cd9f4e09  cni-6b27386b-5d74-86f7-73f6-32ebc5154525  cni-95f9fe3d-0b8a-5e2f-34c4-035c2609ea26  cni-c41aa66d-249b-f5e9-7634-8e1605d7b12d  cni-f7f41d6b-4fc7-d5d0-2fea-34e7c6cc7b0e
cni-33e96208-c20d-be05-81f5-3f010fb90354  cni-6c70120d-3606-5b0e-5ac3-2aa170fe0ce9  cni-95fb865d-99b0-e38d-a57d-5029266608fd  cni-c517f76e-4698-5c7a-e3f0-c2537ac97ba2  cni-f940d7ab-19cd-16b5-09b5-b3b33ba6fa9d
cni-3406e066-95ed-b849-708b-a87241089d8e  cni-6d034874-755f-bdea-258a-38adc21e87ed  cni-96d6f403-28cc-17b3-ab4e-cd0f9ad68c07  cni-c58112e7-5a8e-54db-7485-c20ce7bb72cc  cni-f9a3576b-4bb3-2bcd-1525-80cd07899d1a
cni-34555f3d-6bbe-e672-0d10-5d86ae03825e  cni-6d0a7473-6b74-9a49-b6ec-cf37e5ee8279  cni-96dd4372-7ede-6915-ee67-551f3eb2e21b  cni-c5f7a280-9bec-0082-e9a8-c96077656eb3  cni-fb1f7979-52d7-8360-6ab4-832434595ad3
cni-34cdb2ef-ad27-2ee3-7c32-c75868e6ed3a  cni-6d22e278-3048-7ebe-2ffb-ba58d16ae431  cni-974e515a-572f-49e3-4e13-fef88e449b00  cni-c6339933-a280-bd1a-3185-b280d226ce5e  cni-fb47c6f7-09ef-7194-633d-0cd4176338d7
cni-3501914e-dab3-9697-7807-35e4d55cf377  cni-6d307a21-28f2-aa90-8c3e-9962a91da364  cni-9815c821-5a4f-7be1-a7f8-3989bfc736ed  cni-c6a993bf-b440-e1e7-f8c6-eb2f1b51bbb7  cni-fb47d594-10b0-fdbb-da1c-2c61df0d2f11
cni-35afd92b-3b99-d235-1e89-28f397a0da4e  cni-6de3ea20-61ec-b844-e4ff-17233dae952b  cni-98518066-8620-7de9-a036-48a4ec16c9fb  cni-c6cd01aa-4bc8-a4b0-59bd-65b6c4804394  cni-fb72883c-2795-32bc-18ad-be923b30871d
cni-3618710c-9e58-3893-8fd3-365b23445aa5  cni-6ec6934a-2363-4a58-332f-7049ecfcc64a  cni-988bb7af-8d9e-34a4-faa3-ffcd0370a3c1  cni-c6df98ce-5793-51e7-3613-5d31a55afd47  cni-fb7aa792-7e93-8254-7b6c-a5928ef599bd
cni-3640c1b0-9ef4-834e-3a53-4cbd2d534b04  cni-6fcdc886-47c2-38fa-e283-a59edc8e23f2  cni-98b25282-6d05-9d83-2905-6c3d1dc9d571  cni-c6eadf39-94c3-0d1a-213b-51317d5a2706  cni-fbeb1d86-08f6-782e-bb0a-97feb8af03ba
cni-37c99886-528c-a0fb-356d-58643e01c9ad  cni-6ff181ad-d643-5bdc-c41c-394b21c4ddb1  cni-992423fa-bee6-9cb0-2bce-e7bd38454b28  cni-c72170e8-c63b-a68d-74dc-e1dfcb9d03c9  cni-fc25e705-5149-f77d-1913-686040afdb4c
cni-38461bb1-c459-7b28-2ad7-e16de138a07e  cni-705562c1-0ffc-e565-36a7-bffd70a74088  cni-9947fde7-9a92-4858-32ee-e02e42fa19ef  cni-c80fcea2-a43c-3b0f-995c-05741dd7e9be  cni-fcd3ff57-27a9-7884-2104-ec96b959da11
cni-3938042c-0735-3754-e882-9174d2166c88  cni-70adb38f-f24a-8926-fb49-7508730ce697  cni-99efd9f7-04ef-a65b-4133-d6610f572511  cni-c86f31a0-bf72-91bd-0801-cba04d22d456  cni-fcfd0130-6f13-903b-55ab-8793857c408f
cni-3939c0d4-8cb0-0b57-8aaf-fcc5e66e95cc  cni-70ca72a6-ed17-bd01-5b7c-7981f4035c0c  cni-9a002cd0-5288-2035-73d0-7111b0b15e90  cni-c8780bfe-112f-b90d-fb1a-d20b1d47c0e9  cni-fd00e93c-452f-4bcd-d80c-f80c7d9bf300
cni-39747ee5-96dc-1bba-4a83-dfd8b2bcfe8a  cni-70df8525-4c38-98e0-9649-6d232b93a0f1  cni-9a6c5161-77a9-884d-d534-8bcaf75ffbfb  cni-c917d19d-06a3-5195-6149-7ecaade0f83f  cni-fe4e451f-653f-4b0f-e1c7-2344e516aff2
cni-39c4d1a9-5650-e663-cbdb-c5b0fef79cc5  cni-71994e9a-c61c-4209-fe38-26a78db8578e  cni-9a81708e-3686-8d88-09ca-b17993d07bb2  cni-ca1e7466-e53e-80f3-f674-d4d2c3d14bf8  cni-fe755cc1-3d5e-68fa-00f8-082f8c13ff6d
cni-3b411a9d-7fb8-269c-caa7-87acb4176612  cni-71ad8789-cd64-fc9a-4cf0-ff21ea1b4b27  cni-9b88b5ab-0fa6-1b1d-0bca-ea6a7ac94350  cni-ca314bfb-90df-ada0-d660-c4b2794d44fc  cni-fe86d075-0a36-6cb8-e050-4f68cfb9fec0
cni-3d282e4f-ad15-f980-1ed1-5da7fa1f58fa  cni-71b6b598-bf3e-03fa-2324-32f22f1ed565  cni-9b942542-463e-2e80-5fe2-00a1032ba666  cni-ca8c9397-396a-2f15-7a69-a10a30995bfb  cni-ff168288-ca5c-c795-c641-334cd4260f88
cni-3d2f54e4-0a39-787b-f47f-4b1792f3f1cd  cni-71c152d8-e68b-6874-c029-675dabf5953c  cni-9b9848d3-49d1-aba9-bf54-8c0bde2a8280  cni-cb11fdd9-2af7-8f8b-b46a-ff3452d453b4  cni-ff3a966c-51dd-6c4b-ea82-b56247279fe8
cni-3df1133e-3a3e-6217-7eec-fb946c3fffad  cni-71eafbe8-d234-caa6-2de2-32e287d16297  cni-9c59435f-b93e-71d7-7088-60fc89f9380f  cni-cb69085d-5211-b3c2-f66f-3f9ffbbe6abc  cni-ff70827c-a42b-ae54-06d4-fbb32713dbb2
cni-3df834f8-57e4-d3b8-ec37-2bab937a16d1  cni-721e32db-422f-f8b2-858f-4a286d335977  cni-9c664b4d-7986-1170-bdb1-2f2dee26c769  cni-cb9c09db-0e9d-f077-1834-558d3a315101  cni-ff79e421-9e98-462a-34a5-b1f69d7fba8d
cni-3e92a849-faae-7fec-fb04-1697bd2fe96a  cni-72a328f0-e248-a65a-cf0e-027f3c2915ca  cni-9c70ea51-d4a5-4208-7179-f9d873ed819c  cni-cc06c0cf-ecf8-d969-d56e-5fbe24457a89  cni-ffdf994b-dbb7-8fee-ff78-5870bfc79f22
cni-3ea4b51c-c2c1-3a26-133e-25e3da761ac8  cni-72d3fbe0-49cf-c81d-9d62-efcf1b88b78a  cni-9cb066a2-8779-9536-a5da-f7c30397bb34  cni-ccb3e730-3001-f4cd-775a-d142a91896fc  cni-ffe88d75-16f5-6110-e17f-18e71e988e7f
cni-3ef8822b-adb3-0444-9feb-7cf45a21e246  cni-732a9da1-348e-4766-7ed8-468879eaf24d  cni-9cd7b86b-ed30-d924-a8c4-51d44ff32277  cni-cce42cb5-4302-d8d8-b91b-beda577bd164



Version-Release number of selected component (if applicable):
openshift v3.7.0-0.184.0
kubernetes v1.7.6+a08f5eeb62
etcd 3.2.8


How reproducible:
Sometime

Steps to Reproduce:
1. In openshift 3.7 + cri-o env, create some pods.
2.
3.

Actual results:


Expected results:


Additional info:
similar like: https://github.com/kubernetes-incubator/cri-o/issues/273

Comment 1 DeShuai Ma 2017-10-31 10:03:43 UTC

Created attachment 1345823 [details]
atomic-openshift-node.log

Comment 4 Antonio Murdaca 2017-10-31 14:47:26 UTC

is cri-o rpm or the system container?

Comment 6 DeShuai Ma 2017-10-31 15:24:28 UTC

(In reply to Antonio Murdaca from comment #4)
> is cri-o rpm or the system container?

It's system container

Comment 7 Antonio Murdaca 2017-10-31 15:28:27 UTC

alright, so you need the new system container being built now for 1.0.2 which conatains https://github.com/projectatomic/atomic-system-containers/pull/136 and a CRI-O leak fix as well.

Comment 8 DeShuai Ma 2017-10-31 15:38:08 UTC

Will test the 1.0.2 when image is ready in private registry.

Comment 9 Mrunal Patel 2017-11-03 17:21:22 UTC

1.0.2 has been released so this could be tested again.

Comment 11 DeShuai Ma 2018-01-04 08:54:05 UTC

Verify on ocp-3.9 & crio version 1.8.2
openshift v3.9.0-0.16.0
kubernetes v1.9.0-beta1
etcd 3.2.8


[root@ip-172-18-10-184 cri-o.0]# cd /run/netns
[root@ip-172-18-10-184 netns]# ls
cni-1e5dc1fc-f2cf-e492-abaf-4b20d5ca020b  k8s_apiserver-w79z4_openshift-template-service-broker_0a06c306-f126-11e7-83ce-0e6b06fc777c_0-b96dae67
cni-340152ce-3b06-c561-10a2-87eeaf76180d  k8s_asb-1-deploy_openshift-ansible-service-broker_f7795d66-f125-11e7-83ce-0e6b06fc777c_0-3596aaa9
cni-5fababf1-fbbb-3f70-819c-163836ebd333  k8s_asb-etcd-1-deploy_openshift-ansible-service-broker_fa4f64d3-f125-11e7-83ce-0e6b06fc777c_0-356d56a9
cni-90c1e23c-9a2f-e6a1-e795-ee356c50bbd2  k8s_docker-registry-2-gt8bk_default_7f169c7e-f128-11e7-8243-0e6b06fc777c_0-90400134
cni-ba63aaad-e9bf-c0bf-0b25-b7aa7e178324  k8s_mongodb-1-deploy_install-test_50368d96-f126-11e7-83ce-0e6b06fc777c_0-f882d6bd
cni-e49ad143-2d09-1caa-3826-467f9aaf1dce  k8s_nodejs-mongodb-example-1-build_install-test_4f9c3508-f126-11e7-83ce-0e6b06fc777c_0-d7d4f9af
cni-fb57266a-73d8-a89b-e693-6960290e79f0  k8s_registry-console-2-jlgtd_default_7f1729a1-f128-11e7-8243-0e6b06fc777c_0-8b5d7d68

Comment 14 errata-xmlrpc 2018-03-28 14:08:55 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2018:0489

Note You need to log in before you can comment on or make changes to this bug.