Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1335833 - Specific puppet module fails to upload on 6.2 beta (works on 6.1.8)
Summary: Specific puppet module fails to upload on 6.2 beta (works on 6.1.8)
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Configuration Management
Version: 6.2.0
Hardware: All
OS: Linux
high
high
Target Milestone: Unspecified
Assignee: David Davis
QA Contact: Jitendra Yejare
URL:
Whiteboard:
Depends On:
Blocks: GSS_Sat6Beta_Tracker, GSS_Sat6_Tracker
TreeView+ depends on / blocked
 
Reported: 2016-05-13 10:35 UTC by Julio Entrena Perez
Modified: 2021-04-06 17:57 UTC (History)
16 users (show)

Fixed In Version: pulp-puppet-2.8.3.2-1
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2016-07-27 11:35:42 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)
puppet module that fails to upload to 6.2 beta (16.13 KB, application/x-gzip)
2016-05-13 10:35 UTC, Julio Entrena Perez 		no flags Details
View All


Links
System ID Private Priority Status Summary Last Updated
Pulp Redmine 1950 0 Urgent CLOSED - CURRENTRELEASE module upload fails with IOError: [Errno 2] No such file or directory 2016-06-27 17:00:28 UTC

Description Julio Entrena Perez 2016-05-13 10:35:02 UTC 
Created attachment 1157067 [details]
puppet module that fails to upload to 6.2 beta

Description of problem:
A specific puppet module fails to upload.

Version-Release number of selected component (if applicable):


How reproducible:
Always

Steps to Reproduce:
1. Try to upload puppet module "jfryman-selinux-0.3.1.tar" (attached to this BZ) to a puppet repo.
2.
3.

Actual results:
Upload is reported as successful but module is not present in the puppet repo it has been uploaded to.

May 13 09:46:12 example pulp: kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism ANONYMOUS
May 13 09:46:13 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[649fdfd2-59de-47e2-a0d9-7d91c2be6f33]
May 13 09:46:13 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.content.upload.import_uploaded_unit[f7c129f6-569a-45e4-99ee-6dfb61d87362]
May 13 09:46:13 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[39aa41ad-10d4-4659-bb40-0e2e610a834d]
May 13 09:46:13 example pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[649fdfd2-59de-47e2-a0d9-7d91c2be6f33] succeeded in 0.088215906173s: None
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) [Errno 2] No such file or directory: u'/var/lib/pulp/uploads/jfryman/selinux-0.3.1.tar.gz'
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) Traceback (most recent call last):
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912)   File "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/importer.py", line 82, in upload_unit
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912)     conduit)
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912)   File "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/upload.py", line 43, in handle_uploaded_unit
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912)     shutil.move(file_path, new_file_path)
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912)   File "/usr/lib64/python2.7/shutil.py", line 301, in move
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912)     copy2(src, real_dst)
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912)   File "/usr/lib64/python2.7/shutil.py", line 130, in copy2
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912)     copyfile(src, dst)
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912)   File "/usr/lib64/python2.7/shutil.py", line 83, in copyfile
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912)     with open(dst, 'wb') as fdst:
May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) IOError: [Errno 2] No such file or directory: u'/var/lib/pulp/uploads/jfryman/selinux-0.3.1.tar.gz'
May 13 09:46:13 example pulp: py.warnings:WARNING: (28385-46912) /usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/importer.py:85: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6
May 13 09:46:13 example pulp: py.warnings:WARNING: (28385-46912)   report = {'success_flag': False, 'summary': e.message, 'details': {}}
May 13 09:46:13 example pulp: py.warnings:WARNING: (28385-46912)
May 13 09:46:13 example pulp: celery.worker.job:INFO: Task pulp.server.managers.content.upload.import_uploaded_unit[f7c129f6-569a-45e4-99ee-6dfb61d87362] succeeded in 0.313630488003s: {'details': {}, 'success_flag': False, 'summary': ''}
May 13 09:46:13 example pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[39aa41ad-10d4-4659-bb40-0e2e610a834d] succeeded in 0.0388202879112s: None
May 13 09:46:14 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[cbf3476b-44d5-4f84-a3fe-1083f1dd3d0d]
May 13 09:46:14 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.publish.publish[10436e7a-7742-42b0-9217-8c5e1daf10aa]
May 13 09:46:14 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[4931f09a-95da-4fd6-b12b-3d5ded2d5941]
May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Beginning publish for repository <Default_Organization-test_product-test_puppet_repo>
May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Initializing build directory for repository <Default_Organization-test_product-test_puppet_repo>
May 13 09:46:14 example pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[cbf3476b-44d5-4f84-a3fe-1083f1dd3d0d] succeeded in 0.121072845999s: None
May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Creating symlinks for modules in repository <Default_Organization-test_product-test_puppet_repo>
May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Generating metadata for repository <Default_Organization-test_product-test_puppet_repo>
May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Making newly built repository live for repository <Default_Organization-test_product-test_puppet_repo>
May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Cleaning up build directory for repository <Default_Organization-test_product-test_puppet_repo>
May 13 09:46:14 example pulp: celery.worker.job:INFO: Task pulp.server.managers.repo.publish.publish[10436e7a-7742-42b0-9217-8c5e1daf10aa] succeeded in 0.25458475505s: {'exception': None, 'repo_id': u'Default_Organization-test_product-test_puppet_repo', 'traceback': None, 'started':...
May 13 09:46:14 example pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[4931f09a-95da-4fd6-b12b-3d5ded2d5941] succeeded in 0.0117288241163s: None


Expected results:
Module uploads successfully and is present in the puppet repo it has been uploaded to.

Additional info:
This works fine on 6.1.8 but fails on 6.2 beta.
It still fails despite "puppetlabs/stdlib" dependency being present in the puppet repo.
Comment 4 pulp-infra@redhat.com 2016-05-27 14:00:20 UTC 
The Pulp upstream bug status is at ASSIGNED. Updating the external tracker on this bug.
Comment 5 pulp-infra@redhat.com 2016-05-27 14:00:23 UTC 
The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.
Comment 6 pulp-infra@redhat.com 2016-05-27 15:00:20 UTC 
The Pulp upstream bug priority is at Urgent. Updating the external tracker on this bug.
Comment 7 pulp-infra@redhat.com 2016-05-30 12:00:25 UTC 
The Pulp upstream bug status is at POST. Updating the external tracker on this bug.
Comment 10 David Davis 2016-06-01 17:42:03 UTC 
This seems to be a valid bug that needs to be addressed. The puppet module shows up in the UI for 6.1 (which seems to indicate the puppet module is in fact uploaded successfully) but it does not show up in 6.2.
Comment 12 David Davis 2016-06-01 17:57:25 UTC 
I think I found the problem. In pulp 2.8.x, we are using the puppet module's name which could contain a "/". See here:

https://git.io/vrAk2

Before 2.8, we called module.filename:

https://git.io/vrAkN

Here's the filename method:

https://git.io/vrAIR

The name of the module was setup in from_json which called this bit of code:

https://git.io/vrAIV

Will open a pulp bug.
Comment 13 David Davis 2016-06-01 17:59:45 UTC 
Did not see the upstream bug. Ignore my comments. :)
Comment 14 pulp-infra@redhat.com 2016-06-08 09:50:55 UTC 
The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.
Comment 15 pulp-infra@redhat.com 2016-06-17 17:30:25 UTC 
The Pulp upstream bug status is at ON_QA. Updating the external tracker on this bug.
Comment 16 pulp-infra@redhat.com 2016-06-21 18:00:22 UTC 
The Pulp upstream bug status is at VERIFIED. Updating the external tracker on this bug.
Comment 17 pulp-infra@redhat.com 2016-06-27 17:00:29 UTC 
The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.
Comment 18 Jitendra Yejare 2016-07-01 07:38:23 UTC 
Verified !

@ Sat 6.2 Snap 18.1

The attached puppet repo is been successfully uploaded. 


Logs:
==> /var/log/messages <==
Jul  1 03:29:55 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[fc9df80d-4935-405d-89d4-9b8337db885b]
Jul  1 03:29:55 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.content.upload.import_uploaded_unit[fb992e16-8181-4193-8b07-f8d515e45dea]
Jul  1 03:29:55 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[55080ba5-52b8-4651-8faf-5dd6759a83b5]
Jul  1 03:29:55 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[fc9df80d-4935-405d-89d4-9b8337db885b] succeeded in 0.0351566019963s: None
Jul  1 03:29:55 qeblade36 pulp: py.warnings:WARNING: (15349-37056) /usr/lib/python2.7/site-packages/mongoengine/document.py:324: DeprecationWarning: save is deprecated. Use insert_one or replace_one instead
Jul  1 03:29:55 qeblade36 pulp: py.warnings:WARNING: (15349-37056)   object_id = collection.save(doc, **write_concern)
Jul  1 03:29:55 qeblade36 pulp: py.warnings:WARNING: (15349-37056)
Jul  1 03:29:55 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.managers.content.upload.import_uploaded_unit[fb992e16-8181-4193-8b07-f8d515e45dea] succeeded in 0.0721736900014s: {'details': {}, 'success_flag': True, 'summary': ''}
Jul  1 03:29:55 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[55080ba5-52b8-4651-8faf-5dd6759a83b5] succeeded in 0.00543597500655s: None
Jul  1 03:29:56 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[f1a50390-b357-4b17-ad61-07cdd0980ff0]
Jul  1 03:29:57 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.publish.publish[7f933e04-c64d-49d8-abf4-c631574eb442]
Jul  1 03:29:57 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[7019a0f9-b794-405e-8149-abba968e8820]
Jul  1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Beginning publish for repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul  1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Initializing build directory for repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul  1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Creating symlinks for modules in repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul  1 03:29:57 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[f1a50390-b357-4b17-ad61-07cdd0980ff0] succeeded in 0.0357442670065s: None
Jul  1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Generating metadata for repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul  1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Making newly built repository live for repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul  1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Cleaning up build directory for repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul  1 03:29:57 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.managers.repo.publish.publish[7f933e04-c64d-49d8-abf4-c631574eb442] succeeded in 0.124149923009s: {'exception': None, 'repo_id': u'Default_Organization-puppet_issue-issue_puppet_repo', 'traceback': None, 'started':...
Jul  1 03:29:57 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[7019a0f9-b794-405e-8149-abba968e8820] succeeded in 0.00743373400474s: None


Also, I am able to publish and promote the puppet module.

So moving this to Verified !
Comment 19 Bryan Kearney 2016-07-27 11:35:42 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1501
Comment 20 Djebran Lezzoum 2017-10-05 16:24:05 UTC 
qe_test_coverage PR: https://github.com/SatelliteQE/robottelo/pull/5336
Note You need to log in before you can comment on or make changes to this bug.