Bug 1335833
| Summary: | Specific puppet module fails to upload on 6.2 beta (works on 6.1.8) | ||||||
|---|---|---|---|---|---|---|---|
| Product: | Red Hat Satellite | Reporter: | Julio Entrena Perez <jentrena> | ||||
| Component: | Configuration Management | Assignee: | David Davis <daviddavis> | ||||
| Status: | CLOSED ERRATA | QA Contact: | Jitendra Yejare <jyejare> | ||||
| Severity: | high | Docs Contact: | |||||
| Priority: | high | ||||||
| Version: | 6.2.0 | CC: | bbuckingham, bkearney, bmbouter, cwelton, daviddavis, dkliban, dlezzoum, ehelms, ggainey, ipanova, jyejare, mhrivnak, mmccune, pcreech, rchan, ttereshc | ||||
| Target Milestone: | Unspecified | Keywords: | Regression, Triaged | ||||
| Target Release: | Unused | ||||||
| Hardware: | All | ||||||
| OS: | Linux | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | pulp-puppet-2.8.3.2-1 | Doc Type: | Bug Fix | ||||
| Doc Text: | Story Points: | --- | |||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2016-07-27 11:35:42 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Bug Depends On: | |||||||
| Bug Blocks: | 1115190 | ||||||
| Attachments: |
|
||||||
The Pulp upstream bug status is at ASSIGNED. Updating the external tracker on this bug. The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug. The Pulp upstream bug priority is at Urgent. Updating the external tracker on this bug. The Pulp upstream bug status is at POST. Updating the external tracker on this bug. This seems to be a valid bug that needs to be addressed. The puppet module shows up in the UI for 6.1 (which seems to indicate the puppet module is in fact uploaded successfully) but it does not show up in 6.2. I think I found the problem. In pulp 2.8.x, we are using the puppet module's name which could contain a "/". See here: https://git.io/vrAk2 Before 2.8, we called module.filename: https://git.io/vrAkN Here's the filename method: https://git.io/vrAIR The name of the module was setup in from_json which called this bit of code: https://git.io/vrAIV Will open a pulp bug. Did not see the upstream bug. Ignore my comments. :) The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug. The Pulp upstream bug status is at ON_QA. Updating the external tracker on this bug. The Pulp upstream bug status is at VERIFIED. Updating the external tracker on this bug. The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug. Verified !
@ Sat 6.2 Snap 18.1
The attached puppet repo is been successfully uploaded.
Logs:
==> /var/log/messages <==
Jul 1 03:29:55 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[fc9df80d-4935-405d-89d4-9b8337db885b]
Jul 1 03:29:55 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.content.upload.import_uploaded_unit[fb992e16-8181-4193-8b07-f8d515e45dea]
Jul 1 03:29:55 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[55080ba5-52b8-4651-8faf-5dd6759a83b5]
Jul 1 03:29:55 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[fc9df80d-4935-405d-89d4-9b8337db885b] succeeded in 0.0351566019963s: None
Jul 1 03:29:55 qeblade36 pulp: py.warnings:WARNING: (15349-37056) /usr/lib/python2.7/site-packages/mongoengine/document.py:324: DeprecationWarning: save is deprecated. Use insert_one or replace_one instead
Jul 1 03:29:55 qeblade36 pulp: py.warnings:WARNING: (15349-37056) object_id = collection.save(doc, **write_concern)
Jul 1 03:29:55 qeblade36 pulp: py.warnings:WARNING: (15349-37056)
Jul 1 03:29:55 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.managers.content.upload.import_uploaded_unit[fb992e16-8181-4193-8b07-f8d515e45dea] succeeded in 0.0721736900014s: {'details': {}, 'success_flag': True, 'summary': ''}
Jul 1 03:29:55 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[55080ba5-52b8-4651-8faf-5dd6759a83b5] succeeded in 0.00543597500655s: None
Jul 1 03:29:56 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[f1a50390-b357-4b17-ad61-07cdd0980ff0]
Jul 1 03:29:57 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.publish.publish[7f933e04-c64d-49d8-abf4-c631574eb442]
Jul 1 03:29:57 qeblade36 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[7019a0f9-b794-405e-8149-abba968e8820]
Jul 1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Beginning publish for repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul 1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Initializing build directory for repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul 1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Creating symlinks for modules in repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul 1 03:29:57 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[f1a50390-b357-4b17-ad61-07cdd0980ff0] succeeded in 0.0357442670065s: None
Jul 1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Generating metadata for repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul 1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Making newly built repository live for repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul 1 03:29:57 qeblade36 pulp: pulp_puppet.plugins.distributors.publish:INFO: Cleaning up build directory for repository <Default_Organization-puppet_issue-issue_puppet_repo>
Jul 1 03:29:57 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.managers.repo.publish.publish[7f933e04-c64d-49d8-abf4-c631574eb442] succeeded in 0.124149923009s: {'exception': None, 'repo_id': u'Default_Organization-puppet_issue-issue_puppet_repo', 'traceback': None, 'started':...
Jul 1 03:29:57 qeblade36 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[7019a0f9-b794-405e-8149-abba968e8820] succeeded in 0.00743373400474s: None
Also, I am able to publish and promote the puppet module.
So moving this to Verified !
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2016:1501 qe_test_coverage PR: https://github.com/SatelliteQE/robottelo/pull/5336 |
Created attachment 1157067 [details] puppet module that fails to upload to 6.2 beta Description of problem: A specific puppet module fails to upload. Version-Release number of selected component (if applicable): How reproducible: Always Steps to Reproduce: 1. Try to upload puppet module "jfryman-selinux-0.3.1.tar" (attached to this BZ) to a puppet repo. 2. 3. Actual results: Upload is reported as successful but module is not present in the puppet repo it has been uploaded to. May 13 09:46:12 example pulp: kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism ANONYMOUS May 13 09:46:13 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[649fdfd2-59de-47e2-a0d9-7d91c2be6f33] May 13 09:46:13 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.content.upload.import_uploaded_unit[f7c129f6-569a-45e4-99ee-6dfb61d87362] May 13 09:46:13 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[39aa41ad-10d4-4659-bb40-0e2e610a834d] May 13 09:46:13 example pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[649fdfd2-59de-47e2-a0d9-7d91c2be6f33] succeeded in 0.088215906173s: None May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) [Errno 2] No such file or directory: u'/var/lib/pulp/uploads/jfryman/selinux-0.3.1.tar.gz' May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) Traceback (most recent call last): May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) File "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/importer.py", line 82, in upload_unit May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) conduit) May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) File "/usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/upload.py", line 43, in handle_uploaded_unit May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) shutil.move(file_path, new_file_path) May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) File "/usr/lib64/python2.7/shutil.py", line 301, in move May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) copy2(src, real_dst) May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) File "/usr/lib64/python2.7/shutil.py", line 130, in copy2 May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) copyfile(src, dst) May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) File "/usr/lib64/python2.7/shutil.py", line 83, in copyfile May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) with open(dst, 'wb') as fdst: May 13 09:46:13 example pulp: pulp_puppet.plugins.importers.importer:ERROR: (28385-46912) IOError: [Errno 2] No such file or directory: u'/var/lib/pulp/uploads/jfryman/selinux-0.3.1.tar.gz' May 13 09:46:13 example pulp: py.warnings:WARNING: (28385-46912) /usr/lib/python2.7/site-packages/pulp_puppet/plugins/importers/importer.py:85: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6 May 13 09:46:13 example pulp: py.warnings:WARNING: (28385-46912) report = {'success_flag': False, 'summary': e.message, 'details': {}} May 13 09:46:13 example pulp: py.warnings:WARNING: (28385-46912) May 13 09:46:13 example pulp: celery.worker.job:INFO: Task pulp.server.managers.content.upload.import_uploaded_unit[f7c129f6-569a-45e4-99ee-6dfb61d87362] succeeded in 0.313630488003s: {'details': {}, 'success_flag': False, 'summary': ''} May 13 09:46:13 example pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[39aa41ad-10d4-4659-bb40-0e2e610a834d] succeeded in 0.0388202879112s: None May 13 09:46:14 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[cbf3476b-44d5-4f84-a3fe-1083f1dd3d0d] May 13 09:46:14 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.publish.publish[10436e7a-7742-42b0-9217-8c5e1daf10aa] May 13 09:46:14 example pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[4931f09a-95da-4fd6-b12b-3d5ded2d5941] May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Beginning publish for repository <Default_Organization-test_product-test_puppet_repo> May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Initializing build directory for repository <Default_Organization-test_product-test_puppet_repo> May 13 09:46:14 example pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[cbf3476b-44d5-4f84-a3fe-1083f1dd3d0d] succeeded in 0.121072845999s: None May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Creating symlinks for modules in repository <Default_Organization-test_product-test_puppet_repo> May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Generating metadata for repository <Default_Organization-test_product-test_puppet_repo> May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Making newly built repository live for repository <Default_Organization-test_product-test_puppet_repo> May 13 09:46:14 example pulp: pulp_puppet.plugins.distributors.publish:INFO: Cleaning up build directory for repository <Default_Organization-test_product-test_puppet_repo> May 13 09:46:14 example pulp: celery.worker.job:INFO: Task pulp.server.managers.repo.publish.publish[10436e7a-7742-42b0-9217-8c5e1daf10aa] succeeded in 0.25458475505s: {'exception': None, 'repo_id': u'Default_Organization-test_product-test_puppet_repo', 'traceback': None, 'started':... May 13 09:46:14 example pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[4931f09a-95da-4fd6-b12b-3d5ded2d5941] succeeded in 0.0117288241163s: None Expected results: Module uploads successfully and is present in the puppet repo it has been uploaded to. Additional info: This works fine on 6.1.8 but fails on 6.2 beta. It still fails despite "puppetlabs/stdlib" dependency being present in the puppet repo.