Bug 2176870

Summary:	Custom repo sync failed " Cannot open /var/lib/pulp/tmp/89726@satellite.example.com/tmpzmdau7qg/tmpy_kkhu3a: Cannot detect compression type"
Product:	Red Hat Satellite	Reporter:	Ajay Laxman Chavan <ajchavan>
Component:	Pulp	Assignee:	satellite6-bugs <satellite6-bugs>
Status:	CLOSED ERRATA	QA Contact:	visawant
Severity:	high	Docs Contact:
Priority:	high
Version:	6.11.4	CC:	dalley, dkliban, ggainey, hyu, ipanova, jbhatia, osousa, pcreech, rchan, saydas, shwsingh, visawant
Target Milestone:	6.14.0	Keywords:	Reopened, Triaged
Target Release:	Unused
Hardware:	x86_64
OS:	Linux
Whiteboard:
Fixed In Version:	pulpcore-3.16.17.pulpcore-3.18.17,pulpcore-3.21.7	Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:
Clones:	2218979 (view as bug list)		Environment:
Last Closed:	2023-11-08 14:18:58 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Ajay Laxman Chavan 2023-03-09 14:24:03 UTC

Description of problem:

Custom repository sync fails "Cannot detect compression type"

How reproducible: Always

Steps to Reproduce:
1. create custom repository using the following Upstream URL https://packages.graylog2.org/el/stable/2.2/x86_64 
2. try to sync


Actual results:

Cannot open /var/lib/pulp/tmp/89726.com/tmpzmdau7qg/tmpy_kkhu3a: Cannot detect compression type

Expected results:

on satellite custom repository sync should be completed successfully.

Comment 1 Sayan Das 2023-03-09 14:44:16 UTC

I think the URL is https://packages.graylog2.org/el/stable/2.2/x86_64 


And, Traceback:

Mar  9 20:02:49 satellite611 pulpcore-worker-2[273632]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]: pulpcore.tasking.pulpcore_worker:INFO: Starting task e57aa951-c8cb-4758-b9ca-d233151162df
Mar  9 20:02:49 satellite611 pulpcore-worker-2[273632]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]: pulp_rpm.app.tasks.synchronizing:INFO: Synchronizing: repository=test-101926 remote=test-101106
Mar  9 20:02:49 satellite611 pulpcore-api[257862]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:49 +0000] "GET /pulp/api/v3/tasks/e57aa951-c8cb-4758-b9ca-d233151162df/ HTTP/1.1" 200 666 "-" "OpenAPI-Generator/3.16.7/ruby"
Mar  9 20:02:50 satellite611 pulpcore-api[257864]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:50 +0000] "GET /pulp/api/v3/tasks/e57aa951-c8cb-4758-b9ca-d233151162df/ HTTP/1.1" 200 666 "-" "OpenAPI-Generator/3.16.7/ruby"
Mar  9 20:02:50 satellite611 pulpcore-api[257862]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:50 +0000] "GET /pulp/api/v3/tasks/e57aa951-c8cb-4758-b9ca-d233151162df/ HTTP/1.1" 200 666 "-" "OpenAPI-Generator/3.16.7/ruby"
Mar  9 20:02:51 satellite611 pulpcore-api[257862]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:51 +0000] "GET /pulp/api/v3/tasks/e57aa951-c8cb-4758-b9ca-d233151162df/ HTTP/1.1" 200 666 "-" "OpenAPI-Generator/3.16.7/ruby"
Mar  9 20:02:51 satellite611 pulpcore-worker-2[273632]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]: pulpcore.tasking.pulpcore_worker:INFO: Task e57aa951-c8cb-4758-b9ca-d233151162df failed (Cannot open /var/lib/pulp/tmp/257879.com/tmpc5p2j5h6/tmpwrjkazt4: Cannot detect compression type)
Mar  9 20:02:51 satellite611 pulpcore-worker-2[273632]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]: pulpcore.tasking.pulpcore_worker:INFO:   File "/usr/lib/python3.8/site-packages/pulpcore/tasking/pulpcore_worker.py", line 380, in _perform_task
Mar  9 20:02:51 satellite611 pulpcore-worker-2[273632]:    result = func(*args, **kwargs)
Mar  9 20:02:51 satellite611 pulpcore-worker-2[273632]:  File "/usr/lib/python3.8/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 474, in synchronize
Mar  9 20:02:51 satellite611 pulpcore-worker-2[273632]:    sync_details = get_sync_details(
Mar  9 20:02:51 satellite611 pulpcore-worker-2[273632]:  File "/usr/lib/python3.8/site-packages/pulp_rpm/app/tasks/synchronizing.py", line 449, in get_sync_details
Mar  9 20:02:51 satellite611 pulpcore-worker-2[273632]:    repomd = cr.Repomd(repomd_path)
Mar  9 20:02:51 satellite611 pulpcore-worker-2[273632]:  File "/usr/lib64/python3.8/site-packages/createrepo_c/__init__.py", line 159, in __init__
Mar  9 20:02:51 satellite611 pulpcore-worker-2[273632]:    xml_parse_repomd(path, self, warningcb=_warningcb)
Mar  9 20:02:51 satellite611 pulpcore-worker-2[273632]:  File "/usr/lib64/python3.8/site-packages/createrepo_c/__init__.py", line 355, in xml_parse_repomd
Mar  9 20:02:51 satellite611 pulpcore-worker-2[273632]:    return _createrepo_c.xml_parse_repomd(path, repomdobj, warningcb)
Mar  9 20:02:51 satellite611 pulpcore-api[257862]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:51 +0000] "GET /pulp/api/v3/tasks/e57aa951-c8cb-4758-b9ca-d233151162df/ HTTP/1.1" 200 1613 "-" "OpenAPI-Generator/3.16.7/ruby"
Mar  9 20:02:52 satellite611 pulpcore-api[257862]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:52 +0000] "GET /pulp/api/v3/distributions/rpm/rpm/?base_path=RedHat%2FLibrary%2Fcustom%2Fgraylog%2Ftest HTTP/1.1" 200 507 "-" "OpenAPI-Generator/3.17.4/ruby"
Mar  9 20:02:52 satellite611 pulpcore-api[257862]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:52 +0000] "GET /pulp/api/v3/publications/rpm/rpm/98e41280-2088-4a11-bba0-fd35cb0e6639/ HTTP/1.1" 200 447 "-" "OpenAPI-Generator/3.17.4/ruby"
Mar  9 20:02:52 satellite611 pulpcore-api[257862]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:52 +0000] "PATCH /pulp/api/v3/distributions/rpm/rpm/ddaa0eb8-4ac1-449e-9fbf-0e7d2460d584/ HTTP/1.1" 202 67 "-" "OpenAPI-Generator/3.17.4/ruby"
Mar  9 20:02:52 satellite611 pulpcore-worker-1[273645]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]: pulpcore.tasking.pulpcore_worker:INFO: Starting task 7eebf94c-22c4-42ef-9e29-42ff6e2361a7
Mar  9 20:02:52 satellite611 pulpcore-api[257864]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:52 +0000] "GET /pulp/api/v3/tasks/7eebf94c-22c4-42ef-9e29-42ff6e2361a7/ HTTP/1.1" 200 535 "-" "OpenAPI-Generator/3.16.7/ruby"
Mar  9 20:02:52 satellite611 pulpcore-worker-1[273645]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]: pulpcore.tasking.pulpcore_worker:INFO: Task completed 7eebf94c-22c4-42ef-9e29-42ff6e2361a7
Mar  9 20:02:52 satellite611 pulpcore-api[257864]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:52 +0000] "GET /pulp/api/v3/tasks/7eebf94c-22c4-42ef-9e29-42ff6e2361a7/ HTTP/1.1" 200 562 "-" "OpenAPI-Generator/3.16.7/ruby"
Mar  9 20:02:52 satellite611 pulpcore-api[257864]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:52 +0000] "GET /pulp/api/v3/publications/rpm/rpm/98e41280-2088-4a11-bba0-fd35cb0e6639/ HTTP/1.1" 200 447 "-" "OpenAPI-Generator/3.17.4/ruby"
Mar  9 20:02:53 satellite611 pulpcore-api[257864]: pulp [1feff242-0687-4d91-937a-3523d3ebe0ce]:  - - [09/Mar/2023:14:32:53 +0000] "PATCH /pulp/api/v3/distributions/rpm/rpm/ddaa0eb8-4ac1-449e-9fbf-0e7d2460d584/ HTTP/1.1" 202 67 "-" "OpenAPI-Generator/3.17.4/ruby"

Comment 10 Daniel Alley 2023-03-21 19:57:12 UTC

I'm going to close this as a duplicate of https://bugzilla.redhat.com/show_bug.cgi?id=2135215

The issue is that this webserver is responding to nonexistent URLs with an HTTP 200 response code and an HTML error page.  Pulp therefore thinks the file it received was legitimate because it has no way to know otherwise.

The behavior of URLs rooted at https://packages.graylog2.org/repo/el/stable/2.2/x86_64/ meanwhile is different, here the webserver returns correct and meaningful responses (a 404 code on file-not-found).  It seems like this is the correct URL to use.

In terms of a generic solution as this is not the first or only webserver to be misconfigured like this, the solution to the linked BZ was to add an option to avoid downloading the treeinfo, which prevents Pulp from requesting it and being confused when the webserver hands back invalid data.  Otherwise we ought to just let these sites know on a case-by-case basis that the way they have configured their webserver (to lie to clients) causes problems.

*** This bug has been marked as a duplicate of bug 2135215 ***

Comment 11 Daniel Alley 2023-03-21 20:14:07 UTC

To expand on the last part of what I wrote above, that solves one of the common cases (treeinfo), but if a user inputs an incorrect repo URL and the remote webserver is misconfigured such that it returns HTTP 200 always, it will remain very difficult for us to return a helpful error message.

Comment 13 Daniel Alley 2023-03-24 01:42:14 UTC

Reopening. I was able to reproduce in a repo where my explanation does not apply.

Comment 14 Daniel Alley 2023-03-24 02:34:57 UTC

I've filed https://github.com/rpm-software-management/createrepo_c/issues/353 but really this seems to be related to the "file" library detecting the mimetype incorrectly in a way that makes very little sense. If anyone is enlightened about why it might do so let me know.

Comment 15 Robin Chan 2023-04-10 13:06:05 UTC

The Pulp upstream bug status is at closed. Updating the external tracker on this bug.

Comment 16 visawant 2023-07-16 19:06:57 UTC

Failed QA


Version tested:
---------------
# rpm -qa | grep satellite
satellite-6.14.0-3.el8sat.noarch

# # rpm -qa | grep pulpcore
rubygem-pulpcore_client-3.22.4-1.el8sat.noarch
python39-pulpcore-3.22.7-1.el8pc.noarch


Steps performed:
----------------
1. Create custom product name "cp" & repository name "graylog2" from third party URL "https://packages.graylog2.org/el/stable/2.2/x86_64"
2. Sync repository


Actual result:
--------------
Sync Task failed with Error "This repository has a malformed or inaccessible treeinfo file. To sync, try enabling 'Ignore treeinfo'. All kickstart contents will be skipped."


Observation:
------------
Output:
-------
{"pulp_tasks"=>
  [{"pulp_href"=>"/pulp/api/v3/tasks/24d2af46-9a39-40ab-98a4-e20ffb59cf6c/",
    "pulp_created"=>"2023-07-16T18:46:44.680+00:00",
    "state"=>"failed",
    "name"=>"pulp_rpm.app.tasks.synchronizing.synchronize",
    "logging_cid"=>"56e17dbe-b14e-47de-bdb9-081c2673aa43",
    "started_at"=>"2023-07-16T18:46:44.709+00:00",
    "finished_at"=>"2023-07-16T18:47:29.156+00:00",
    "error"=>
     {"traceback"=>
       "  File \"/usr/lib/python3.9/site-packages/pulpcore/tasking/pulpcore_worker.py\", line 444, in _perform_task\n" +
       "    result = func(*args, **kwargs)\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 489, in synchronize\n" +
       "    treeinfo = get_treeinfo_data(remote, remote_url)\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulp_rpm/app/tasks/synchronizing.py\", line 431, in get_treeinfo_data\n" +
       "    treeinfo.load(f=result.path)\n" +
       "  File \"/usr/lib/python3.9/site-packages/pulp_rpm/app/kickstart/treeinfo.py\", line 28, in load\n" +
       "    raise TypeError(_(\"Treeinfo file should have INI format\"))\n",
      "description"=>"Treeinfo file should have INI format"},
    "worker"=>"/pulp/api/v3/workers/10bcdc21-1d33-42f8-8e0a-66a782591b10/",
    "child_tasks"=>[],
    "progress_reports"=>[],
    "created_resources"=>[],
    "reserved_resources_record"=>
     ["/pulp/api/v3/repositories/rpm/rpm/713275eb-3938-4a12-9c3e-c2d57f8bad93/",
      "shared:/pulp/api/v3/remotes/rpm/rpm/5ac1ed7a-7ee0-43e1-83e8-a866069b0c69/"]}],
 "create_version"=>true,
 "task_groups"=>[],
 "poll_attempts"=>{"total"=>21, "failed"=>1}}

Exception:
----------
Katello::Errors::Pulp3Error: This repository has a malformed or inaccessible treeinfo file. To sync, try enabling 'Ignore treeinfo'. All kickstart contents will be skipped.

Backtrace:
----------
/usr/share/gems/gems/katello-4.9.0.3/app/lib/actions/pulp3/abstract_async_task.rb:108:in `block in check_for_errors'
/usr/share/gems/gems/katello-4.9.0.3/app/lib/actions/pulp3/abstract_async_task.rb:106:in `each'
/usr/share/gems/gems/katello-4.9.0.3/app/lib/actions/pulp3/abstract_async_task.rb:106:in `check_for_errors'
/usr/share/gems/gems/katello-4.9.0.3/app/lib/actions/pulp3/abstract_async_task.rb:162:in `poll_external_task'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action/polling.rb:100:in `poll_external_task_with_rescue'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action/polling.rb:22:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action/cancellable.rb:14:in `run'
/usr/share/gems/gems/katello-4.9.0.3/app/lib/actions/pulp3/abstract_async_task.rb:10:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action.rb:588:in `block (3 levels) in execute_run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:32:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/katello-4.9.0.3/app/lib/actions/middleware/remote_action.rb:16:in `block in run'
/usr/share/gems/gems/katello-4.9.0.3/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'
/usr/share/gems/gems/katello-4.9.0.3/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'
/usr/share/gems/gems/katello-4.9.0.3/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'
/usr/share/gems/gems/katello-4.9.0.3/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'
/usr/share/gems/gems/katello-4.9.0.3/app/lib/actions/middleware/remote_action.rb:16:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
/usr/share/gems/gems/activesupport-6.1.7.3/lib/active_support/execution_wrapper.rb:91:in `wrap'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action/progress.rb:17:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/load_setting_values.rb:20:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_request_id.rb:52:in `restore_current_request_id'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezone'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxonomies'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:32:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:27:in `pass'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware.rb:19:in `pass'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_user.rb:54:in `restore_curent_user'
/usr/share/gems/gems/foreman-tasks-8.1.1/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/stack.rb:23:in `call'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/middleware/world.rb:31:in `execute'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action.rb:587:in `block (2 levels) in execute_run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action.rb:586:in `catch'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action.rb:586:in `block in execute_run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action.rb:489:in `block in with_error_handling'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action.rb:489:in `catch'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action.rb:489:in `with_error_handling'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action.rb:581:in `execute_run'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/action.rb:302:in `execute'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execute'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/director.rb:94:in `execute'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/executors.rb:18:in `run_user_code'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'
/usr/share/gems/gems/dynflow-1.7.0/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:196:in `execute_job'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:164:in `block (2 levels) in process'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/middleware/chain.rb:133:in `invoke'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:163:in `block in process'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:136:in `block (6 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_retry.rb:112:in `local'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:135:in `block (5 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq.rb:39:in `block in <module:Sidekiq>'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:131:in `block (4 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:257:in `stats'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:126:in `block (3 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_logger.rb:13:in `call'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:125:in `block (2 levels) in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_retry.rb:79:in `global'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:124:in `block in dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/logger.rb:11:in `with'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/job_logger.rb:33:in `prepare'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:123:in `dispatch'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:162:in `process'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:78:in `process_one'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/processor.rb:68:in `run'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/util.rb:43:in `watchdog'
/usr/share/gems/gems/sidekiq-6.3.1/lib/sidekiq/util.rb:52:in `block in safe_thread'
/usr/share/gems/gems/logging-2.3.1/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'


Additional information:
-----------------------
As per info from the error log, when the field "Ignore treeinfo" changed to "Yes" from Sync Settings of repository (that can be seen in attached screenshot) and sync repository again, unfortunately task failed with the error "Parse error '/var/lib/pulp/tmp/9209.com/tmp64tw_fdj/tmpt1twci8w-repomd.xml' at line: 27 (Opening and ending tag mismatch: link line 0 and head)"

Comment 18 Robin Chan 2023-07-16 20:05:10 UTC

Requesting needsinfo from upstream developer dkliban, ggainey because the 'FailedQA' flag is set.

Comment 19 Daniel Alley 2023-07-16 20:07:25 UTC

Please use one of the URLs from this comment https://bugzilla.redhat.com/show_bug.cgi?id=2176870#c12

This particular error is completely unrelated to the BZ and has to do with the webserver configuration they're using, there's not much we can do about it.

Comment 21 visawant 2023-07-17 14:41:22 UTC

Verified

Version tested:
---------------
Satellite 6.14.0 Snap 7

# rpm -qa | grep satellite
satellite-6.14.0-3.el8sat.noarch

# # rpm -qa | grep pulpcore
rubygem-pulpcore_client-3.22.4-1.el8sat.noarch
python39-pulpcore-3.22.7-1.el8pc.noarch


Steps performed:
----------------
1. Create custom product
2. Create yum repository from any below third party URLs
 https://download.copr.fedorainfracloud.org/results/ndhai/ibus-bamboo/fedora-36-x86_64/
 https://download.copr.fedorainfracloud.org/results/audron/dexed/fedora-36-aarch64/
 https://download.copr.fedorainfracloud.org/results/audron/dexed/fedora-37-aarch64/    
 https://download.copr.fedorainfracloud.org/results/audron/dexed/fedora-38-aarch64/
 https://download.copr.fedorainfracloud.org/results/audron/dexed/fedora-35-aarch64/                           
 https://download.copr.fedorainfracloud.org/results/rolivier/leapp-packit-poc/epel-8-x86_64/
3. Sync repository

Comment 24 errata-xmlrpc 2023-11-08 14:18:58 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: Satellite 6.14 security and bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2023:6818

Comment 25 Red Hat Bugzilla 2024-03-08 04:25:31 UTC

The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days