Bug 2048876

Summary: content-export fails to export content view
Product: Red Hat Satellite Reporter: Gary Scarborough <gscarbor>
Component: Inter Satellite SyncAssignee: satellite6-bugs <satellite6-bugs>
Status: CLOSED DUPLICATE QA Contact: Lai <ltran>
Severity: urgent Docs Contact:
Priority: unspecified    
Version: 6.10.2   
Target Milestone: Unspecified   
Target Release: Unused   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2022-02-03 00:33:47 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Gary Scarborough 2022-02-01 04:10:31 UTC
Description of problem:

In testing ISS for another issue, I find I am unable to export a content view in satellite 6.10.2.  This is a fresh satellite build.  The hammer command fails after a while with an error.

I originally hit this issue on a satellite that had been installed with 6.10.0 and upgraded to 6.10.2.


Version-Release number of selected component (if applicable):

Satellite 6.10.2


How reproducible:

Reproduced on a fresh satellite build.


Steps to Reproduce:
1. Install satellite
2. enable and sync content
3. create content view
4. try to export content view



Actual results:

Export fails


Expected results:

export should succeed.



Additional info:

Log entries below.

Comment 1 Gary Scarborough 2022-02-01 04:10:57 UTC
messages log:

an 31 22:55:07 testsat pulpcore-worker-1: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]: pulpcore.tasking.pulpcore_worker:INFO: Task 89d96438-1757-4838-b428-b7acc69e4150 failed ()
Jan 31 22:55:07 testsat pulpcore-worker-1: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]: pulpcore.tasking.pulpcore_worker:INFO:   File "/usr/lib/python3.6/site-packages/pulpcore/tasking/pulpcore_worker.py", line 317, in _perform_task
Jan 31 22:55:07 testsat pulpcore-worker-1: result = func(*args, **kwargs)
Jan 31 22:55:07 testsat pulpcore-worker-1: File "/usr/lib/python3.6/site-packages/pulpcore/app/tasks/export.py", line 223, in pulp_export
Jan 31 22:55:07 testsat pulpcore-worker-1: _do_export(pulp_exporter, tar, the_export)
Jan 31 22:55:07 testsat pulpcore-worker-1: File "/usr/lib/python3.6/site-packages/pulpcore/app/tasks/export.py", line 313, in _do_export
Jan 31 22:55:07 testsat pulpcore-worker-1: export_content(the_export, version)
Jan 31 22:55:07 testsat pulpcore-worker-1: File "/usr/lib/python3.6/site-packages/pulpcore/app/importexport.py", line 134, in export_content
Jan 31 22:55:07 testsat pulpcore-worker-1: _write_export(export.tarfile, resource, dest_dir)
Jan 31 22:55:07 testsat pulpcore-worker-1: File "/usr/lib/python3.6/site-packages/pulpcore/app/importexport.py", line 41, in _write_export
Jan 31 22:55:07 testsat pulpcore-worker-1: data = dataset.json.encode("utf8")
Jan 31 22:55:08 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:08 +0000] "GET /pulp/api/v3/tasks/89d96438-1757-4838-b428-b7acc69e4150/ HTTP/1.1" 200 1842 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:09 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:09 +0000] "GET /pulp/api/v3/exporters/core/pulp/8b4a77c8-eb6e-4d5d-b6c9-5bf02cfcf105/exports/ HTTP/1.1" 200 1061 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:09 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:09 +0000] "GET /pulp/api/v3/exporters/core/pulp/8b4a77c8-eb6e-4d5d-b6c9-5bf02cfcf105/exports/ HTTP/1.1" 200 1061 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:09 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:09 +0000] "PATCH /pulp/api/v3/exporters/core/pulp/8b4a77c8-eb6e-4d5d-b6c9-5bf02cfcf105/ HTTP/1.1" 202 67 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:10 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:10 +0000] "DELETE /pulp/api/v3/exporters/core/pulp/8b4a77c8-eb6e-4d5d-b6c9-5bf02cfcf105/exports/16889cde-1ecc-4f18-91a2-421d5cf79305/ HTTP/1.1" 204 0 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:10 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:10 +0000] "DELETE /pulp/api/v3/exporters/core/pulp/8b4a77c8-eb6e-4d5d-b6c9-5bf02cfcf105/ HTTP/1.1" 202 67 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:10 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:10 +0000] "GET /pulp/api/v3/tasks/7211263d-5a98-4d25-a6e7-de3d3b854c96/ HTTP/1.1" 200 502 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:11 testsat pulpcore-worker-1: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]: pulpcore.tasking.pulpcore_worker:INFO: Starting task fbc3b83d-1b13-417d-8d25-401fbab18a66
Jan 31 22:55:11 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:11 +0000] "GET /pulp/api/v3/tasks/7211263d-5a98-4d25-a6e7-de3d3b854c96/ HTTP/1.1" 200 502 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:11 testsat pulpcore-worker-1: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]: pulpcore.tasking.pulpcore_worker:INFO: Task completed fbc3b83d-1b13-417d-8d25-401fbab18a66
Jan 31 22:55:12 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:12 +0000] "GET /pulp/api/v3/tasks/7211263d-5a98-4d25-a6e7-de3d3b854c96/ HTTP/1.1" 200 558 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:12 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:12 +0000] "GET /pulp/api/v3/tasks/7211263d-5a98-4d25-a6e7-de3d3b854c96/ HTTP/1.1" 200 583 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:13 testsat pulpcore-worker-4: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]: pulpcore.tasking.pulpcore_worker:INFO: Starting task 7211263d-5a98-4d25-a6e7-de3d3b854c96
Jan 31 22:55:13 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:13 +0000] "GET /pulp/api/v3/tasks/7211263d-5a98-4d25-a6e7-de3d3b854c96/ HTTP/1.1" 200 583 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:13 testsat pulpcore-worker-4: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]: pulpcore.tasking.pulpcore_worker:INFO: Task completed 7211263d-5a98-4d25-a6e7-de3d3b854c96
Jan 31 22:55:14 testsat pulpcore-api: pulp [e99343b2-df22-4c5f-8a61-bc0d9f677620]:  - - [01/Feb/2022:03:55:14 +0000] "GET /pulp/api/v3/tasks/7211263d-5a98-4d25-a6e7-de3d3b854c96/ HTTP/1.1" 200 610 "-" "OpenAPI-Generator/3.14.1/ruby"
Jan 31 22:55:36 testsat dhclient[2063]: RCV: Reply message on eth0 from fe80::425d:82ff:fed4:4a59.
Jan 31 22:55:36 testsat dhclient[2063]: Packet received, but nothing done with it.

Comment 2 Gary Scarborough 2022-02-01 04:12:08 UTC
excerpt from production.log


2022-01-31T22:55:08 [E|bac|e99343b2] Pulp task error (Katello::Errors::Pulp3Error)
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/lib/actions/pulp3/abstract_async_task.rb:108:in `block in check_for_errors'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/lib/actions/pulp3/abstract_async_task.rb:106:in `each'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/lib/actions/pulp3/abstract_async_task.rb:106:in `check_for_errors'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/lib/actions/pulp3/abstract_async_task.rb:139:in `poll_external_task'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action/polling.rb:100:in `poll_external_task_with_rescue'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action/polling.rb:22:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action/cancellable.rb:14:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/lib/actions/pulp3/abstract_async_task.rb:10:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:572:in `block (3 levels) in execute_run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:32:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/lib/actions/middleware/remote_action.rb:16:in `block in run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/lib/actions/middleware/remote_action.rb:40:in `block in as_remote_user'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/lib/actions/middleware/remote_action.rb:27:in `as_cp_user'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/lib/actions/middleware/remote_action.rb:39:in `as_remote_user'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/lib/actions/middleware/remote_action.rb:16:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/execution_wrapper.rb:88:in `wrap'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action/progress.rb:17:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/load_setting_values.rb:20:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_request_id.rb:52:in `restore_current_request_id'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezone'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxonomies'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:32:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_user.rb:54:in `restore_curent_user'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/world.rb:31:in `execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:571:in `block (2 levels) in execute_run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:570:in `catch'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:570:in `block in execute_run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:473:in `block in with_error_handling'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:473:in `catch'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:473:in `with_error_handling'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:565:in `execute_run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:286:in `execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/director.rb:94:in `execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors.rb:18:in `run_user_code'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'
 e99343b2 | [ sidekiq ]
 e99343b2 | [ concurrent-ruby ]
2022-01-31T22:55:08 [I|app|993ef980]   Rendered /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/views/foreman_tasks/api/tasks/show.json.rabl (Duration: 1557.9ms | Allocations: 13759)
2022-01-31T22:55:08 [I|app|993ef980] Completed 200 OK in 2760ms (Views: 1606.4ms | ActiveRecord: 39.0ms | Allocations: 22600)
2022-01-31T22:55:09 [E|bac|e99343b2] undefined method `first' for nil:NilClass (NoMethodError)
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-4.1.1.42/app/lib/actions/pulp3/content_view_version/create_export_history.rb:24:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:572:in `block (3 levels) in execute_run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/rails_executor_wrap.rb:14:in `block in run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.7/lib/active_support/execution_wrapper.rb:88:in `wrap'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/rails_executor_wrap.rb:13:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action/progress.rb:31:in `with_progress_calculation'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action/progress.rb:17:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/load_setting_values.rb:20:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_request_id.rb:15:in `block in run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_request_id.rb:52:in `restore_current_request_id'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_request_id.rb:15:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_timezone.rb:15:in `block in run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_timezone.rb:44:in `restore_curent_timezone'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_timezone.rb:15:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `block in run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_taxonomies.rb:45:in `restore_current_taxonomies'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_taxonomies.rb:15:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:32:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:27:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware.rb:19:in `pass'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_user.rb:15:in `block in run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_user.rb:54:in `restore_curent_user'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/foreman-tasks-4.1.5/app/lib/actions/middleware/keep_current_user.rb:15:in `run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/stack.rb:23:in `call'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/middleware/world.rb:31:in `execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:571:in `block (2 levels) in execute_run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:570:in `catch'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:570:in `block in execute_run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:473:in `block in with_error_handling'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:473:in `catch'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:473:in `with_error_handling'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:565:in `execute_run'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/action.rb:286:in `execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:18:in `block (2 levels) in execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/execution_plan/steps/abstract.rb:167:in `with_meta_calculation'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:17:in `block in execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:32:in `open_action'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:16:in `execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/director.rb:69:in `execute'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors/sidekiq/worker_jobs.rb:11:in `block (2 levels) in perform'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors.rb:18:in `run_user_code'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors/sidekiq/worker_jobs.rb:9:in `block in perform'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors/sidekiq/worker_jobs.rb:25:in `with_telemetry'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors/sidekiq/worker_jobs.rb:8:in `perform'
 e99343b2 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-1.4.9/lib/dynflow/executors/sidekiq/serialization.rb:27:in `perform'
 e99343b2 | [ sidekiq ]
 e99343b2 | [ concurrent-ruby ]

Comment 3 Gary Scarborough 2022-02-01 04:14:00 UTC
[root@testsat log]# hammer repository list --fields Id,Name
---|---------------------------------------------------------------------------------
ID | NAME                                                                            
---|---------------------------------------------------------------------------------
1  | Red Hat Ansible Engine 2.9 RPMs for Red Hat Enterprise Linux 7 Server x86_64    
2  | Red Hat Enterprise Linux 7 Server RPMs x86_64 7Server                           
7  | Red Hat Satellite 6.10 for RHEL 7 Server RPMs x86_64                            
3  | Red Hat Satellite Capsule 6.10 for RHEL 7 Server RPMs x86_64                    
4  | Red Hat Satellite Maintenance 6 for RHEL 7 Server RPMs x86_64                   
5  | Red Hat Satellite Tools 6.10 for RHEL 7 Server RPMs x86_64                      
6  | Red Hat Software Collections RPMs for Red Hat Enterprise Linux 7 Server x86_6...
---|---------------------------------------------------------------------------------
[root@testsat log]# hammer content-view version list
---|-------------------------------|---------|-------------|-----------------------
ID | NAME                          | VERSION | DESCRIPTION | LIFECYCLE ENVIRONMENTS
---|-------------------------------|---------|-------------|-----------------------
2  | export 1.0                    | 1.0     |             | Library, prod         
1  | Default Organization View 1.0 | 1.0     |             | Library               
---|-------------------------------|---------|-------------|-----------------------




[root@testsat log]# hammer content-export complete version --id 2 --organization-id 1

Comment 4 Gary Scarborough 2022-02-01 04:15:33 UTC
This error is very close to the error I see from my customer in case 03114076, BZ 2048861.

Customer is not able to import content into disconnected satellite.

Comment 5 Gary Scarborough 2022-02-01 22:42:20 UTC
I have been testing this issue and I have found that the repo causing the issue is rhel-7-server-rpms 7Server.

[root@testsat exports]# hammer content-export complete version --id 7 --organization-id 1 
[.................................................................................................................................................................................................................................] [100%]
Error: Pulp task error
undefined method `first' for nil:NilClass
[root@testsat exports]# 


[root@testsat exports]# hammer content-view version info --id 7
Id:                     7
Name:                   second 5.0
Version:                5.0
Description:            
Content View ID:        3
Content View Name:      second
Content View Label:     second
Lifecycle Environments: 
 1) Id:    1
    Name:  Library
    Label: Library
 2) Id:    2
    Name:  prod
    Label: prod
Repositories:           
 1) Id:    62
    Name:  Red Hat Enterprise Linux 7 Server RPMs x86_64 7Server
    Label: Red_Hat_Enterprise_Linux_7_Server_RPMs_x86_64_7Server



All other repos in a CV export as expected.  Not sure why this one repo fails to export though.

Comment 6 Gary Scarborough 2022-02-03 00:33:47 UTC
Turns out this was really the bug in BZ 2033847.  Closing this one as a duplicate.

*** This bug has been marked as a duplicate of bug 2033847 ***