Bug 1743776

Description of problem:

Getting the below error when trying to delete a content-view version. Try to clean up the content-view version through API, and hit this issue randomly.

Need to manually skip/resume these tasks to successfully delete the content-view version but getting stuck on below error.


Version-Release number of selected component (if applicable):
6.4


Actual results:

pulp_tasks:
- exception:
  task_type: pulp.server.tasks.repository.delete
  _href: "/pulp/api/v2/tasks/e7eaf752-0e62-4292-b200-28b475002962/"
  task_id: e7eaf752-0e62-4292-b200-28b475002962
  tags:
  - pulp:repository:1-RHEL_7-v785_0-b5b43a8f-3598-4a1b-9400-5625d6f970af
  - pulp:action:delete
  finish_time: '2019-08-16T06:15:46Z'
  _ns: task_status
  start_time: '2019-08-16T06:15:46Z'
  traceback: |
    Traceback (most recent call last):
      File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 367, in trace_task
        R = retval = fun(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in __call__
        return super(Task, self).__call__(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in __call__
        return super(PulpTask, self).__call__(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 622, in __protected_call__
        return self.run(*args, **kwargs)
      File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 559, in delete
        raise pe
    PulpExecutionException: Pulp exception occurred: PulpExecutionException
  spawned_tasks: []
  progress_report: {}
  queue: reserved_resource_worker-1@satellite
  state: error
  worker_name: reserved_resource_worker-1@satellite
  result:
  error:
    code: PLP0000
    data: {}
    description: 'Pulp exception occurred: PulpExecutionException'
    sub_errors:
    - code: PLP0000
      data: {}
      description: "[Errno 2] No such file or directory: '/var/lib/pulp/published/yum/https/repos/redhat/content_views/RHEL_7/78.0/content/dist/rhel/server/7/7Server/x86_64/sat-tools/listing'"
      sub_errors: []
  _id:
    "$oid": 5d564a128e667f6b36e52fc7
  id: 5d564a128e667f6b36e52fc7
poll_attempts:
  total: 1
  failed: 1



Expected results:

content-view has to get deleted without any error and without going into a paused state. 


Additional info:

file - /usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   try:
        # Remove all importers and distributors from the repo. This is likely already done by the
        # calls to other methods in this manager, but in case those failed we still want to attempt
        # to keep the database clean.
        model.Distributor.objects(repo_id=repo_id).delete()
        model.Importer.objects(repo_id=repo_id).delete()
        RepoSyncResult.get_collection().remove({'repo_id': repo_id})
        RepoPublishResult.get_collection().remove({'repo_id': repo_id})
        RepoContentUnit.get_collection().remove({'repo_id': repo_id})
    except Exception, e:
        msg = _('Error updating one or more database collections while removing repo [%(r)s]')
        msg = msg % {'r': repo_id}
        _logger.exception(msg)
        error_tuples.append(e)

    # remove the repo from any groups it was a member of
    group_manager = manager_factory.repo_group_manager()
    group_manager.remove_repo_from_groups(repo_id)

    if len(error_tuples) > 0:
        pe = pulp_exceptions.PulpExecutionException()
        pe.child_exceptions = error_tuples
        raise pe
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

From the code comments, I can see that it is trying to re-delete the distributor and content but it is obvious that if it is trying to re-delete it will not find the file "/var/lib/pulp/published/yum/https/repos/redhat/content_views/RHEL_7/78.0/content/dist/rhel/server/7/7Server/x86_64/sat-tools/listing".