Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1645067 - Atomic repos sync fails with PLP0000: 'ascii' codec can't decode byte 0xe2 in position 28: ordinal not in range(128)
Summary: Atomic repos sync fails with PLP0000: 'ascii' codec can't decode byte 0xe2 in...
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Repositories
Version: 6.4.0
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: Released
Assignee: John Mitsch
QA Contact: Peter Ondrejka
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-11-01 10:49 UTC by Peter Ondrejka
Modified: 2019-10-07 17:18 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2019-01-04 15:24:06 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Foreman Issue Tracker 25713 0 None None None 2018-12-17 17:39:04 UTC

Description Peter Ondrejka 2018-11-01 10:49:56 UTC 
Description of problem:
Synchronizing an ostree repository fails with:

PLP0000: 'ascii' codec can't decode byte 0xe2 in position 28: ordinal not in range(128)

This applies both to red hat atomic trees as well as various custom fedora trees. Will attach prodlog excrept. 

Version-Release number of selected component (if applicable):

satellite-6.4.0-15.el7sat.noarch

Additional info:
Previously, this error was seen here https://bugzilla.redhat.com/show_bug.cgi?id=1269145
Comment 5 Brad Buckingham 2018-12-11 20:53:31 UTC 
*** Bug 1645017 has been marked as a duplicate of this bug. ***
Comment 6 John Mitsch 2018-12-17 17:39:03 UTC 
Created redmine issue https://projects.theforeman.org/issues/25713 from this bug
Comment 7 Satellite Program 2018-12-17 19:11:16 UTC 
Upstream bug assigned to jomitsch
Comment 8 John Mitsch 2018-12-18 15:52:53 UTC 
On a 6.4 box, I see was able to sync 'Red Hat Enterprise Linux Atomic Host Trees' without issue. Can we check this one again?

I ran into issues on the first sync of 'https://kojipkgs.fedoraproject.org/atomic/27/', but a resync worked fine.

```
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712) Task pulp.server.managers.repo.sync.sync[b90e915b-126e-44a0-ab49-c26794f21251] raised unexpe
cted: OverflowError('MongoDB can only handle up to 8-byte ints',)
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712) Traceback (most recent call last):
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 367, in trace_task
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)     R = retval = fun(*args, **kwargs)
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in __call__
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)     return super(Task, self).__call__(*args, **kwargs)
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in __call__
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)     return super(PulpTask, self).__call__(*args, **kwargs)
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 622, in __protected_call
__
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)     return self.run(*args, **kwargs)
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 819, in sync
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)     rebuild_content_unit_counts(repo_obj)
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 313, in rebuild_content_unit_counts
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)     repository.save()
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)   File "/usr/lib/python2.7/site-packages/mongoengine/document.py", line 367, in save
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)     upsert=upsert, **write_concern)
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)   File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 2232, in update
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)     check_keys, multi, manipulate, write_concern)
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)   File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 709, in _update
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)     codec_options=self.codec_options).copy()
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)   File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 216, in command
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)     self._raise_connection_failure(error)
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)   File "/usr/lib64/python2.7/site-packages/pymongo/pool.py", line 343, in _raise_connection_failure
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712)     raise error
Dec 18 15:49:04 sat-6-4-compose-rhel7 pulp: celery.app.trace:ERROR: [b90e915b] (32448-79712) OverflowError: MongoDB can only handle up to 8-byte ints
```

I think we should re-check syncing the repos on the latest 6.4 builds

Versions used:

[root@sat-6-4-compose-rhel7 ~]# rpm -qa | grep pulp-server
pulp-server-2.16.4.1-1.el7sat.noarch

[root@sat-6-4-compose-rhel7 ~]# rpm -qa | grep pulp-ostree
pulp-ostree-plugins-1.3.0-1.el7sat.noarch
ppython-pulp-ostree-common-1.3.0-1.el7sat.noarch

[root@sat-6-4-compose-rhel7 ~]# rpm -qa | grep satellite
satellite-installer-6.4.0.7-2.el7sat.noarch
satellite-6.4.1-2.el7sat.noarch
tfm-rubygem-foreman_theme_satellite-2.0.1.12-1.el7sat.noarch
satellite-cli-6.4.1-1.el7sat.noarch
satellite-common-6.4.1-1.el7sat.noarch
Comment 9 Peter Ondrejka 2019-01-02 12:37:03 UTC 
Hi John, I looked again on Sat 6.4.2, and I confirm that I can sync rhel atomic repos without problems. With custom fedora ostree I get the same "OverflowError: MongoDB can only handle up to 8-byte ints" error, though resync doesn't help in my case. I see that this is being handled here https://bugzilla.redhat.com/show_bug.cgi?id=1658444 so for me it's ok if we want to close this bug.
Comment 10 John Mitsch 2019-01-02 14:28:02 UTC 
(In reply to Peter Ondrejka from comment #9)
> Hi John, I looked again on Sat 6.4.2, and I confirm that I can sync rhel
> atomic repos without problems. With custom fedora ostree I get the same
> "OverflowError: MongoDB can only handle up to 8-byte ints" error, though
> resync doesn't help in my case. I see that this is being handled here
> https://bugzilla.redhat.com/show_bug.cgi?id=1658444 so for me it's ok if we
> want to close this bug.

This is fine with me
Comment 11 Brad Buckingham 2019-01-04 15:24:06 UTC 
Closing based upon comment 8 and 9.  Since the mongo error is different than the one in this report, I am going to close as notabug versus a duplicate.  If there are any concerns, please do needinfo me.  Thanks!
Note You need to log in before you can comment on or make changes to this bug.