Description of problem: Cu is trying to build Phoenix platform and the current python 3.8 image does not have all the modules and dependent libraries in it to install Py4j (grid between python and java) and Pyspark (python API written in python to support Apache spark) . Cu thinks this is definitely a unique situation and python 3.7 version will fulfill all their needs. Error faced on python 3.8, ~~~~~~~~~~~~~ py4j.protocol.Py4JError: org.apache.spark.api.python.PythonUtils.isEncryptionEnabled does not exist in the JVM ~~~~~~~~~~~~~ Please refer this documentation: https://www.py4j.org/install.html {Py4J is a library written in Python and Java. Currently, Py4J has been tested with Python 2.7, 3.4, 3.5, 3.6, and 3.7. } Version-Release number of selected component (if applicable): Python 3.8 How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Python 3.8 not compatible with py4j Expected results: python 3.7 image is required. Additional info: It is working with Python 3.6 but the requirement says cu need python 3.7 or higher for lot of other parts of Phoenix(application) that they are working on.
This is not a bug in the rh-python38 collection, but a request to add new softwarte to RHEL. I'm reassigning it to distribution. Adding a new collection is lot of work in packaging, QA and support. I'm not familiar with py4j; what would it take to update it to support Python 3.8 instead?
Hello Team, Thanks for your reply, For more information on py4j,Please refer this documentation: https://www.py4j.org/install.html {Py4J is a library written in Python and Java. Currently, Py4J has been tested with Python 2.7, 3.4, 3.5, 3.6, and 3.7. } We have tried to install the dependancy and packages on runtime however it fails with following error. ~~~~~~~~~~~~~~~~~~~ py4j.protocol.Py4JError: org.apache.spark.api.python.PythonUtils.isEncryptionEnabled does not exist in the JVM ~~~~~~~~~~~~~~~~~~~ As per cu, ~~~~~~~~~~~ We would not be able to use the python 3.8 even after customizing with all the modules and dependent libraries because the py4j will not support python 3.8 image yet. We would appreciate having python 3.7 image instead of customizing 3.8. ~~~~~~~~~~~ Please help to progress on this case. Regards, Sahil Thakare
Hi Sahil, can the customer use the Python 3.6 collection? It's going EOL soon, but we are working to keep it up to date until that point, and it could be useful after as well. As mentioned above, adding a new collection is an immense amount of work. I'm not sure if it's realistic only to add a specific *old* version of Python, which would EOL soon anyway. And RHEL7 is now in the Maintenance Support 2 phase. Alternatively, the customer could migrate to RHEL8 where Python 3.6 will be supported for the whole lifecycle.