Description of problem: SKU Validation failed for 4 OCP SKUs - MW00692,MW00693,MW00694,MW00695 Version-Release number of selected component (if applicable): No How reproducible: 100% Steps to Reproduce: Make SKU validation for the 4 new OCP SKUs MW00692,MW00693,MW00694,MW00695 as below steps: 1. Get SKU test matrix data from the PNT Ticket(https://redhat.service-now.com/surl.do?n=PNTBO0002100)'s google doc outlining request: https://docs.google.com/spreadsheets/d/1RFr53cnOowI9fnqbhx-hSZEaYHl589FHPFpTJvVyuIM 2. Get SKU attributes data with the entitlement production environment REST API 3. Compare each SKU attribute value for the 4 OCP SKUs: MW00692,MW00693,MW00694,MW00695 Found some inconsistency for some attributes value as shown in below 'Actual results', for details, please see the testing jenkins job: https://entitlement-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/SKU%20Testing/job/sku-validation/13/ Please get the issues fixed asap, otherwise, it will greatly affect the customer's experience during the entitlement process, especially for some import attributes like 'Service Type' - it will cause customer can not get correct service, 'Eng Product ID(s)' - it will cause customer can not download needed packages, etc. Actual results: =================================================== SKU: MW00692 =================================================== The test matrix data for the SKU 'MW00692' - SKU Description: Red Hat OpenShift Container Platform with Runtimes, Premium (1 Core, Business Partner Supported) The REST API data for the SKU 'MW00692' - SKU Description: Red Hat OpenShift Container Platform with Runtimes for IBM Cloud Pak for Applications (1 Core, Business Partner Supported) FAIL -- Failed to verify the attribute 'SKU Description' for the SKU 'MW00692'. The test matrix data for the SKU 'MW00692' - Service Type: Premium The REST API data for the SKU 'MW00692' - Service Type: Self-Support FAIL -- Failed to verify the attribute 'Service Type' for the SKU 'MW00692'. The test matrix data for the SKU 'MW00692' - Service Level: PSF The REST API data for the SKU 'MW00692' - Service Level: L3 FAIL -- Failed to verify the attribute 'Service Level' for the SKU 'MW00692'. The test matrix data for the SKU 'MW00692' - Product Line: OCP & MW RUNTIMES BUNDLE The REST API data for the SKU 'MW00692' - Product Line: Cloud Pak for Applications FAIL -- Failed to verify the attribute 'Product Line' for the SKU 'MW00692'. The test matrix data for the SKU 'MW00692' - Eng Product ID(s): ['69', '70', '180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '408', '418', '458', '473', '479', '484', '491', '518', '519', '521', '546', '550'] The REST API data for the SKU 'MW00692' - Eng Product ID(s): ['180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '408', '418', '458', '473', '479', '484', '491', '521', '546', '550', '69', '70'] The 'Eng Product ID(s)' in test matrix data but not in REST API data for the SKU 'MW00692' are: ['519', '518'] The 'Eng Product ID(s)' in REST API data but not in test matrix data for the SKU 'MW00692' are: [] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00692'. =================================================== SKU: MW00693 =================================================== The test matrix data for the SKU 'MW00693' - SKU Description: Red Hat OpenShift Container Platform, Premium (1 Core, Business Partner Supported) The REST API data for the SKU 'MW00693' - SKU Description: Red Hat OpenShift Container Platform for IBM Cloud Pak for Security (1 Core, Business Partner Supported) FAIL -- Failed to verify the attribute 'SKU Description' for the SKU 'MW00693'. The test matrix data for the SKU 'MW00693' - Service Type: Premium The REST API data for the SKU 'MW00693' - Service Type: Self-Support FAIL -- Failed to verify the attribute 'Service Type' for the SKU 'MW00693'. The test matrix data for the SKU 'MW00693' - Service Level: PSF The REST API data for the SKU 'MW00693' - Service Level: L3 FAIL -- Failed to verify the attribute 'Service Level' for the SKU 'MW00693'. The test matrix data for the SKU 'MW00693' - Product Line: OPENSHIFT The REST API data for the SKU 'MW00693' - Product Line: Cloud Pak for Security FAIL -- Failed to verify the attribute 'Product Line' for the SKU 'MW00693'. The test matrix data for the SKU 'MW00693' - Eng Product ID(s): ['69', '180', '185', '194', '197', '201', '205', '240', '271', '290', '311', '317', '318', '326', '329', '408', '458', '473', '479', '491', '518', '519', '546'] The REST API data for the SKU 'MW00693' - Eng Product ID(s): ['180', '185', '194', '197', '201', '205', '240', '271', '290', '311', '317', '318', '326', '329', '408', '458', '473', '479', '491', '546', '69'] The 'Eng Product ID(s)' in test matrix data but not in REST API data for the SKU 'MW00693' are: ['519', '518'] The 'Eng Product ID(s)' in REST API data but not in test matrix data for the SKU 'MW00693' are: [] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00693'. =================================================== SKU: MW00694 =================================================== The test matrix data for the SKU 'MW00694' - SKU Description: Red Hat OpenShift Container Platform for Business Partners, Partner Support Full The REST API data for the SKU 'MW00694' - SKU Description: Red Hat OpenShift Container Platform with Runtimes for Business Partners, Partner Support Full FAIL -- Failed to verify the attribute 'SKU Description' for the SKU 'MW00694'. The test matrix data for the SKU 'MW00694' - Eng Product ID(s): ['69', '70', '180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '408', '418', '458', '473', '479', '484', '491', '518', '519', '521', '546', '550'] The REST API data for the SKU 'MW00694' - Eng Product ID(s): ['180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '408', '418', '458', '473', '479', '484', '491', '521', '546', '550', '588', '69', '70'] The 'Eng Product ID(s)' in test matrix data but not in REST API data for the SKU 'MW00694' are: ['519', '518'] The 'Eng Product ID(s)' in REST API data but not in test matrix data for the SKU 'MW00694' are: ['588'] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00694'. =================================================== SKU: MW00695 =================================================== The test matrix data for the SKU 'MW00695' - SKU Description: Red Hat OpenShift Container Platform Broker/Master Infrastructure (1 Core, Business Partner Supported) The REST API data for the SKU 'MW00695' - SKU Description: Red Hat OpenShift Container Platform with Runtimes Broker/Master Infrastructure for IBM Cloud Pak for Applications (1 Core, Business Partner Supported) FAIL -- Failed to verify the attribute 'SKU Description' for the SKU 'MW00695'. The test matrix data for the SKU 'MW00695' - Service Level: PSF The REST API data for the SKU 'MW00695' - Service Level: L3 FAIL -- Failed to verify the attribute 'Service Level' for the SKU 'MW00695'. The test matrix data for the SKU 'MW00695' - Eng Product ID(s): ['69', '70', '167', '180', '193', '197', '201', '205', '240', '271', '290', '303', '317', '318', '326', '329', '408', '458'] The REST API data for the SKU 'MW00695' - Eng Product ID(s): ['167', '180', '193', '197', '201', '205', '240', '271', '290', '303', '317', '318', '326', '329', '408', '458', '588', '69', '70'] The 'Eng Product ID(s)' in test matrix data but not in REST API data for the SKU 'MW00695' are: [] The 'Eng Product ID(s)' in REST API data but not in test matrix data for the SKU 'MW00695' are: ['588'] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00695'. Expected results: All SKU attributes value are consistent between PNT Ticket SKU matrix data and the REST API data. Additional info:
Hi Team, Please refer to this approved update PNT ticket: https://redhat.service-now.com/surl.do?n=PNTBO0002119. We have updated the SKU Descriptions and the attributes according to this google sheet attached in this PNT Ticket. Link to the google sheet: https://docs.google.com/spreadsheets/d/14iiOEr6bTRvSi4Rr1CpFF30gdFIF06M0ysq2vGaCz80/edit?usp=sharing For MW00694, please refer to this approved update PNT ticket: https://redhat.service-now.com/surl.do?n=PNTBO0002154 Link to the google sheet attached in this ticket: https://docs.google.com/spreadsheets/d/1FoEEMnEufracacw-djNYEhKebmY4HCSChwpdNOYC2Xs/edit?usp=sharing Please let me know if you have any questions. Thanks, Bharadwaj Tetali
Hi Bharadwaj, Thanks for providing the information! After re-run testing with the newly provided SKU update data, I find all the other attributes issues have been fixed except that the validation for 'Eng Product ID(s)' is still failed as shown in [1]. Please be noted that there are no Eng Product ID(s) data provided in the PnT ticket 'PNTBO0002119' for the SKUs 'MW00692', 'MW00693', 'MW00695', so I have just still used the data from the original PnT ticket 'PNTBO0002100' for the Eng Product ID(s) verification of the 3 SKUs. Could you please have a check and provide further data if have or get them fixed if they're real issues? Thanks! Best Regards, Libin Liu [1] =================================================== SKU: MW00692 =================================================== The test matrix data for the SKU 'MW00692' - Eng Product ID(s): ['69', '70', '180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '408', '418', '458', '473', '479', '484', '491', '518', '519', '521', '546', '550'] The REST API data for the SKU 'MW00692' - Eng Product ID(s): ['180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '408', '418', '458', '473', '479', '484', '491', '521', '546', '550', '69', '70'] The 'Eng Product ID(s)' in test matrix data but not in REST API data for the SKU 'MW00692' are: ['519', '518'] The 'Eng Product ID(s)' in REST API data but not in test matrix data for the SKU 'MW00692' are: [] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00692'. =================================================== SKU: MW00693 =================================================== The test matrix data for the SKU 'MW00693' - Eng Product ID(s): ['69', '180', '185', '194', '197', '201', '205', '240', '271', '290', '311', '317', '318', '326', '329', '408', '458', '473', '479', '491', '518', '519', '546'] The REST API data for the SKU 'MW00693' - Eng Product ID(s): ['180', '185', '194', '197', '201', '205', '240', '271', '290', '311', '317', '318', '326', '329', '408', '458', '473', '479', '491', '546', '69'] The 'Eng Product ID(s)' in test matrix data but not in REST API data for the SKU 'MW00693' are: ['519', '518'] The 'Eng Product ID(s)' in REST API data but not in test matrix data for the SKU 'MW00693' are: [] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00693'. =================================================== SKU: MW00694 =================================================== The test matrix data for the SKU 'MW00694' - Eng Product ID(s): ['69', '70', '180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '408', '418', '458', '473', '479', '484', '491', '518', '519', '521', '546', '550'] The REST API data for the SKU 'MW00694' - Eng Product ID(s): ['180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '408', '418', '458', '473', '479', '484', '491', '521', '546', '550', '588', '69', '70'] The 'Eng Product ID(s)' in test matrix data but not in REST API data for the SKU 'MW00694' are: ['519', '518'] The 'Eng Product ID(s)' in REST API data but not in test matrix data for the SKU 'MW00694' are: ['588'] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00694'. =================================================== SKU: MW00695 =================================================== The test matrix data for the SKU 'MW00695' - Eng Product ID(s): ['69', '70', '167', '180', '193', '197', '201', '205', '240', '271', '290', '303', '317', '318', '326', '329', '408', '458'] The REST API data for the SKU 'MW00695' - Eng Product ID(s): ['167', '180', '193', '197', '201', '205', '240', '271', '290', '303', '317', '318', '326', '329', '408', '458', '588', '69', '70'] The 'Eng Product ID(s)' in test matrix data but not in REST API data for the SKU 'MW00695' are: [] The 'Eng Product ID(s)' in REST API data but not in test matrix data for the SKU 'MW00695' are: ['588'] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00695'. --- Testing Jenkins Jobs: https://entitlement-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/SKU%20Validation/job/sku-validation/60/ - Testing for SKU 'MW00694' https://entitlement-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/SKU%20Validation/job/sku-validation/61/ - Testing for SKUs 'MW00692', 'MW00693', 'MW00695'
Libin and Bharadwaj, For MW00692 and MW00693, I saw 518 and 519 in Prod Admin, cause there is no content associated with them, so that is why we can't get them by REST API. It should not a real issue. For the other two SKUs MW00694 and MW00695, why Eng ID "588" - "Red Hat CodeReady Linux Builder for x86_64 - Extended Update Support" is configured, is there any requests for that? thanks Song
(In reply to Liu Song from comment #3) > Libin and Bharadwaj, > > For MW00692 and MW00693, I saw 518 and 519 in Prod Admin, cause there is no > content associated with them, so that is why we can't get them by REST API. > It should not a real issue. > > For the other two SKUs MW00694 and MW00695, why Eng ID "588" - "Red Hat > CodeReady Linux Builder for x86_64 - Extended Update Support" is configured, > is there any requests for that? thanks > > Song decision to include the following EngIds in these SKUs came from BU. 588 - Red Hat CodeReady Linux Builder for x86_64 - Extended Update Support 589 - Red Hat CodeReady Linux Builder for Power, little endian - Extended Update Support 590 - Red Hat CodeReady Linux Builder for IBM z Systems - Extended Update Support So we should be all set with that. So looks like all issues have been addressed. Can QE mark this bug as Verified?
Thanks Tushar for providing the information! Yes, after check the 588 is configured for the SKU MW00694, and the 588, 589 have been configured for the SKU MW00695, attached the testing results as below [1] FYI, from the testing result, there are more SKUs have been newly configured for the 4 SKUs comparing to the testing results in the Comment 2, I think that should be okay since it's used the previously provided SKU matrix data for testing which were from the PnT ticket PNTBO0002119 and PNTBO0002154 respectively, according to the Comment 2 and Comment 3, the remaining concerned issue of this bug is to confirm if the 588 should be configured for the SKU MW00694 and MW00695, then it's working as expected now, so I'm closing this bug now, if any one has any concern or comments, please just re-open this bug. [1] =================================================== SKU: MW00692 =================================================== The Test Matrix data for the SKU 'MW00692' - Eng Product ID(s): ['69', '70', '180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '408', '418', '458', '473', '479', '484', '491', '518', '519', '521', '546', '550'] The REST API data for the SKU 'MW00692' - Eng Product ID(s): ['180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '358', '359', '362', '406', '407', '408', '418', '434', '458', '473', '479', '484', '491', '492', '494', '521', '546', '550', '579', '580', '581', '582', '69', '70', '72'] The 'Eng Product ID(s)' in Test Matrix data but not in REST API data for the SKU 'MW00692' are: ['518', '519'] The 'Eng Product ID(s)' in REST API data but not in Test Matrix data for the SKU 'MW00692' are: ['358', '359', '362', '406', '407', '434', '492', '494', '579', '580', '581', '582', '72'] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00692'. =================================================== SKU: MW00693 =================================================== The Test Matrix data for the SKU 'MW00693' - Eng Product ID(s): ['69', '180', '185', '194', '197', '201', '205', '240', '271', '290', '311', '317', '318', '326', '329', '408', '458', '473', '479', '491', '518', '519', '546'] The REST API data for the SKU 'MW00693' - Eng Product ID(s): ['180', '185', '194', '197', '201', '205', '240', '271', '290', '311', '317', '318', '326', '329', '408', '458', '473', '479', '491', '546', '69'] The 'Eng Product ID(s)' in Test Matrix data but not in REST API data for the SKU 'MW00693' are: ['518', '519'] The 'Eng Product ID(s)' in REST API data but not in Test Matrix data for the SKU 'MW00693' are: [] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00693'. =================================================== SKU: MW00694 =================================================== The Test Matrix data for the SKU 'MW00694' - Eng Product ID(s): ['69', '70', '180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '408', '418', '458', '473', '479', '484', '491', '518', '519', '521', '546', '550'] The REST API data for the SKU 'MW00694' - Eng Product ID(s): ['180', '183', '185', '194', '197', '198', '201', '205', '225', '240', '271', '278', '290', '301', '307', '311', '317', '318', '322', '326', '329', '349', '358', '359', '362', '406', '407', '408', '418', '434', '458', '473', '479', '484', '491', '492', '494', '521', '546', '550', '579', '580', '581', '582', '588', '69', '70', '72'] The 'Eng Product ID(s)' in Test Matrix data but not in REST API data for the SKU 'MW00694' are: ['518', '519'] The 'Eng Product ID(s)' in REST API data but not in Test Matrix data for the SKU 'MW00694' are: ['358', '359', '362', '406', '407', '434', '492', '494', '579', '580', '581', '582', '588', '72'] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00694'. =================================================== SKU: MW00695 =================================================== The Test Matrix data for the SKU 'MW00695' - Eng Product ID(s): ['69', '70', '167', '180', '193', '197', '201', '205', '240', '271', '290', '303', '317', '318', '326', '329', '408', '458'] The REST API data for the SKU 'MW00695' - Eng Product ID(s): ['167', '180', '193', '194', '197', '201', '205', '240', '271', '279', '290', '303', '317', '318', '326', '329', '356', '357', '358', '359', '362', '406', '407', '408', '420', '434', '458', '474', '475', '479', '482', '491', '492', '494', '579', '580', '581', '582', '588', '589', '69', '70', '72'] The 'Eng Product ID(s)' in Test Matrix data but not in REST API data for the SKU 'MW00695' are: [] The 'Eng Product ID(s)' in REST API data but not in Test Matrix data for the SKU 'MW00695' are: ['194', '279', '356', '357', '358', '359', '362', '406', '407', '420', '434', '474', '475', '479', '482', '491', '492', '494', '579', '580', '581', '582', '588', '589', '72'] FAIL -- Failed to verify the 'Eng Product ID(s)' for the SKU 'MW00695'. --- Testing Jenkins Jobs: Testing Job: https://entitlement-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/SKU Validation/job/sku-validation/77/ PnT ticket: https://redhat.service-now.com/surl.do?n=PNTBO0002119 Test Matrix: https://docs.google.com/spreadsheets/d/14iiOEr6bTRvSi4Rr1CpFF30gdFIF06M0ysq2vGaCz80/edit#gid=1443397617 Testing SKU: MW00692, MW00693, MW00695 Testing Job: https://entitlement-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/SKU Validation/job/sku-validation/78/ PnT ticket: https://redhat.service-now.com/surl.do?n=PNTBO0002154 Test Matrix: https://docs.google.com/spreadsheets/d/1FoEEMnEufracacw-djNYEhKebmY4HCSChwpdNOYC2Xs/edit#gid=1443397617 Testing SKU: MW00694
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2020:0062