Bug 1124661

Summary: [RFE][sahara]: [EDP] Add a Spark job type (instead of overloading Java)
Product: Red Hat OpenStack Reporter: RHOS Integration <rhos-integ>
Component: openstack-saharaAssignee: Keith Basil <kbasil>
Status: CLOSED CURRENTRELEASE QA Contact: Luigi Toscano <ltoscano>
Severity: high Docs Contact:
Priority: medium    
Version: unspecifiedCC: kbasil, markmc, matt, yeylon
Target Milestone: gaKeywords: FutureFeature, Triaged
Target Release: 6.0 (Juno)   
Hardware: Unspecified   
OS: Unspecified   
URL: https://blueprints.launchpad.net/sahara/+spec/edp-spark-job-type
Whiteboard: upstream_milestone_juno-3 upstream_definition_approved upstream_status_implemented
Fixed In Version: openstack-sahara-2014.2.1-3.el7ost Doc Type: Enhancement
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2015-02-09 20:05:05 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description RHOS Integration 2014-07-30 04:00:54 UTC
Cloned from launchpad blueprint https://blueprints.launchpad.net/sahara/+spec/edp-spark-job-type.

Description:

Spark EDP has been implemented initially using the Java job type.  However, it will be better to suport a specific Spark job type for several reasons:

* the semantics are slightly different.  Spark requires a "main" application jar and supporting libs are optional (Java uses all libs)
* the Spark job type may someday support Python apps
* the possible config set for Spark will be different from Java (although they both use edp.java.main_class)
* Spark/Java may diverge in different ways in the future

This will need support in sahara-api and the dashboard.  TBD whether or not there is a client impact or data model impact.

(spec in progress)

Specification URL (additional information):

None

Comment 2 Scott Lewis 2015-02-09 20:05:05 UTC
This bug has been closed as a part of the RHEL-OSP 6 general availability release. For details, see https://rhn.redhat.com/errata/rhel7-rhos-6-errata.html