Releases: radanalyticsio/oshinko-s2i
Release v0.6.1
Oshinko S2I images used by these templates
These templates use the following oshinko s2i images:
- radanalyticsio/radanalytics-pyspark:v0.6.1 found here
radanalyticsio/radanalytics-pyspark-py36:v0.6.1 found here - radanalyticsio/radanalytics-java-spark:v0.6.1 found here
- radanalyticsio/radanalytics-scala-spark:v0.6.1 found here
- radanalyticsio/radanalytics-r-spark:v0.6.1 found here
Apache Spark version
The referenced oshinko s2i images use Apache Spark 2.4.0
The change to Apache Spark 2.4.0 is the significant change in this release.
Oshinko binary version
The referenced oshinko s2i images use oshinko binary release v0.6.1 found here
Noted difference between these templates and those at https://radanalytics.io
The templates created by https://radanalytics.io/resources.yaml use imagestreams to reference the images so that versions may be easily changed with tags, or so that custom spark distributions may be used (see the site for more information). These templates, on the other hand, reference the v0.6.1 versioned images directly without the use of imagestreams.
Release v0.5.6
Oshinko S2I images used by these templates
These templates use the following oshinko s2i images:
- radanalyticsio/radanalytics-pyspark:v0.5.6 found here
radanalyticsio/radanalytics-pyspark-py36:v0.5.6 found here - radanalyticsio/radanalytics-java-spark:v0.5.6 found here
- radanalyticsio/radanalytics-scala-spark:v0.5.6 found here
- radanalyticsio/radanalytics-r-spark:v0.5.6 found here
Apache Spark version
The referenced oshinko s2i images use Apache Spark 2.3.0
Oshinko binary version
The referenced oshinko s2i images use oshinko binary release v0.5.6 found here
Summary of changes in templates
- The selector labels in the sparkjob.json template were modified to fix issue 256 (All jobs created with template oshinko-spark-job fail)
Summary of changes in related images
- The usage scripts for all of the s2i images have been updated
- The spark user id is handled differently now, allowing the nss_wrapper dependency to be dropped
- A non-fatal error in the spark driver log has been removed (#249)
Release v0.5.4
Oshinko S2I images used by these templates
These templates use the following oshinko s2i images:
- radanalyticsio/radanalytics-pyspark:v0.5.4 found here
radanalyticsio/radanalytics-pyspark-py36:v0.5.4 found here - radanalyticsio/radanalytics-java-spark:v0.5.4 found here
- radanalyticsio/radanalytics-scala-spark:v0.5.4 found here
- radanalyticsio/radanalytics-r-spark:v0.5.4 found here
Apache Spark version
The referenced oshinko s2i images use Apache Spark 2.3.0
Oshinko binary version
The referenced oshinko s2i images use oshinko binary release v0.5.4 found here
Summary of changes in templates
- Templates have been added to support applications written with Python 3.6. Note that if you use the py36 template to create a Spark cluster, you must create a configmap for cluster configuration, set sparkimage to
radanalyticsio/openshift-spark-py36in the configmap, and pass the name of the configmap to the template using-p OSHINKO_NAMED_CONFIG=<your-configmap-name> - Templates have been added to support applications written in R. The S2I image contains both the sparklyr and SparkR drivers for Spark.
- Local lookup policy has been set on all of the imagestreams created by the templates so that they can be referenced with simple names within a project. This helps when using them from job templates, for instance.
Release v0.5.3
Oshinko S2I images used by these templates
These templates use the following oshinko s2i images:
- radanalyticsio/radanalytics-pyspark:v0.5.3 found here
- radanalyticsio/radanalytics-java-spark:v0.5.3 found here
- radanalyticsio/radanalytics-scala-spark:v0.5.3 found here
Apache Spark version
The referenced oshinko s2i images use Apache Spark 2.3.0
Oshinko binary version
The referenced oshinko s2i images use oshinko binary release v0.5.3 found here
Summary of changes in templates
The S2I templates now support kubernetes native scheduling for spark applications as an option instead of a Spark standalone deployment. To use this deployment mode, set the OSHINKO_KUBE_SCHEDULER parameter to true when launching the template. Note that clusters created this way are always ephemeral and do not support some oshinko options like cluster configuration configmaps.
Release v0.5.2
Oshinko S2I images used by these templates
These templates use the following oshinko s2i images:
- radanalyticsio/radanalytics-pyspark:v0.5.2 found here
- radanalyticsio/radanalytics-java-spark:v0.5.2 found here
- radanalyticsio/radanalytics-scala-spark:v0.5.2 found here
Apache Spark version
The referenced oshinko s2i images use Apache Spark 2.3.0
Oshinko binary version
The referenced oshinko s2i images use oshinko binary release v0.5.2 found here
Summary of changes in templates
There are no user facing changes in this release
Release v0.5.1
Oshinko S2I images used by these templates
These templates use the following oshinko s2i images:
- radanalyticsio/radanalytics-pyspark:v0.5.1 found here
- radanalyticsio/radanalytics-java-spark:v0.5.1 found here
- radanalyticsio/radanalytics-scala-spark:v0.5.1 found here
Apache Spark version
The referenced oshinko s2i images use Apache Spark 2.3.0
Oshinko binary version
The referenced oshinko s2i images use oshinko binary release v0.5.1 found here
Summary of changes in templates
There are no user facing changes in this release
Release v0.4.6
Oshinko S2I images used by these templates
These templates use the following oshinko s2i images:
- radanalyticsio/radanalytics-pyspark:v0.4.6 found here
- radanalyticsio/radanalytics-java-spark:v0.4.6 found here
- radanalyticsio/radanalytics-scala-spark:v0.4.6 found here
Apache Spark version
The referenced oshinko s2i images use Apache Spark 2.2.1
Oshinko binary version
The referenced oshinko s2i images use oshinko binary release v0.4.6 found here
Summary of changes in templates
-
The names of the python templates were changed to include "spark" for consistency with the Java and Scala templates. The template names now are oshinko-python-spark-build, oshinko-python-spark-build-dc and oshinko-python-spark-dc
-
The "deploymentconfig" labels and selectors in the python templates were changed to "deploymentConfig"
Release v0.4.5
Oshinko S2I images used by these templates
These templates use the following oshinko s2i images:
- radanalyticsio/radanalytics-pyspark:v0.4.5 found here
- radanalyticsio/radanalytics-java-spark:v0.4.5 found here
- radanalyticsio/radanalytics-scala-spark:v0.4.5 found here
Apache Spark version
The referenced oshinko s2i images use Apache Spark 2.2.1
Oshinko binary version
The referenced oshinko s2i images use oshinko binary release v0.4.5 found here
Summary of changes in templates
-
The image pull policy for build configs has been changed from Always to IfNotPresent
-
Scala and Java builds will look for a main class specified in a MANIFEST.MF file; the APP_MAIN_CLASS parameter is now optional
Release v0.4.4
Oshinko S2I images used by these templates
These templates use the following oshinko s2i images:
- radanalyticsio/radanalytics-pyspark:v0.4.4 found here
- radanalyticsio/radanalytics-java-spark:v0.4.4 found here
- radanalyticsio/radanalytics-scala-spark:v0.4.4 found here
Apache Spark version
The referenced oshinko s2i images use Apache Spark 2.2.0
Oshinko binary version
The referenced oshinko s2i images use oshinko binary release v0.4.4 found here
Summary of changes in templates
- add a generic job template
- add java templates for dc
- add a scala template for dc
- reorganize parameter sections to share ordering and descriptions
- add a Service object to java build-dc and dc templates
- add a Service object to scala build-dc and dc templates
- rename pyspark* templates to python*
- remove pysparkjob.json
- add a readme file to template dir
- update common e2e script with new template names
Release v0.4.3
Oshinko S2I images used by these templates
These templates use the following oshinko s2i images:
- radanalyticsio/radanalytics-pyspark:v0.4.3 found here
- radanalyticsio/radanalytics-java-spark:v0.4.3 found here
- radanalyticsio/radanalytics-scala-spark:v0.4.3 found here
Apache Spark version
The referenced oshinko s2i images use Apache Spark 2.2.0
Oshinko binary version
The referenced oshinko s2i images use oshinko binary release v0.4.3 found here
Summary of changes in corresponding images
-
Some functionality in the scala image in v0.4.0 was unintentionally removed in v0.4.1 and v0.4.2 and has been restored in this release. This was the availability of the SBT_ARGS and SBT_ARGS_APPEND environment variables for modifying the sbt build command. Additionally, these environment variables are now exposed in the oshinko s2i scala build templates to make them easier to use.
-
Signal handling has been approved in openshift-spark:2.2-latest so that any signals passed to the container will be passed to spark itself.