Skip to content

Commit

Permalink
bump mmlspark version to 0.16 (#511)
Browse files Browse the repository at this point in the history
* bump mmlspark version to 0.16
  • Loading branch information
mhamilton723 authored Mar 6, 2019
1 parent 1c050ad commit 1d29394
Show file tree
Hide file tree
Showing 5 changed files with 18 additions and 18 deletions.
16 changes: 8 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -155,9 +155,9 @@ MMLSpark can be conveniently installed on existing Spark clusters via the
`--packages` option, examples:

```bash
spark-shell --packages Azure:mmlspark:0.15
pyspark --packages Azure:mmlspark:0.15
spark-submit --packages Azure:mmlspark:0.15 MyApp.jar
spark-shell --packages Azure:mmlspark:0.16
pyspark --packages Azure:mmlspark:0.16
spark-submit --packages Azure:mmlspark:0.16 MyApp.jar
```

This can be used in other Spark contexts too. For example, you can use MMLSpark
Expand All @@ -172,14 +172,14 @@ cloud](http://community.cloud.databricks.com), create a new [library from Maven
coordinates](https://docs.databricks.com/user-guide/libraries.html#libraries-from-maven-pypi-or-spark-packages)
in your workspace.

For the coordinates use: `Azure:mmlspark:0.15`. Ensure this library is
For the coordinates use: `Azure:mmlspark:0.16`. Ensure this library is
attached to all clusters you create.

Finally, ensure that your Spark cluster has at least Spark 2.1 and Scala 2.11.

You can use MMLSpark in both your Scala and PySpark notebooks. To get started with our example notebooks import the following databricks archive:

```https://mmlspark.blob.core.windows.net/dbcs/MMLSpark%20Examples%20v0.15.dbc```
```https://mmlspark.blob.core.windows.net/dbcs/MMLSpark%20Examples%20v0.16.dbc```


### Docker
Expand Down Expand Up @@ -212,7 +212,7 @@ the above example, or from python:
```python
import pyspark
spark = pyspark.sql.SparkSession.builder.appName("MyApp") \
.config("spark.jars.packages", "Azure:mmlspark:0.15") \
.config("spark.jars.packages", "Azure:mmlspark:0.16") \
.getOrCreate()
import mmlspark
```
Expand All @@ -228,7 +228,7 @@ running script actions, see [this
guide](https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-customize-cluster-linux#use-a-script-action-during-cluster-creation).

The script action url is:
<https://mmlspark.azureedge.net/buildartifacts/0.15/install-mmlspark.sh>.
<https://mmlspark.azureedge.net/buildartifacts/0.16/install-mmlspark.sh>.

If you're using the Azure Portal to run the script action, go to `Script
actions` → `Submit new` in the `Overview` section of your cluster blade. In
Expand All @@ -244,7 +244,7 @@ your `build.sbt`:

```scala
resolvers += "MMLSpark Repo" at "https://mmlspark.azureedge.net/maven"
libraryDependencies += "com.microsoft.ml.spark" %% "mmlspark" % "0.15"
libraryDependencies += "com.microsoft.ml.spark" %% "mmlspark" % "0.16"
```

### Building from source
Expand Down
6 changes: 3 additions & 3 deletions docs/R-setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ To install the current MMLSpark package for R use:

```R
...
devtools::install_url("https://mmlspark.azureedge.net/rrr/mmlspark-0.15.zip")
devtools::install_url("https://mmlspark.azureedge.net/rrr/mmlspark-0.16.zip")
...
```

Expand All @@ -23,7 +23,7 @@ It will take some time to install all dependencies. Then, run:
library(sparklyr)
library(dplyr)
config <- spark_config()
config$sparklyr.defaultPackages <- "Azure:mmlspark:0.15"
config$sparklyr.defaultPackages <- "Azure:mmlspark:0.16"
sc <- spark_connect(master = "local", config = config)
...
```
Expand Down Expand Up @@ -83,7 +83,7 @@ and then use spark_connect with method = "databricks":

```R
install.packages("devtools")
devtools::install_url("https://mmlspark.azureedge.net/rrr/mmlspark-0.15.zip")
devtools::install_url("https://mmlspark.azureedge.net/rrr/mmlspark-0.16.zip")
library(sparklyr)
library(dplyr)
sc <- spark_connect(method = "databricks")
Expand Down
8 changes: 4 additions & 4 deletions docs/docker.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ You can now select one of the sample notebooks and run it, or create your own.
In the above, `microsoft/mmlspark` specifies the project and image name that you
want to run. There is another component implicit here which is the *tag* (=
version) that you want to use — specifying it explicitly looks like
`microsoft/mmlspark:0.15` for the `0.15` tag.
`microsoft/mmlspark:0.16` for the `0.16` tag.
Leaving `microsoft/mmlspark` by itself has an implicit `latest` tag, so it is
equivalent to `microsoft/mmlspark:latest`. The `latest` tag is identical to the
Expand All @@ -47,7 +47,7 @@ that you will probably want to use can look as follows:
-e ACCEPT_EULA=y \
-p 127.0.0.1:80:8888 \
-v ~/myfiles:/notebooks/myfiles \
microsoft/mmlspark:0.15
microsoft/mmlspark:0.16
```
In this example, backslashes are used to break things up for readability; you
Expand All @@ -59,7 +59,7 @@ path and line breaks looks a little different:
-e ACCEPT_EULA=y `
-p 127.0.0.1:80:8888 `
-v C:\myfiles:/notebooks/myfiles `
microsoft/mmlspark:0.15
microsoft/mmlspark:0.16
```
Let's break this command and go over the meaning of each part:
Expand Down Expand Up @@ -143,7 +143,7 @@ Let's break this command and go over the meaning of each part:
model.write().overwrite().save('myfiles/myTrainedModel.mml')
```
* **`microsoft/mmlspark:0.15`**
* **`microsoft/mmlspark:0.16`**
Finally, this specifies an explicit version tag for the image that we want to
run.
Expand Down
4 changes: 2 additions & 2 deletions docs/gpu-setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ to check availability in your data center.
MMLSpark provides an Azure Resource Manager (ARM) template to create a
default setup that includes an HDInsight cluster and a GPU machine for
training. The template can be found here:
<https://mmlspark.azureedge.net/buildartifacts/0.15/deploy-main-template.json>.
<https://mmlspark.azureedge.net/buildartifacts/0.16/deploy-main-template.json>.

It has the following parameters that configure the HDI Spark cluster and
the associated GPU VM:
Expand Down Expand Up @@ -69,7 +69,7 @@ GPU VM setup template at experimentation time.
### 1. Deploy an ARM template within the [Azure Portal](https://ms.portal.azure.com/)

[Click here to open the above main
template](https://portal.azure.com/#create/Microsoft.Template/uri/https%3A%2F%2Fmmlspark.azureedge.net%2Fbuildartifacts%2F0.15%2Fdeploy-main-template.json)
template](https://portal.azure.com/#create/Microsoft.Template/uri/https%3A%2F%2Fmmlspark.azureedge.net%2Fbuildartifacts%2F0.16%2Fdeploy-main-template.json)
in the Azure portal.

(If needed, you click the **Edit template** button to view and edit the
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -177,7 +177,7 @@ object URLEncodingUtils {
object CognitiveServiceUtils {

def setUA(req: HttpRequestBase): Unit = {
req.setHeader("User-Agent", "mmlspark/0.15")
req.setHeader("User-Agent", "mmlspark/0.16")
}
}

Expand Down

0 comments on commit 1d29394

Please sign in to comment.