New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

About develop branch #1

Open

2 tasks done

suaaa7 opened this issue Dec 14, 2019 · 2 comments

Assignees

Owner

suaaa7 commented Dec 14, 2019 •

edited

Loading

Development items

Add sbt
Add Batch

suaaa7 self-assigned this

suaaa7 mentioned this issue

Add SparkMLLrBatch #2

Merged

Owner Author

suaaa7 commented Dec 31, 2019

Update README

Owner Author

suaaa7 commented Jan 6, 2020 •

edited

Loading

参考

Spark MLとBreezeでロジスティック回帰
https://qiita.com/mura-s/items/29ccdc7cfebf866d47a2

ローカルのSparkでS3のファイルを扱う
https://qiita.com/uryyyyyyy/items/b1f7a9fea928e1003602

How to pass -D parameter or environment variable to Spark job?
https://stackoverflow.com/questions/28166667/how-to-pass-d-parameter-or-environment-variable-to-spark-job

Serializable Custom Transformer with Spark 2.0 (Scala)
https://qikaigu.com/serializable-custom-transformer-with-spark-2/

LogrithmicTransformer
https://github.com/czehoul/mobileapps-ads-attribution/blob/dbb157e6a6580847dd73001999c64a0489e25936/SparkML/src/main/scala/com/yee/talking/LogTransformer.scala

Extend Spark ML for your own model/transformer types
https://www.oreilly.com/learning/extend-spark-ml-for-your-own-modeltransformer-types

https://docs.databricks.com/applications/machine-learning/mllib/advanced-mllib.html

https://github.com/starcolon/spark-ml-kaggle/blob/97edbc67381d249547c5d380e5e0f892a6c04215/common/src/main/scala/com/starcolon/ml/transformers/data.scala

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment