Add docs pointing towards daft-launcher (in the distributed-computing…

… section)
Eventual-Inc · Nov 22, 2024 · 638b738 · 638b738
1 parent 60ae62f
commit 638b738
Show file tree

Hide file tree

Showing 7 changed files with 18 additions and 4 deletions.
diff --git a/.gitignore b/.gitignore
@@ -11,6 +11,7 @@ requirements.txt
 build
 .cython_build
 .hypothesis
+.ropeproject
 
 **/.ipynb_checkpoints/
 
@@ -36,7 +37,6 @@ log/
 # Added by pyenv
 .python-version
 
-
 # Zed editor
 .zed/
 

diff --git a/docs/source/conf.py b/docs/source/conf.py
@@ -96,7 +96,7 @@
     "learn/install": "../install.html",
     "learn/user_guides/dataframes": "intro-dataframes.html",
     "learn/user_guides/types_and_ops": "intro-dataframes.html",
-    "learn/user_guides/remote_cluster_execution": "distributed-computing.html",
+    "learn/user_guides/remote_cluster_execution": "user_guide/distributed-computing",
     "learn/quickstart": "learn/10-min.html",
     "learn/10-min": "../10-min.html",
     "user_guide/basic_concepts/expressions": "user_guide/expressions",

diff --git a/docs/source/migration_guides/coming_from_dask.rst b/docs/source/migration_guides/coming_from_dask.rst
@@ -118,7 +118,7 @@ Dask supports the same data types as pandas. Daft is built to support many more
 Distributed Computing and Remote Clusters
 -----------------------------------------
 
-Both Dask and Daft support distributed computing on remote clusters. In Dask, you create a Dask cluster either locally or remotely and perform computations in parallel there. Currently, Daft supports distributed cluster computing :doc:`with Ray <../user_guide/poweruser/distributed-computing>`. Support for running Daft computations on Dask clusters is on the roadmap.
+Both Dask and Daft support distributed computing on remote clusters. In Dask, you create a Dask cluster either locally or remotely and perform computations in parallel there. Currently, Daft supports distributed cluster computing :doc:`with Ray <../user_guide/distributed-computing>`. Support for running Daft computations on Dask clusters is on the roadmap.
 
 Cloud support for both Dask and Daft is the same.
 

diff --git a/...guide/poweruser/distributed-computing.rst → ...urce/user_guide/distributed-computing.rst b/...guide/poweruser/distributed-computing.rst → ...urce/user_guide/distributed-computing.rst
@@ -67,3 +67,7 @@ You can take the IP address and port and pass it to Daft:
     ╰───────╯
 
     (Showing first 2 of 2 rows)
+
+.. toctree::
+
+    distributed-computing/daft-launcher
diff --git a/docs/source/user_guide/distributed-computing/daft-launcher.rst b/docs/source/user_guide/distributed-computing/daft-launcher.rst
@@ -0,0 +1,10 @@
+Daft Launcher
+=====================
+
+Getting started with running daft at a distributed scale can be tough.
+Therefore, we've created a simple, open-sourced launcher to help you get started.
+
+The tool, `daft-launcher <https://github.com/Eventual-Inc/daft-launcher>`_, is open-sourced and available to be run today!
+To install it, you can run ``pip install daft-launcher`` (or using ``uv``, you can run ``uv pip install daft-launcher``).
+
+To get started with it, please refer to our MDBook documentation, available `here <https://eventual-inc.github.io/daft-launcher/>`_.
diff --git a/docs/source/user_guide/index.rst b/docs/source/user_guide/index.rst
@@ -10,6 +10,7 @@ Daft User Guide
     expressions
     datatypes
     dataframe-operations
+    distributed-computing
     sql
     aggregations
     udf

diff --git a/docs/source/user_guide/poweruser.rst b/docs/source/user_guide/poweruser.rst
@@ -5,4 +5,3 @@ The Daft Poweruser
 
     poweruser/memory
     poweruser/partitioning
-    poweruser/distributed-computing
Original file line number	Diff line number	Diff line change
Expand Up		@@ -5,4 +5,3 @@ The Daft Poweruser

		poweruser/memory
		poweruser/partitioning
		poweruser/distributed-computing