Merge remote-tracking branch 'origin/master'

README.md

@@ -42,7 +42,7 @@ It mainly has the following characteristics:
 
 ## 🎉 News
 * 🔥🔥🔥Aug 8, 2024: A new graph based code generation tool [CodexGraph](https://arxiv.org/abs/2408.03910) is released by Modelscope-Agent, it has been proved effective and versatile on various code related tasks, please check [example](https://github.com/modelscope/modelscope-agent/tree/master/apps/codexgraph_agent).
-* 🔥🔥Aug 1, 2024: A high efficient and reliable Data Science Assistant is running on Modelscope-Agent, please find detail in [example](https://github.com/modelscope/modelscope-agent/blob/master/examples/agents/data_science_assistant.ipynb).
+* 🔥🔥Aug 1, 2024: A high efficient and reliable Data Science Assistant is running on Modelscope-Agent, please find detail in [example](https://github.com/modelscope/modelscope-agent/tree/master/apps/datascience_assistant).
 * 🔥July 17, 2024: Parallel tool calling on Modelscope-Agent-Server, please find detail in [doc](https://github.com/modelscope/modelscope-agent/blob/master/modelscope_agent_servers/README.md).
 * 🔥June 17, 2024: Upgrading RAG flow based on LLama-index, allow user to hybrid search knowledge by different strategies and modalities, please find detail in [doc](https://github.com/modelscope/modelscope-agent/blob/master/modelscope_agent/rag/README_zh.md).
 * 🔥June 6, 2024: With [Modelscope-Agent-Server](https://github.com/modelscope/modelscope-agent/blob/master/modelscope_agent_servers/README.md), **Qwen2** could be used by OpenAI SDK with tool calling ability, please find detail in [doc](https://github.com/modelscope/modelscope-agent/blob/master/docs/llms/qwen2_tool_calling.md).

README_CN.md

@@ -41,7 +41,7 @@ Modelscope-Agent是一个可定制的、可扩展的Agent代码框架。单Agent
 
 ## 更新
 * 🔥🔥🔥Aug 8, 2024: 基于Graph的[CodexGraph](https://arxiv.org/abs/2408.03910)代码生成工具依赖Modelscope-Agent上线, 目前在多个代码生成、补全任务上展示了有效性和通用性，请查看[使用示例](https://github.com/modelscope/modelscope-agent/tree/master/apps/codexgraph_agent).
-* 🔥🔥Aug 1, 2024: Modelscope-Agent目前支持了高性能的且效果可靠的数据科学助理, 请查看[使用示例](https://github.com/modelscope/modelscope-agent/blob/master/examples/agents/data_science_assistant.ipynb).
+* 🔥🔥Aug 1, 2024: Modelscope-Agent目前支持了高性能的且效果可靠的数据科学助理, 请查看[使用示例](https://github.com/modelscope/modelscope-agent/tree/master/apps/datascience_assistant).
 * 🔥July 17, 2024: Modelscope-Agent-Server支持并行工具生成(parallel_tool_calls)[doc](https://github.com/modelscope/modelscope-agent/blob/master/modelscope_agent_servers/README.md).
 * 🔥June 17, 2024: 基于llama-index的RAG链路升级，支持混合搜索（多策略，多模态），相关详情具体参考[文档](https://github.com/modelscope/modelscope-agent/blob/master/modelscope_agent/rag/README_zh.md).
 * 🔥June 6, 2024: 通过利用[Modelscope-Agent-Server](https://github.com/modelscope/modelscope-agent/blob/master/modelscope_agent_servers/README.md)，**Qwen2**可以通过OpenAI的SDK实现tool calling的能力，具体参考[文档](https://github.com/modelscope/modelscope-agent/blob/master/docs/llms/qwen2_tool_calling.md).

apps/datascience_assistant/README.md

@@ -6,21 +6,27 @@ Detailed information can be found in the [documentation](../../docs/source/agent
 ## Quick Start
 Streamlit is a Python library that makes it easy to create and share beautiful, custom web apps for machine learning and data science.
 
-To run the DS Assistant in streamlit, you need to install the Streamlit library. You can install it using pip:
+To run the DS Assistant in streamlit, you need to install additional libraries. You can install it using pip:
 ```bash
-pip install streamlit streamlit-jupyter
+pip install streamlit mistune matplotlib nbconvert
 ```
-Then, you need to set
+
 Then, you can run the DS Assistant using the following command:
 ```bash
-streamlit run app.py
+cd ../../
+streamlit run ./apps/datascience_assistant/app.py
 ```
 
 After running the command, a new tab will open in your default web browser with the DS Assistant running.
-The following are screenshots of the DS Assistant running in the browser:
 
+you can upload your dataset and write your request.
 ![img_2.png](../../resources/data_science_assistant_streamlit_1.png)
-you can view all of the codes and  in streamlit
+
+After submitting your request, DS Assistant will automatically generate a plan for this request.
+![img_2.png](../../resources/data_science_assistant_streamlit_4.png)
+
+After that, DS Assistant will automatically excute every task, you can view all of the codes and details in streamlit
 ![img_3.png](../../resources/data_science_assistant_streamlit_2.png)
+
 After you have finished using the DS Assistant, you can directly convert the running process to a pdf
 ![img_5.png](../../resources/data_science_assistant_streamlit_3.png)

apps/datascience_assistant/app.py

@@ -1,23 +1,45 @@
 import os
+import sys
 
 import streamlit as st
-from modelscope_agent.agents.data_science_assistant import DataScienceAssistant
-from modelscope_agent.tools.metagpt_tools.tool_recommend import \
-    TypeMatchToolRecommender
 
-llm_config = {
-    'model': 'qwen2-72b-instruct',
-    'model_server': 'dashscope',
-}
-os.environ['DASHSCOPE_API_KEY'] = input(
-    'Please input your dashscope api key: ')
-data_science_assistant = DataScienceAssistant(
-    llm=llm_config, tool_recommender=TypeMatchToolRecommender(tools=['<all>']))
-st.title('Data Science Assistant')
-st.write(
-    'This is a data science assistant that can help you with your data science tasks.'
-)
-st.write('Please input your request below and click the submit button.')
-user_request = st.text_input('User Request')
-if st.button('submit'):
-    data_science_assistant.run(user_request=user_request, streamlit=True)
+os.environ['DASHSCOPE_API_KEY'] = 'YOUR_API_KEY'
+
+
+def setup_project_paths():
+    current_dir = os.path.dirname(os.path.abspath(__file__))  # noqa
+    project_root_path = os.path.abspath(os.path.join(current_dir,
+                                                     '../../'))  # noqa
+    sys.path.append(project_root_path)  # noqa
+
+
+if __name__ == '__main__':
+    setup_project_paths()
+    from modelscope_agent.agents.data_science_assistant import \
+        DataScienceAssistant  # noqa
+    from modelscope_agent.tools.metagpt_tools.tool_recommend import \
+        TypeMatchToolRecommender  # noqa
+    st.title('Data Science Assistant')
+    st.write(
+        'This is a data science assistant that can help you with your data science tasks.'
+    )
+    st.write(
+        'Please input your request and upload files then click the submit button.'
+    )
+
+    files = st.file_uploader(
+        'Please upload files that you need. ', accept_multiple_files=True)
+    last_file_name = ''
+    user_request = st.text_area('User Request')
+    if st.button('submit'):
+        llm_config = {
+            'model': 'qwen2-72b-instruct',
+            'model_server': 'dashscope',
+        }
+        data_science_assistant = DataScienceAssistant(
+            llm=llm_config,
+            tool_recommender=TypeMatchToolRecommender(tools=['<all>']))
+        for file in files:
+            with open(file.name, 'wb') as f:
+                f.write(file.getbuffer())
+        data_science_assistant.run(user_request=user_request, streamlit=True)