Skip to content

Commit

Permalink
Merge pull request #125 from FederatedAI/feature-2.2.0-update_doc
Browse files Browse the repository at this point in the history
add readme to fdkt
  • Loading branch information
mgqa34 authored Aug 2, 2024
2 parents 9e88bb4 + 2ff4b06 commit e5eb458
Show file tree
Hide file tree
Showing 4 changed files with 19 additions and 5 deletions.
14 changes: 14 additions & 0 deletions doc/tutorial/fdkt/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
# FATE-LLM: FDKT
The algorithm is based on paper [Federated Domain-Specific Knowledge Transfer on Large Language Models Using Synthetic Data](https://arxiv.org/pdf/2405.14212),
a novel framework that enables domain-specific knowledge transfer from LLMs to SLMs while preserving SLM data privacy.

## Citation
If you publish work that uses FDKT, please cite FDKT as follows:
```
@article{li2024federated,
title={Federated Domain-Specific Knowledge Transfer on Large Language Models Using Synthetic Data},
author={Li, Haoran and Zhao, Xinyuan and Guo, Dadi and Gu, Hanlin and Zeng, Ziqian and Han, Yuxing and Song, Yangqiu and Fan, Lixin and Yang, Qiang},
journal={arXiv preprint arXiv:2405.14212},
year={2024}
}
```
2 changes: 1 addition & 1 deletion doc/tutorial/fdkt/fdkt.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -528,7 +528,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"## Running FEDMKT with Pipeline (Industrial Using)"
"## Running FDKT with Pipeline (Industrial Using)"
]
},
{
Expand Down
4 changes: 2 additions & 2 deletions doc/tutorial/fedmkt/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# FATE-LLM: FedMKT

The Algorithm is based on paper ["FedMKT: Federated Mutual Knowledge Transfer for Large and SmallLanguage Models"](https://arxiv.org/pdf/2406.02224), We integrate its code into the FATE-LLM framework.
The algorithm is based on paper ["FedMKT: Federated Mutual Knowledge Transfer for Large and SmallLanguage Models"](https://arxiv.org/pdf/2406.02224), We integrate its code into the FATE-LLM framework.

## Citation
If you publish work that uses FedMKT, please cite FedMKT as follows:
Expand All @@ -11,4 +11,4 @@ If you publish work that uses FedMKT, please cite FedMKT as follows:
journal={arXiv preprint arXiv:2406.02224},
year={2024}
}
```
```
4 changes: 2 additions & 2 deletions doc/tutorial/pdss/README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# FATE-LLM: PDSS
The Algorithm is based on paper ["PDSS: A Privacy-Preserving Framework for Step-by-Step Distillation of Large Language Models"](https://arxiv.org/pdf/2406.12403), which introduce a novel framework for privacy preserving federated distillation. We integrate its code into the FATE-LLM framework.
The algorithm is based on paper ["PDSS: A Privacy-Preserving Framework for Step-by-Step Distillation of Large Language Models"](https://arxiv.org/pdf/2406.12403), which introduce a novel framework for privacy preserving federated distillation. We integrate its code into the FATE-LLM framework.

## Citation
If you publish work that uses PDSS, please cite PDSS as follows:
Expand All @@ -10,4 +10,4 @@ If you publish work that uses PDSS, please cite PDSS as follows:
journal={arXiv preprint arXiv:2406.12403},
year={2024}
}
```
```

0 comments on commit e5eb458

Please sign in to comment.