Skip to content

Commit

Permalink
modified: contents/home.md
Browse files Browse the repository at this point in the history
	modified:   contents/publications.md
  • Loading branch information
JerryYin777 committed Aug 9, 2024
1 parent 69c3f9b commit cf32fe8
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
4 changes: 2 additions & 2 deletions contents/home.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,11 +17,11 @@ I have experience in NLP and computer systems(both architecture and high perform

My current passion revolves around building **EFFICIENT** system solutions to AGI and LLM(VLM) for **RELIABLE** Hardware Design, this includes:

1. Machine Learning System
1. <strong><strong>Machine Learning System</strong></strong>
* Training: Design more effective training system and algorithms, examples include [BMTrain](https://github.com/OpenBMB/BMTrain).
* Quantization (e.g. Attempting to finetune Llama 3.1 405B on a single A100 80GB GPU), the other example includes [IAPT](https://arxiv.org/pdf/2405.18203).
* Long context inference: example includes [Cross Layer Attention](https://github.com/JerryYin777/Cross-Layer-Attention).
2. LLM(VLM) for RELIABLE Hardware Design
2. <strong><strong>LLM(VLM) for RELIABLE Hardware Design</strong></strong>
* Synthesise pretraining and finetuning common knowledge of CodeLLM, exploring the boundary capabilities of LLM/VLM for hardware design (e.g. pretrain/finetune a VerilogLLM).
* Align the simulation code with the waveform image data to finetune VerilogVLM.

Expand Down
2 changes: 1 addition & 1 deletion contents/publications.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
For full paper list (not now, but I'm sure there will be more great work in the future), please refer to my [Google Scholar](https://scholar.google.com/citations?user=7gsdLw4AAAAJ&hl=en)
For full paper list (not now, but I'm sure there will be more great work in the future), please refer to my [Google Scholar](https://scholar.google.com/citations?user=7gsdLw4AAAAJ&hl=en).

- *W. Zhu, Y. Ni, <strong><strong>C. Yin</strong></strong>, A. Tian, X. Wang, G. Xie. (2024). IAPT: Instance-Aware Prompt Turing for Large Language Models. The 62nd Annual Meeting of the Association for Computational Linguistics <strong><strong>(ACL 2024)</strong></strong>.*[[Paper]](https://arxiv.org/pdf/2405.18203)

Expand Down

0 comments on commit cf32fe8

Please sign in to comment.