Skip to content
Code Quality Checks

Allows interweaving of arbitrary kinds of 'attention' layers, like sliding window, reuse prev layer kv cache etc. #6566

Sign in to view logs

Allows interweaving of arbitrary kinds of 'attention' layers, like sliding window, reuse prev layer kv cache etc.

Allows interweaving of arbitrary kinds of 'attention' layers, like sliding window, reuse prev layer kv cache etc. #6566

Triggered via pull request June 24, 2024 19:25
@ShashankMosaicMLShashankMosaicML
synchronize #1299
ShashankMosaicML:mixed_attention_modules
Status Success
Total duration 7m 9s
Artifacts –

code-quality.yaml

on: pull_request
Matrix: code-quality
Fit to window
Zoom out
Zoom in

Annotations

2 warnings
code-quality (3.9, [dev])
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
code-quality (3.10, [dev])
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.