Skip to content
Code Quality Checks

Allows interweaving of arbitrary kinds of 'attention' layers, like sliding window, reuse prev layer kv cache etc. #6589

Sign in to view logs

Allows interweaving of arbitrary kinds of 'attention' layers, like sliding window, reuse prev layer kv cache etc.

Allows interweaving of arbitrary kinds of 'attention' layers, like sliding window, reuse prev layer kv cache etc. #6589

Triggered via pull request June 25, 2024 23:18
@ShashankMosaicMLShashankMosaicML
synchronize #1299
ShashankMosaicML:mixed_attention_modules
Status Cancelled
Total duration 1m 46s
Artifacts –

code-quality.yaml

on: pull_request
Matrix: code-quality
Fit to window
Zoom out
Zoom in

Annotations

2 errors
code-quality (3.9, [dev])
Canceling since a higher priority waiting request for 'Code Quality Checks-1299' exists
code-quality (3.10, [dev])
Canceling since a higher priority waiting request for 'Code Quality Checks-1299' exists