Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[wip] Updating build process for speed #249

Draft
wants to merge 18 commits into
base: main
Choose a base branch
from
Draft

[wip] Updating build process for speed #249

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
189be95
updating cargo build to use --frozen
rswanson Jan 13, 2023
e6b0e74
updating rust.yml to use --frozen
rswanson Jan 13, 2023
ee33ad5
going back to --locked for now
rswanson Jan 13, 2023
1eccf09
new caching
rswanson Jan 13, 2023
317f860
updating hashing inputs
rswanson Jan 13, 2023
6a0ac3d
reorder the workflows so the cache get setup properly
rswanson Jan 13, 2023
569cd4e
switching to cargo check
rswanson Jan 13, 2023
efbb616
stepping towards sccache
rswanson Jan 13, 2023
2dcf7ea
yolo sccache
rswanson Jan 13, 2023
ee128a3
missed an env
rswanson Jan 13, 2023
d0c9ddc
bumping version
rswanson Jan 13, 2023
b2af67d
bumping version correctly
rswanson Jan 13, 2023
780d7a8
tweaking caching a bit more
rswanson Jan 13, 2023
8108ae0
fixing syntax
rswanson Jan 13, 2023
02029c4
minor scache tweak and bump version
rswanson Jan 13, 2023
38176dc
trying to split it back now lets see
rswanson Jan 14, 2023
9e05d92
trying to split it back now lets see
rswanson Jan 14, 2023
3feda7d
forgot to shutdown the server
rswanson Jan 14, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 9 additions & 4 deletions .github/workflows/docker.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,13 +19,18 @@ jobs:
- uses: actions-rs/toolchain@v1
with:
toolchain: stable
- uses: Swatinem/rust-cache@v1
- uses: actions/cache@v3
with:
# Add a key to prevent rust cache collision with rust.yml workflows
key: 'release'
path: |
~/.cargo/bin/
~/.cargo/registry/index/
~/.cargo/registry/cache/
~/.cargo/git/db/
target/
key: ${{ runner.os }}-cargo-${{ hashFiles('**/Cargo.lock', '**/rust-toolchain') }}

- name: Build agents (release)
run: cargo build --release
run: cargo build --release --locked --workspace --all-features --verbose

- name: Docker metadata
id: meta
Expand Down
162 changes: 153 additions & 9 deletions .github/workflows/rust.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,53 +17,197 @@ env:
jobs:
build:
runs-on: ubuntu-22.04
env:
RUSTC_WRAPPER: sccache
SCCACHE_CACHE_SIZE: 2G
SCCACHE_DIR: /home/runner/.cargo/bin/sccache
steps:
- uses: actions/checkout@v2
- uses: actions-rs/toolchain@v1
with:
toolchain: stable
- uses: Swatinem/rust-cache@v1

- name: install sccache
env:
LINK: https://github.com/mozilla/sccache/releases/download
SCCACHE_VERSION: v0.3.3
run: |
SCCACHE_FILE=sccache-$SCCACHE_VERSION-x86_64-unknown-linux-musl
mkdir -p $HOME/.local/bin
curl -L "$LINK/$SCCACHE_VERSION/$SCCACHE_FILE.tar.gz" | tar xz
mv -f $SCCACHE_FILE/sccache $HOME/.local/bin/sccache
echo "$HOME/.local/bin" >> $GITHUB_PATH
- name: Cache cargo registry
uses: actions/cache@v3
continue-on-error: false
with:
path: |
~/.cargo/registry
~/.cargo/git
key: ${{ runner.os }}-cargo-${{ hashFiles('**/Cargo.lock', '**/rust-environment') }}
restore-keys: |
${{ runner.os }}-cargo-
- name: Save sccache
uses: actions/cache@v3
continue-on-error: false
with:
path: /home/runner/.cargo/bin/sccache
key: ${{ runner.os }}-sccache-${{ hashFiles('**/Cargo.lock', '**/rust-environment') }}
restore-keys: |
${{ runner.os }}-sccache-
- name: Start sccache server
run: sccache --start-server
- name: Build agents
run: cargo build --locked --workspace --all-features --verbose

run: cargo check --locked --workspace --all-features --verbose
- name: Print sccache stats
run: sccache --show-stats
- name: Stop sccache server
run: sccache --stop-server || true
test:
runs-on: ubuntu-22.04
env:
RUSTC_WRAPPER: sccache
SCCACHE_CACHE_SIZE: 2G
SCCACHE_DIR: /home/runner/.cargo/bin/sccache
steps:
- uses: actions/checkout@v2
- uses: actions-rs/toolchain@v1
with:
toolchain: stable
- uses: Swatinem/rust-cache@v1

- name: install sccache
env:
LINK: https://github.com/mozilla/sccache/releases/download
SCCACHE_VERSION: v0.3.3
run: |
SCCACHE_FILE=sccache-$SCCACHE_VERSION-x86_64-unknown-linux-musl
mkdir -p $HOME/.local/bin
curl -L "$LINK/$SCCACHE_VERSION/$SCCACHE_FILE.tar.gz" | tar xz
mv -f $SCCACHE_FILE/sccache $HOME/.local/bin/sccache
echo "$HOME/.local/bin" >> $GITHUB_PATH
- name: Cache cargo registry
uses: actions/cache@v3
continue-on-error: false
with:
path: |
~/.cargo/registry
~/.cargo/git
key: ${{ runner.os }}-cargo-${{ hashFiles('**/Cargo.lock', '**/rust-environment') }}
restore-keys: |
${{ runner.os }}-cargo-
- name: Save sccache
uses: actions/cache@v3
continue-on-error: false
with:
path: /home/runner/.cargo/bin/sccache
key: ${{ runner.os }}-sccache-${{ hashFiles('**/Cargo.lock', '**/rust-environment') }}
restore-keys: |
${{ runner.os }}-sccache-
- name: Start sccache server
run: sccache --start-server
- name: Run tests
run: cargo test --locked --workspace --all-features --verbose
- name: Print sccache stats
run: sccache --show-stats
- name: Stop sccache server
run: sccache --stop-server || true

lint:
runs-on: ubuntu-22.04
env:
RUSTC_WRAPPER: sccache
SCCACHE_CACHE_SIZE: 2G
SCCACHE_DIR: /home/runner/.cargo/bin/sccache
steps:
- uses: actions/checkout@v2
- uses: actions-rs/toolchain@v1
with:
toolchain: stable
- uses: Swatinem/rust-cache@v1
- name: install sccache
env:
LINK: https://github.com/mozilla/sccache/releases/download
SCCACHE_VERSION: v0.3.3
run: |
SCCACHE_FILE=sccache-$SCCACHE_VERSION-x86_64-unknown-linux-musl
mkdir -p $HOME/.local/bin
curl -L "$LINK/$SCCACHE_VERSION/$SCCACHE_FILE.tar.gz" | tar xz
mv -f $SCCACHE_FILE/sccache $HOME/.local/bin/sccache
echo "$HOME/.local/bin" >> $GITHUB_PATH
- name: Cache cargo registry
uses: actions/cache@v3
continue-on-error: false
with:
path: |
~/.cargo/registry
~/.cargo/git
key: ${{ runner.os }}-cargo-${{ hashFiles('**/Cargo.lock', '**/rust-environment') }}
restore-keys: |
${{ runner.os }}-cargo-
- name: Save sccache
uses: actions/cache@v3
continue-on-error: false
with:
path: /home/runner/.cargo/bin/sccache
key: ${{ runner.os }}-sccache-${{ hashFiles('**/Cargo.lock', '**/rust-environment') }}
restore-keys: |
${{ runner.os }}-sccache-
- name: Start sccache server
run: sccache --start-server

- name: Rustfmt
run: cargo fmt --all -- --check

- name: Clippy
run: cargo clippy --workspace --all-features -- -D warnings
- name: Print sccache stats
run: sccache --show-stats
- name: Stop sccache server
run: sccache --stop-server || true

wasm-build:
runs-on: ubuntu-22.04
env:
RUSTC_WRAPPER: sccache
SCCACHE_CACHE_SIZE: 2G
SCCACHE_DIR: /home/runner/.cargo/bin/sccache
steps:
- uses: actions/checkout@v2
- uses: actions-rs/toolchain@v1
with:
toolchain: stable
- uses: Swatinem/rust-cache@v1
- name: install sccache
env:
LINK: https://github.com/mozilla/sccache/releases/download
SCCACHE_VERSION: v0.3.3
run: |
SCCACHE_FILE=sccache-$SCCACHE_VERSION-x86_64-unknown-linux-musl
mkdir -p $HOME/.local/bin
curl -L "$LINK/$SCCACHE_VERSION/$SCCACHE_FILE.tar.gz" | tar xz
mv -f $SCCACHE_FILE/sccache $HOME/.local/bin/sccache
echo "$HOME/.local/bin" >> $GITHUB_PATH
- name: Cache cargo registry
uses: actions/cache@v3
continue-on-error: false
with:
path: |
~/.cargo/registry
~/.cargo/git
key: ${{ runner.os }}-cargo-${{ hashFiles('**/Cargo.lock', '**/rust-environment') }}
restore-keys: |
${{ runner.os }}-cargo-
- name: Save sccache
uses: actions/cache@v3
continue-on-error: false
with:
path: /home/runner/.cargo/bin/sccache
key: ${{ runner.os }}-sccache-${{ hashFiles('**/Cargo.lock', '**/rust-environment') }}
restore-keys: |
${{ runner.os }}-sccache-
- name: Start sccache server
run: sccache --start-server
- uses: jetli/[email protected]
- name: wasm-configuration
run: cd configuration && bash package_it.sh
- name: wasm-accumulator
run: cd accumulator && bash package_it.sh
- name: Print sccache stats
run: sccache --show-stats
- name: Stop sccache server
run: sccache --stop-server || true