continuwuation/continuwuity
continuwuation/continuwuity
13
35
Fork 34
Code Issues 103 Pull requests 21 Releases 20 Packages 3 Activity Actions 1

ci: Fix BuildKit cache invalidation and add Haswell-optimised builds #1012

Merged
tcpipuk merged 1 commit from tom/haswell into main 2025-09-11 14:31:43 +00:00
Conversation 3 Commits 1 Files changed 2 +50 -28
tcpipuk commented 2025-09-11 11:31:47 +00:00
Owner
Copy link

The workflow was rebuilding dependencies unnecessarily despite timelord restoring timestamps because TARGET_CPU and RUST_PROFILE weren't passed to Docker, creating inconsistent cache keys. Now passes both arguments for proper cache reuse.

Adds x86-64-v3 optimised builds alongside baseline builds. Recent build improvements reducing compile times from 15-20 minutes to ~5 minutes make this additional CPU variant feasible.

Users can pull performance-optimised images with -haswell suffix (e.g. main-haswell, pr-123-haswell).

The workflow was rebuilding dependencies unnecessarily despite timelord restoring timestamps because TARGET_CPU and RUST_PROFILE weren't passed to Docker, creating inconsistent cache keys. Now passes both arguments for proper cache reuse. Adds x86-64-v3 optimised builds alongside baseline builds. Recent build improvements reducing compile times from 15-20 minutes to ~5 minutes make this additional CPU variant feasible. Users can pull performance-optimised images with -haswell suffix (e.g. main-haswell, pr-123-haswell).
tcpipuk self-assigned this 2025-09-11 11:31:47 +00:00
Jade approved these changes 2025-09-11 11:34:51 +00:00
Jade left a comment
Owner
Copy link

ayyyy

ayyyy
Jade changed title from ci: Fix BuildKit cache invalidation and add Haswell-optimised builds to WIP: ci: Fix BuildKit cache invalidation and add Haswell-optimised builds 2025-09-11 11:35:13 +00:00
tcpipuk force-pushed tom/haswell from 4d6e9a9ae4
Some checks failed
Release Docker Image / define-variables (pull_request) Has been cancelled
Details
Release Docker Image / Build linux-amd64 (pull_request) Has been cancelled
Details
Release Docker Image / Build linux-arm64 (pull_request) Has been cancelled
Details
Release Docker Image / Build linux-amd64-haswell (pull_request) Has been cancelled
Details
Release Docker Image / Build (pull_request) Has been cancelled
Details
Release Docker Image / merge () (pull_request) Has been cancelled
Details
Release Docker Image / merge (-haswell) (pull_request) Has been cancelled
Details
Documentation / Build and Deploy Documentation (pull_request) Successful in 36s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m5s
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 8m28s
Details
to da124fbb55
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Successful in 42s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m27s
Details
Release Docker Image / define-variables (pull_request) Successful in 2s
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 7m4s
Details
Release Docker Image / Build linux-amd64 (pull_request) Successful in 9m33s
Details
Release Docker Image / Build linux-amd64-haswell (pull_request) Failing after 4m46s
Details
Release Docker Image / Build linux-arm64 (pull_request) Successful in 9m6s
Details
Release Docker Image / Create Multi-arch Manifest (pull_request) Has been skipped
Details
Release Docker Image / Create Haswell Manifest (pull_request) Has been skipped
Details
2025-09-11 11:36:43 +00:00 Compare
tcpipuk force-pushed tom/haswell from da124fbb55
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Successful in 42s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m27s
Details
Release Docker Image / define-variables (pull_request) Successful in 2s
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 7m4s
Details
Release Docker Image / Build linux-amd64 (pull_request) Successful in 9m33s
Details
Release Docker Image / Build linux-amd64-haswell (pull_request) Failing after 4m46s
Details
Release Docker Image / Build linux-arm64 (pull_request) Successful in 9m6s
Details
Release Docker Image / Create Multi-arch Manifest (pull_request) Has been skipped
Details
Release Docker Image / Create Haswell Manifest (pull_request) Has been skipped
Details
to 0d314c4099
All checks were successful
Release Docker Image / define-variables (pull_request) Successful in 7s
Details
Documentation / Build and Deploy Documentation (pull_request) Successful in 44s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m29s
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 6m38s
Details
Release Docker Image / Build linux-amd64 (pull_request) Successful in 7m29s
Details
Release Docker Image / Build linux-arm64 (pull_request) Successful in 6m36s
Details
Release Docker Image / Build linux-amd64-haswell (pull_request) Successful in 10m3s
Details
Release Docker Image / Create Haswell Manifest (pull_request) Successful in 14s
Details
Release Docker Image / Create Multi-arch Manifest (pull_request) Successful in 10s
Details
2025-09-11 11:56:06 +00:00 Compare
tcpipuk force-pushed tom/haswell from 0d314c4099
All checks were successful
Release Docker Image / define-variables (pull_request) Successful in 7s
Details
Documentation / Build and Deploy Documentation (pull_request) Successful in 44s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m29s
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 6m38s
Details
Release Docker Image / Build linux-amd64 (pull_request) Successful in 7m29s
Details
Release Docker Image / Build linux-arm64 (pull_request) Successful in 6m36s
Details
Release Docker Image / Build linux-amd64-haswell (pull_request) Successful in 10m3s
Details
Release Docker Image / Create Haswell Manifest (pull_request) Successful in 14s
Details
Release Docker Image / Create Multi-arch Manifest (pull_request) Successful in 10s
Details
to 2e2ab2208e
Some checks failed
Release Docker Image / define-variables (pull_request) Successful in 12s
Details
Documentation / Build and Deploy Documentation (pull_request) Successful in 34s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m0s
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Has been cancelled
Details
Release Docker Image / Build linux-amd64 (pull_request) Successful in 7m30s
Details
Release Docker Image / Build linux-arm64 (pull_request) Successful in 6m29s
Details
Release Docker Image / Build linux-amd64-1 (pull_request) Successful in 9m46s
Details
Release Docker Image / Create Haswell Manifest (pull_request) Has been cancelled
Details
Release Docker Image / Create Multi-arch Manifest (pull_request) Has been cancelled
Details
2025-09-11 12:15:49 +00:00 Compare
tcpipuk force-pushed tom/haswell from 2e2ab2208e
Some checks failed
Release Docker Image / define-variables (pull_request) Successful in 12s
Details
Documentation / Build and Deploy Documentation (pull_request) Successful in 34s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m0s
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Has been cancelled
Details
Release Docker Image / Build linux-amd64 (pull_request) Successful in 7m30s
Details
Release Docker Image / Build linux-arm64 (pull_request) Successful in 6m29s
Details
Release Docker Image / Build linux-amd64-1 (pull_request) Successful in 9m46s
Details
Release Docker Image / Create Haswell Manifest (pull_request) Has been cancelled
Details
Release Docker Image / Create Multi-arch Manifest (pull_request) Has been cancelled
Details
to 97fa07961e
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Successful in 44s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m13s
Details
Release Docker Image / define-variables (pull_request) Successful in 1s
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 5m45s
Details
Release Docker Image / Build linux-amd64 (pull_request) Successful in 5m36s
Details
Release Docker Image / Build linux-arm64 (pull_request) Successful in 6m15s
Details
Release Docker Image / Build linux-amd64-haswell (pull_request) Failing after 18m14s
Details
Release Docker Image / Create Haswell Manifest (pull_request) Has been skipped
Details
Release Docker Image / Create Multi-arch Manifest (pull_request) Has been skipped
Details
2025-09-11 12:21:04 +00:00 Compare
tcpipuk force-pushed tom/haswell from 97fa07961e
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Successful in 44s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m13s
Details
Release Docker Image / define-variables (pull_request) Successful in 1s
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 5m45s
Details
Release Docker Image / Build linux-amd64 (pull_request) Successful in 5m36s
Details
Release Docker Image / Build linux-arm64 (pull_request) Successful in 6m15s
Details
Release Docker Image / Build linux-amd64-haswell (pull_request) Failing after 18m14s
Details
Release Docker Image / Create Haswell Manifest (pull_request) Has been skipped
Details
Release Docker Image / Create Multi-arch Manifest (pull_request) Has been skipped
Details
to a13f0eddaf
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Successful in 31s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m1s
Details
Release Docker Image / define-variables (pull_request) Successful in 1s
Details
Release Docker Image / Build linux-amd64 (pull_request) Has been cancelled
Details
Release Docker Image / Build linux-amd64-haswell (pull_request) Has been cancelled
Details
Release Docker Image / Build linux-arm64 (pull_request) Has been cancelled
Details
Release Docker Image / Create Haswell Manifest (pull_request) Has been cancelled
Details
Release Docker Image / Create Multi-arch Manifest (pull_request) Has been cancelled
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Has been cancelled
Details
2025-09-11 12:49:46 +00:00 Compare
tcpipuk force-pushed tom/haswell from a13f0eddaf
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Successful in 31s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m1s
Details
Release Docker Image / define-variables (pull_request) Successful in 1s
Details
Release Docker Image / Build linux-amd64 (pull_request) Has been cancelled
Details
Release Docker Image / Build linux-amd64-haswell (pull_request) Has been cancelled
Details
Release Docker Image / Build linux-arm64 (pull_request) Has been cancelled
Details
Release Docker Image / Create Haswell Manifest (pull_request) Has been cancelled
Details
Release Docker Image / Create Multi-arch Manifest (pull_request) Has been cancelled
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Has been cancelled
Details
to 9c147b182f
All checks were successful
Documentation / Build and Deploy Documentation (pull_request) Successful in 35s
Details
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 1m50s
Details
Release Docker Image / define-variables (pull_request) Successful in 6s
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 7m41s
Details
Release Docker Image / Build linux-amd64 (pull_request) Successful in 4m57s
Details
Release Docker Image / Build linux-arm64 (pull_request) Successful in 4m47s
Details
Release Docker Image / Build linux-amd64-haswell (pull_request) Successful in 1m50s
Details
Release Docker Image / Create Haswell Manifest (pull_request) Successful in 13s
Details
Release Docker Image / Create Multi-arch Manifest (pull_request) Successful in 14s
Details
Documentation / Build and Deploy Documentation (push) Successful in 40s
Details
Checks / Prek / Pre-commit & Formatting (push) Successful in 52s
Details
Release Docker Image / define-variables (push) Successful in 2s
Details
Release Docker Image / Build linux-arm64 (push) Successful in 1m43s
Details
Checks / Prek / Clippy and Cargo Tests (push) Successful in 4m37s
Details
Release Docker Image / Build linux-amd64 (push) Successful in 2m41s
Details
Release Docker Image / Build linux-amd64-haswell (push) Successful in 2m36s
Details
Release Docker Image / Create Multi-arch Manifest (push) Successful in 9s
Details
Release Docker Image / Create Haswell Manifest (push) Successful in 14s
Details
2025-09-11 13:01:18 +00:00 Compare
tcpipuk changed title from WIP: ci: Fix BuildKit cache invalidation and add Haswell-optimised builds to ci: Fix BuildKit cache invalidation and add Haswell-optimised builds 2025-09-11 14:14:24 +00:00
tcpipuk commented 2025-09-11 14:15:19 +00:00
Author
Owner
Copy link

I am running the current forgejo.ellis.link/continuwuation/continuwuity:pr-1012-head-haswell image and it seems to be running fine 🙂

I am running the current `forgejo.ellis.link/continuwuation/continuwuity:pr-1012-head-haswell` image and it seems to be running fine 🙂
tcpipuk deleted branch tom/haswell 2025-09-11 14:31:43 +00:00
Jade reviewed 2025-09-11 15:57:27 +00:00
.forgejo/workflows/release-image.yml
@ -92,2 +95,4 @@
profile: "release"
steps:
- name: Set CPU suffix variable
Jade commented 2025-09-11 15:57:27 +00:00
Owner
Copy link

@tcpipuk You don't need the bash script here - ${{ matrix.target_cpu && format('-{0}', ${{ matrix.target_cpu }}) || '' }} should work I think

@tcpipuk You don't need the bash script here - `${{ matrix.target_cpu && format('-{0}', ${{ matrix.target_cpu }}) || '' }}` should work I think
Jade commented 2025-09-11 15:58:22 +00:00
Owner
Copy link

oh you even have it in the job name lol

oh you even have it in the job name lol
Sign in to join this conversation.
Reviewers
No reviewers
Jade
Labels
Clear labels   
Bug

Something isn't working as intended

  
Cherry-picking

Commits picked from other conduit projects

  
Database

This requires or includes changes to the database

  
Dependencies

Something dependency related

  
Dependencies/Renovate

Automatic dependency upgrades by Renovate

  
Difficulty
Easy
Low difficulty to implement - touches few parts of the codebase, low complexity

  
Difficulty
Hard
High difficulty to implement - touches many parts of the codebase, high complexity

  
Difficulty
Medium
Medium difficulty to implement - touches more parts of the codebase, higher complexity

  
Documentation

Improvements or additions to documentation

  
Enhancement

New feature or request

  
Good first issue

Good for newcomers

  
Help wanted

Additional eyes and keyboards are required for this one

  
Inherited

Issues that have been inhereted from the project pre-fork

  
Matrix/Administration

Features pertaining to homeserver administration

  
Matrix/Appservices

Features pertaining to the appservice API

  
Matrix/Auth

Features pertaining to authentication

  
Matrix/Client

Features pertaining to client-to-server interactions

  
Matrix/Core

Issues relating to core matrix functionality, such as state resolution and PDU formats

  
Matrix/Federation

Features pertaining to server-to-server interactions

  
Matrix/Hydra

Issues related to room version 12 and related changes (temporary label)

  
Matrix/MSC

Features pertaining to unstable matrix features

  
Matrix/Media

Features pertaining to media interactions

  
Meta

Related to housekeeping, maintenance, or other repo-meta.

  
Meta/CI

Issues related to CI changes

  
Meta/Packaging

Packaging

  
Priority
Blocking
This issue is blocking the next release

  
Priority
High
This issue is very important

  
Priority
Low
This issue is of a rather low priority

  
Security

This item is related to general security

  
Status/Blocked

This pull request or issue is currently blocked from being merged/closed

  
Status
Confirmed
This issue has enough information and is confirmed

  
Status
Duplicate
This issue or pull request already exists

  
Status
Invalid
This issue doesn't seem right

  
Status
Needs Investigation
This issue needs further investigation

  
Support

Questions or support requests

  
To-Merge

   
Wont fix

This will not be worked on

  
old/ci/cd

Ci/CD

Archived

  
old/rust

Pull requests that update Rust code

Archived

No labels
Bug
Cherry-picking
Database
Dependencies
Dependencies/Renovate
Difficulty
Easy
Difficulty
Hard
Difficulty
Medium
Documentation
Enhancement
Good first issue
Help wanted
Inherited
Matrix/Administration
Matrix/Appservices
Matrix/Auth
Matrix/Client
Matrix/Core
Matrix/Federation
Matrix/Hydra
Matrix/MSC
Matrix/Media
Meta
Meta/CI
Meta/Packaging
Priority
Blocking
Priority
High
Priority
Low
Security
Status/Blocked
Status
Confirmed
Status
Duplicate
Status
Invalid
Status
Needs Investigation
Support
To-Merge
Wont fix
old/ci/cd
old/rust
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
tcpipuk
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
continuwuation/continuwuity!1012
No description provided.