WIP: feat(media): add config to enable missing legacy media endpoints #1454

Draft
gamesguru wants to merge 4 commits from gamesguru/continuwuity:guru/fix/media-legacy-r0-endpoints into main
Contributor

update config key descriptions in config/mod.rs

add speculative fixes for the following 404 ORB errors in SchildiChat web:

{"errcode":"M_NOT_FOUND","error":"M_NOT_FOUND: Fetching media failed: Answer from matrix.sp-codes.de: [404 / M_UNRECOGNIZED] Unrecognized request mxc=mxc://matrix.sp-codes.de/SpHUPhCGRnsYTFlyRYCDZhDD authenticated=true"}

{"errcode":"M_NOT_FOUND","error":"M_NOT_FOUND: Fetching media failed: Answer from hampai.ch: [401 / M_UNAUTHORIZED] no auth provided (required) mxc=mxc://hampai.ch/b291e6908914b64277b7ed0e1de87df5d52cac241958243044855644160 authenticated=true"}

enforce freeze_legacy_media on all legacy remote fetch paths

fix: fallback to unauthenticated media on more errors and safely return NotFound for empty media


This pull request... (see above commit messages). Unsure whether this breaks anything else, but it fixes many, many loading issues in matrix.to and SchildiChat web legacy.

Pull request checklist:

  • This pull request targets the main branch, and the branch is named something other than
    main.
  • I have written an appropriate pull request title and my description is clear.
  • I understand I am responsible for the contents of this pull request.
  • I have followed the contributing guidelines:
update config key descriptions in config/mod.rs add speculative fixes for the following 404 ORB errors in SchildiChat web: {"errcode":"M_NOT_FOUND","error":"M_NOT_FOUND: Fetching media failed: Answer from matrix.sp-codes.de: [404 / M_UNRECOGNIZED] Unrecognized request mxc=mxc://matrix.sp-codes.de/SpHUPhCGRnsYTFlyRYCDZhDD authenticated=true"} {"errcode":"M_NOT_FOUND","error":"M_NOT_FOUND: Fetching media failed: Answer from hampai.ch: [401 / M_UNAUTHORIZED] no auth provided (required) mxc=mxc://hampai.ch/b291e6908914b64277b7ed0e1de87df5d52cac241958243044855644160 authenticated=true"} enforce freeze_legacy_media on all legacy remote fetch paths fix: fallback to unauthenticated media on more errors and safely return NotFound for empty media <!-- In order to help reviewers know what your pull request does at a glance, you should ensure that 1. Your PR title is a short, single sentence describing what you changed 2. You have described in more detail what you have changed, why you have changed it, what the intended effect is, and why you think this will be beneficial to the project. If you have made any potentially strange/questionable design choices, but didn't feel they'd benefit from code comments, please don't mention them here - after opening your pull request, go to "files changed", and click on the "+" symbol in the line number gutter, and attach comments to the lines that you think would benefit from some clarification. --> ----------------------- This pull request... (see above commit messages). Unsure whether this breaks anything else, but it fixes many, many loading issues in matrix.to and SchildiChat web legacy. <!-- Example: This pull request allows us to warp through time and space ten times faster than before by double-inverting the warp drive with hyperheated jump fluid, both making the drive faster and more efficient. This resolves the common issue where we have to wait more than 10 milliseconds to engage, use, and disengage the warp drive when travelling between galaxies. --> <!-- Closes: #... --> <!-- Fixes: #... --> <!-- Uncomment the above line(s) if your pull request fixes an issue or closes another pull request by superseding it. Replace `#...` with the issue/pr number, such as `#123`. --> **Pull request checklist:** <!-- You need to complete these before your PR can be considered. If you aren't sure about some, feel free to ask for clarification in #dev:continuwuity.org. --> - [x] This pull request targets the `main` branch, and the branch is named something other than `main`. - [x] I have written an appropriate pull request title and my description is clear. - [x] I understand I am responsible for the contents of this pull request. - I have followed the [contributing guidelines][c1]: - [x] My contribution follows the [code style][c2], if applicable. - [x] I ran [pre-commit checks][c1pc] before opening/drafting this pull request. - [x] I have [tested my contribution][c1t] (or proof-read it for documentation-only changes) myself, if applicable. This includes ensuring code compiles. - [x] My commit messages follow the [commit message format][c1cm] and are descriptive. - [ ] I have written a [news fragment][n1] for this PR, if applicable<!--(can be done after hitting open!)-->. <!-- Notes on these requirements: - While not required, we encourage you to sign your commits with GPG or SSH to attest the authenticity of your changes. - While we allow LLM-assisted contributions, we do not appreciate contributions that are low quality, which is typical of machine-generated contributions that have not had a lot of love and care from a human. Please do not open a PR if all you have done is asked ChatGPT to tidy up the codebase with a +-100,000 diff. - In the case of code style violations, reviewers may leave review comments/change requests indicating what the ideal change would look like. For example, a reviewer may suggest you lower a log level, or use `match` instead of `if/else` etc. - In the case of code style violations, pre-commit check failures, minor things like typos/spelling errors, and in some cases commit format violations, reviewers may modify your branch directly, typically by making changes and adding a commit. Particularly in the latter case, a reviewer may rebase your commits to squash "spammy" ones (like "fix", "fix", "actually fix"), and reword commit messages that don't satisfy the format. - Pull requests MUST pass the `Checks` CI workflows to be capable of being merged. This can only be bypassed in exceptional circumstances. If your CI flakes, let us know in matrix:r/dev:continuwuity.org. - Pull requests have to be based on the latest `main` commit before being merged. If the main branch changes while you're making your changes, you should make sure you rebase on main before opening a PR. Your branch will be rebased on main before it is merged if it has fallen behind. - We typically only do fast-forward merges, so your entire commit log will be included. Once in main, it's difficult to get out cleanly, so put on your best dress, smile for the cameras! --> [c1]: https://forgejo.ellis.link/continuwuation/continuwuity/src/branch/main/CONTRIBUTING.md [c2]: https://forgejo.ellis.link/continuwuation/continuwuity/src/branch/main/docs/development/code_style.mdx [c1pc]: https://forgejo.ellis.link/continuwuation/continuwuity/src/branch/main/CONTRIBUTING.md#pre-commit-checks [c1t]: https://forgejo.ellis.link/continuwuation/continuwuity/src/branch/main/CONTRIBUTING.md#running-tests-locally [c1cm]: https://forgejo.ellis.link/continuwuation/continuwuity/src/branch/main/CONTRIBUTING.md#commit-messages [n1]: https://towncrier.readthedocs.io/en/stable/tutorial.html#creating-news-fragments
feat(media): add config to enable missing legacy media endpoints
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Has been skipped
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 3m23s
Checks / Prek / Clippy and Cargo Tests (pull_request) Failing after 40m24s
15956a6422
update config key descriptions in config/mod.rs

add speculative fixes for the following 404 ORB errors in SchildiChat web:

    {"errcode":"M_NOT_FOUND","error":"M_NOT_FOUND: Fetching media failed: Answer from matrix.sp-codes.de: [404 / M_UNRECOGNIZED] Unrecognized request mxc=mxc://matrix.sp-codes.de/SpHUPhCGRnsYTFlyRYCDZhDD authenticated=true"}

    {"errcode":"M_NOT_FOUND","error":"M_NOT_FOUND: Fetching media failed: Answer from hampai.ch: [401 / M_UNAUTHORIZED] no auth provided (required) mxc=mxc://hampai.ch/b291e6908914b64277b7ed0e1de87df5d52cac241958243044855644160 authenticated=true"}

enforce freeze_legacy_media on all legacy remote fetch paths

fix: fallback to unauthenticated media on more errors and safely return NotFound for empty media
nex requested changes 2026-02-25 12:40:44 +00:00
nex left a comment
Owner

Looks good, just some concerns regarding returned errors & noncompliant error handling

Looks good, just some concerns regarding returned errors & noncompliant error handling
@ -163,0 +160,4 @@
} = fetch_file(&services, &mxc, Some(user), body.timeout_ms, None)
.await
.map_err(|e| {
err!(Request(NotFound(debug_warn!(%mxc, "Fetching media failed: {e:?}"))))
Owner

This potentially leaks misconfigurations, which is why the previous content had an explicit match & different error for PermissionDenied

This potentially leaks misconfigurations, which is why the previous content had an explicit match & different error for `PermissionDenied`
@ -210,0 +204,4 @@
} = fetch_file(&services, &mxc, Some(user), body.timeout_ms, Some(&body.filename))
.await
.map_err(|e| {
err!(Request(NotFound(debug_warn!(%mxc, "Fetching media failed: {e:?}"))))
Owner

This potentially leaks misconfigurations, which is why the previous content had an explicit match & different error for PermissionDenied

This potentially leaks misconfigurations, which is why the previous content had an explicit match & different error for `PermissionDenied`
@ -42,0 +37,4 @@
if let Err(error) = &result {
if matches!(
error.kind(),
NotFound | Unrecognized | Unauthorized | Forbidden { .. } | Unknown
Owner

This is incorrect behaviour - the fallback to unauthenticated media, per the spec, should only be done when M_UNRECOGNIZED is encountered.

This is incorrect behaviour - the fallback to unauthenticated media, [per the spec](https://spec.matrix.org/v1.17/server-server-api/#content-repository), should only be done when `M_UNRECOGNIZED` is encountered.
gamesguru marked this conversation as resolved
@ -74,0 +74,4 @@
if let Err(error) = &result {
if matches!(
error.kind(),
NotFound | Unrecognized | Unauthorized | Forbidden { .. } | Unknown
Owner

Same as above

Same as above
gamesguru marked this conversation as resolved
fix: revert to fall thru to legacy only on Unrecognized
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Has been skipped
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 4m27s
Checks / Prek / Clippy and Cargo Tests (pull_request) Has been cancelled
472e4d5a01
gamesguru force-pushed guru/fix/media-legacy-r0-endpoints from 472e4d5a01
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Has been skipped
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 4m27s
Checks / Prek / Clippy and Cargo Tests (pull_request) Has been cancelled
to d4b19fb200
All checks were successful
Documentation / Build and Deploy Documentation (pull_request) Has been skipped
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 3m43s
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 24m38s
2026-02-25 13:51:43 +00:00
Compare
Author
Contributor

think this is better now, but still not 100% sure.

iirc the 404 was added and did help some things initially, but the forbiddens and other catch alls were speculative at best.

think this is better now, but still not 100% sure. iirc the 404 was added and did help some things initially, but the forbiddens and other catch alls were speculative at best.
Jade changed title from feat(media): add config to enable missing legacy media endpoints to WIP: feat(media): add config to enable missing legacy media endpoints 2026-03-03 18:32:07 +00:00
nex force-pushed guru/fix/media-legacy-r0-endpoints from d4b19fb200
All checks were successful
Documentation / Build and Deploy Documentation (pull_request) Has been skipped
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 3m43s
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 24m38s
to ef2c6a8d4e
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Has been skipped
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 6m10s
Checks / Prek / Clippy and Cargo Tests (pull_request) Failing after 20m9s
2026-03-03 18:52:47 +00:00
Compare
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Has been skipped
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 6m10s
Required
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Failing after 20m9s
Required
Details
This pull request has changes conflicting with the target branch.
  • src/service/media/remote.rs
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u guru/fix/media-legacy-r0-endpoints:gamesguru-guru/fix/media-legacy-r0-endpoints
git switch gamesguru-guru/fix/media-legacy-r0-endpoints
Sign in to join this conversation.
No reviewers
nex
No milestone
No project
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
continuwuation/continuwuity!1454
No description provided.