fix(testing): fix DB path for Matrix Complement test and enable easier first-time registration for automation #1453

Open
gamesguru wants to merge 1 commit from gamesguru/continuwuity:guru/fix/first-time-registration-and-Matrix-Complement-Test-Suite into main
Contributor

This pull request fixes issues which prevented the Matrix Complement Test Suite from running registration tests, and therefore also many other tests.

See attached image. First run (top) is default behavior on main. The bottom run (small, only a few lines because no errors) is the behavior of this branch.

Pull request checklist:

  • This pull request targets the main branch, and the branch is named something other than
    main.
  • I have written an appropriate pull request title and my description is clear.
  • I understand I am responsible for the contents of this pull request.
  • I have followed the contributing guidelines:
<!-- In order to help reviewers know what your pull request does at a glance, you should ensure that 1. Your PR title is a short, single sentence describing what you changed 2. You have described in more detail what you have changed, why you have changed it, what the intended effect is, and why you think this will be beneficial to the project. If you have made any potentially strange/questionable design choices, but didn't feel they'd benefit from code comments, please don't mention them here - after opening your pull request, go to "files changed", and click on the "+" symbol in the line number gutter, and attach comments to the lines that you think would benefit from some clarification. --> This pull request fixes issues which prevented the Matrix Complement Test Suite from running registration tests, and therefore also many other tests. See attached image. First run (top) is default behavior on `main`. The bottom run (small, only a few lines because no errors) is the behavior of this branch. <!-- Example: This pull request allows us to warp through time and space ten times faster than before by double-inverting the warp drive with hyperheated jump fluid, both making the drive faster and more efficient. This resolves the common issue where we have to wait more than 10 milliseconds to engage, use, and disengage the warp drive when travelling between galaxies. --> <!-- Closes: #... --> <!-- Fixes: #... --> <!-- Uncomment the above line(s) if your pull request fixes an issue or closes another pull request by superseding it. Replace `#...` with the issue/pr number, such as `#123`. --> **Pull request checklist:** <!-- You need to complete these before your PR can be considered. If you aren't sure about some, feel free to ask for clarification in #dev:continuwuity.org. --> - [x] This pull request targets the `main` branch, and the branch is named something other than `main`. - [x] I have written an appropriate pull request title and my description is clear. - [x] I understand I am responsible for the contents of this pull request. - I have followed the [contributing guidelines][c1]: - [x] My contribution follows the [code style][c2], if applicable. - [x] I ran [pre-commit checks][c1pc] before opening/drafting this pull request. - [x] I have [tested my contribution][c1t] (or proof-read it for documentation-only changes) myself, if applicable. This includes ensuring code compiles. - [x] My commit messages follow the [commit message format][c1cm] and are descriptive. - [ ] I have written a [news fragment][n1] for this PR, if applicable<!--(can be done after hitting open!)-->. <!-- Notes on these requirements: - While not required, we encourage you to sign your commits with GPG or SSH to attest the authenticity of your changes. - While we allow LLM-assisted contributions, we do not appreciate contributions that are low quality, which is typical of machine-generated contributions that have not had a lot of love and care from a human. Please do not open a PR if all you have done is asked ChatGPT to tidy up the codebase with a +-100,000 diff. - In the case of code style violations, reviewers may leave review comments/change requests indicating what the ideal change would look like. For example, a reviewer may suggest you lower a log level, or use `match` instead of `if/else` etc. - In the case of code style violations, pre-commit check failures, minor things like typos/spelling errors, and in some cases commit format violations, reviewers may modify your branch directly, typically by making changes and adding a commit. Particularly in the latter case, a reviewer may rebase your commits to squash "spammy" ones (like "fix", "fix", "actually fix"), and reword commit messages that don't satisfy the format. - Pull requests MUST pass the `Checks` CI workflows to be capable of being merged. This can only be bypassed in exceptional circumstances. If your CI flakes, let us know in matrix:r/dev:continuwuity.org. - Pull requests have to be based on the latest `main` commit before being merged. If the main branch changes while you're making your changes, you should make sure you rebase on main before opening a PR. Your branch will be rebased on main before it is merged if it has fallen behind. - We typically only do fast-forward merges, so your entire commit log will be included. Once in main, it's difficult to get out cleanly, so put on your best dress, smile for the cameras! --> [c1]: https://forgejo.ellis.link/continuwuation/continuwuity/src/branch/main/CONTRIBUTING.md [c2]: https://forgejo.ellis.link/continuwuation/continuwuity/src/branch/main/docs/development/code_style.mdx [c1pc]: https://forgejo.ellis.link/continuwuation/continuwuity/src/branch/main/CONTRIBUTING.md#pre-commit-checks [c1t]: https://forgejo.ellis.link/continuwuation/continuwuity/src/branch/main/CONTRIBUTING.md#running-tests-locally [c1cm]: https://forgejo.ellis.link/continuwuation/continuwuity/src/branch/main/CONTRIBUTING.md#commit-messages [n1]: https://towncrier.readthedocs.io/en/stable/tutorial.html#creating-news-fragments
fix(testing): fix DB path for Matrix Complement test and enable easier first-time registration for automation
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Has been skipped
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 3m19s
Checks / Prek / Clippy and Cargo Tests (pull_request) Failing after 41m0s
03d13a489c
Author
Contributor

Guys, i'm very excited to announce my first major run of the complement test suite. It is a partial run, but with about 75% of tests passing, I'm very excited and surprised at how little work may remain to bring that number to 95% or more.

Log summary is below. Link to run (logs held for 90 days is here).

I'm now able to see exactly which tests pass, fail, or are skipped, and to compare major code changes I make on other branches with the baseline main branch.

https://github.com/gamesguru/continuwuity/actions/runs/22398947097/job/64839874933

DONE 739 tests, 8 skipped, 245 failures in 765.767s


Run ./bin/complement ./complement-src
removed 'complement_test_logs.jsonl'
removed 'complement_test_results.jsonl'

running go test with:
$COMPLEMENT_SRC: ./complement-src
$COMPLEMENT_BASE_IMAGE: continuwuity:complement
$RESULTS_FILE: complement_test_results.jsonl
$LOG_FILE: complement_test_logs.jsonl

PASS tests.TestWriteMDirectAccountData (15.79s)
PASS tests.TestIsDirectFlagLocal (2.06s)
PASS tests/csapi.TestChangePasswordPushers/Pushers_created_with_a_different_access_token_are_deleted_on_password_change (0.16s)
PASS tests/csapi.TestChangePasswordPushers/Pushers_created_with_the_same_access_token_are_not_deleted_on_password_change (0.10s)
PASS tests/csapi.TestChangePasswordPushers (16.03s)
FAIL tests/msc3391.TestRemovingAccountData/Deleting_a_user's_account_data_via_DELETE_works (0.05s)
FAIL tests/msc3391.TestRemovingAccountData/Deleting_a_user's_account_data_via_PUT_works (0.05s)
FAIL tests/msc3391.TestRemovingAccountData/Deleting_a_user's_room_data_via_DELETE_works (0.05s)
FAIL tests/msc3391.TestRemovingAccountData/Deleting_a_user's_room_account_data_via_PUT_works (0.05s)
FAIL tests/msc3391.TestRemovingAccountData (15.20s)
PASS tests/csapi.TestChangePassword/After_changing_password,_can't_log_in_with_old_password (0.11s)
PASS tests/csapi.TestChangePassword/After_changing_password,_can_log_in_with_new_password (0.04s)
PASS tests/csapi.TestChangePassword/After_changing_password,_existing_session_still_works (0.00s)
PASS tests/csapi.TestChangePassword/After_changing_password,_a_different_session_no_longer_works_by_default (0.00s)
PASS tests/csapi.TestChangePassword/After_changing_password,_different_sessions_can_optionally_be_kept (0.14s)
PASS tests/csapi.TestChangePassword (1.92s)
  FAIL Package tests/msc3391 (20.552s)

PASS tests/csapi.TestAddAccountData/Can_add_global_account_data (0.00s)
PASS tests/csapi.TestAddAccountData/Can_add_room_account_data (0.05s)
PASS tests/csapi.TestAddAccountData (1.68s)
PASS tests/csapi.TestDeactivateAccount/Password_flow_is_available (0.00s)
PASS tests/csapi.TestDeactivateAccount/Can't_deactivate_account_with_wrong_password (0.04s)
PASS tests/csapi.TestDeactivateAccount/Can_deactivate_account (0.05s)
PASS tests/csapi.TestDeactivateAccount/After_deactivating_account,_can't_log_in_with_password (0.00s)
PASS tests/csapi.TestDeactivateAccount (2.05s)
PASS tests.TestIsDirectFlagFederation (6.55s)
SKIP tests/csapi.TestCanRegisterAdmin (1.71s)
SKIP tests/csapi.TestServerNotices (1.77s)
PASS tests/csapi.TestContent (2.17s)
PASS tests/csapi.TestContentCSAPIMediaV1 (1.58s)
FAIL tests/msc2836.TestEventRelationships (32.13s)
PASS tests/csapi.TestDeviceManagement/GET_/device/{deviceId} (0.06s)
PASS tests/csapi.TestDeviceManagement/GET_/device/{deviceId}_gives_a_404_for_unknown_devices (0.00s)
PASS tests/csapi.TestDeviceManagement/GET_/devices (0.04s)
PASS tests/csapi.TestDeviceManagement/PUT_/device/{deviceId}_updates_device_fields (0.00s)
PASS tests/csapi.TestDeviceManagement/PUT_/device/{deviceId}_gives_a_404_for_unknown_devices (0.00s)
PASS tests/csapi.TestDeviceManagement/DELETE_/device/{deviceId} (0.15s)
PASS tests/csapi.TestDeviceManagement/DELETE_/device/{deviceId}_requires_UI_auth_user_to_match_device_owner (0.15s)
PASS tests/csapi.TestDeviceManagement (1.82s)
PASS tests/csapi.TestLogin/parallel/GET_/login_yields_a_set_of_flows (0.00s)
PASS tests/csapi.TestLogin/parallel/POST_/login_as_non-existing_user_is_rejected (0.00s)
PASS tests/csapi.TestLogin/parallel/POST_/login_can_log_in_as_a_user_with_just_the_local_part_of_the_id (0.06s)
PASS tests/csapi.TestLogin/parallel/POST_/login_can_login_as_user (0.07s)
PASS tests/csapi.TestLogin/parallel/Login_with_uppercase_username_works_and_GET_/whoami_afterwards_also (0.07s)
FAIL tests/csapi.TestLogin/parallel/POST_/login_returns_the_same_device_id_as_that_in_the_request (0.00s)
PASS tests/csapi.TestLogin/parallel/POST_/login_wrong_password_is_rejected (0.07s)
FAIL tests/csapi.TestLogin/parallel (0.00s)
FAIL tests/csapi.TestLogin (2.55s)
PASS tests/csapi.TestLogout/Can_logout_current_device (0.05s)
PASS tests/csapi.TestLogout/Can_logout_all_devices (0.05s)
PASS tests/csapi.TestLogout/Request_to_logout_with_invalid_an_access_token_is_rejected (0.05s)
PASS tests/csapi.TestLogout/Request_to_logout_without_an_access_token_is_rejected (0.05s)
PASS tests/csapi.TestLogout (1.76s)
PASS tests/msc3757.TestWithoutOwnedState/parallel/user_can_set_state_with_their_own_user_ID_as_state_key (0.01s)
PASS tests/msc3757.TestWithoutOwnedState/parallel/room_creator_cannot_set_state_with_a_non-member_user_ID_as_state_key (0.01s)
PASS tests/msc3757.TestWithoutOwnedState/parallel/room_creator_cannot_set_state_with_their_own_suffixed_user_ID_as_state_key (0.02s)
PASS tests/msc3757.TestWithoutOwnedState/parallel/room_creator_cannot_set_state_with_another_suffixed_user_ID_as_state_key (0.02s)
PASS tests/msc3757.TestWithoutOwnedState/parallel/room_creator_cannot_set_state_with_another_user_ID_as_state_key (0.02s)
PASS tests/msc3757.TestWithoutOwnedState/parallel/room_creator_cannot_set_state_with_malformed_user_ID_as_state_key (0.02s)
PASS tests/msc3757.TestWithoutOwnedState/parallel (0.00s)
PASS tests/msc3757.TestWithoutOwnedState (14.53s)
PASS tests/csapi.TestPresence/GET_/presence/:user_id/status_fetches_initial_status (0.00s)
PASS tests/csapi.TestPresence/PUT_/presence/:user_id/status_updates_my_presence (0.00s)
PASS tests/csapi.TestPresence/Presence_can_be_set_from_sync (0.03s)
PASS tests/csapi.TestPresence/Presence_changes_are_reported_to_local_room_members (0.02s)
PASS tests/csapi.TestPresence/Presence_changes_to_UNAVAILABLE_are_reported_to_local_room_members (0.01s)
PASS tests/csapi.TestPresence (1.79s)
PASS tests/csapi.TestProfileAvatarURL/PUT_/profile/:user_id/avatar_url_sets_my_avatar (0.01s)
PASS tests/csapi.TestProfileAvatarURL/GET_/profile/:user_id/avatar_url_publicly_accessible (0.00s)
PASS tests/csapi.TestProfileAvatarURL (1.71s)
FAIL tests/msc3757.TestMSC3757OwnedState (3.02s)
  FAIL Package tests/msc3757 (21.211s)

PASS tests/csapi.TestProfileDisplayName/PUT_/profile/:user_id/displayname_sets_my_name (0.01s)
PASS tests/csapi.TestProfileDisplayName/GET_/profile/:user_id/displayname_publicly_accessible (0.00s)
PASS tests/csapi.TestProfileDisplayName (1.44s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/q (0.07s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/3 (0.06s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/. (0.06s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/_ (0.06s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/= (0.06s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/- (0.06s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_// (0.06s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_ (0.44s)
SKIP tests/csapi.TestRegistration/parallel/POST_/_synapse/admin/v1/register_admin_with_shared_secret (0.00s)
SKIP tests/csapi.TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret (0.00s)
SKIP tests/csapi.TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_disallows_symbols (0.00s)
SKIP tests/csapi.TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_downcases_capitals (0.00s)
PASS tests/csapi.TestRegistration/parallel/Registration_accepts_non-ascii_passwords (0.05s)
PASS tests/csapi.TestRegistration/parallel/POST_{}_returns_a_set_of_flows (0.00s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_can_create_a_user (0.09s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_downcases_capitals_in_usernames (0.10s)
PASS tests/csapi.TestRegistration/parallel/GET_/register/available_returns_available_for_unregistered_user_name (0.00s)
PASS tests/csapi.TestRegistration/parallel/GET_/register/available_returns_M_INVALID_USERNAME_for_invalid_user_name (0.00s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_rejects_if_user_already_exists (0.14s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_returns_the_same_device_id_as_that_in_the_request (0.16s)
PASS tests/csapi.TestRegistration/parallel/POST_/register_rejects_usernames_with_special_characters (0.09s)
PASS tests/csapi.TestRegistration/parallel/GET_/register/available_returns_M_USER_IN_USE_for_registered_user_name (0.09s)
PASS tests/csapi.TestRegistration/parallel (0.49s)
PASS tests/csapi.TestRegistration (2.02s)
PASS tests/csapi.TestRequestEncodingFails/POST_rejects_invalid_utf-8_in_JSON (0.00s)
PASS tests/csapi.TestRequestEncodingFails (1.49s)
PASS tests/csapi.TestRoomAlias/Parallel/PUT_/directory/room/:room_alias_creates_alias (0.03s)
PASS tests/csapi.TestRoomAlias/Parallel/Room_aliases_can_contain_Unicode (0.07s)
PASS tests/csapi.TestRoomAlias/Parallel/Only_room_members_can_list_aliases_of_a_room (0.10s)
PASS tests/csapi.TestRoomAlias/Parallel/GET_/rooms/:room_id/aliases_lists_aliases (0.13s)
PASS tests/csapi.TestRoomAlias/Parallel (0.00s)
PASS tests/csapi.TestRoomAlias (1.93s)
PASS tests/csapi.TestRoomDeleteAlias/Parallel/Deleting_a_non-existent_alias_should_return_a_404 (0.01s)
PASS tests/csapi.TestRoomDeleteAlias/Parallel/Alias_creators_can_delete_alias_with_no_ops (0.06s)
PASS tests/csapi.TestRoomDeleteAlias/Parallel/Regular_users_can_add_and_delete_aliases_in_the_default_room_configuration (0.11s)
PASS tests/csapi.TestRoomDeleteAlias/Parallel/Users_can't_delete_other's_aliases (0.14s)
PASS tests/csapi.TestRoomDeleteAlias/Parallel/Alias_creators_can_delete_canonical_alias_with_no_ops (0.20s)
PASS tests/csapi.TestRoomDeleteAlias/Parallel (0.00s)
PASS tests/csapi.TestRoomDeleteAlias (1.73s)
FAIL tests/msc2836.TestFederatedEventRelationships (18.73s)
PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_missing_aliases (0.03s)
PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_invalid_aliases (0.03s)
PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_alias_pointing_to_different_local_room (0.06s)
PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_setting_rejects_deleted_aliases (0.04s)
PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_missing_aliases#01 (0.03s)
PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_alt_alias_pointing_to_different_local_room (0.08s)
PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_invalid_aliases#01 (0.04s)
PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_accepts_present_aliases (0.12s)
PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_accepts_present_alt_aliases (0.12s)
PASS tests/csapi.TestRoomCanonicalAlias/Parallel (0.30s)
PASS tests/csapi.TestRoomCanonicalAlias (1.81s)
  FAIL Package tests/msc2836 (51.994s)

PASS tests/csapi.TestRoomCreate/Parallel/Rooms_can_be_created_with_an_initial_invite_list_(SYN-205) (0.04s)
PASS tests/csapi.TestRoomCreate/Parallel/Can_/sync_newly_created_room (0.05s)
PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_ignores_attempts_to_set_the_room_version_via_creation_content (0.08s)
PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_public_room (0.03s)
PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_room_with_a_name (0.06s)
FAIL tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_creates_a_room_with_the_given_version (0.06s)
PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_room_with_a_topic_via_initial_state (0.04s)
PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_private_room_with_invites (0.13s)
FAIL tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_room_with_a_topic_and_writes_rich_topic_representation (0.13s)
FAIL tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_room_with_a_topic_via_initial_state_overwritten_by_topic (0.13s)
PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_room_with_a_topic (0.13s)
PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_rejects_attempts_to_create_rooms_with_unknown_versions (0.10s)
PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_private_room (0.09s)
PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_rejects_attempts_to_create_rooms_with_numeric_versions (0.06s)
FAIL tests/csapi.TestRoomCreate/Parallel (0.16s)
FAIL tests/csapi.TestRoomCreate (2.88s)
PASS tests/csapi.TestRoomForget/Parallel/Can't_forget_room_you're_still_in (0.03s)
PASS tests/csapi.TestRoomForget/Parallel/Can_forget_room_we_weren't_an_actual_member (0.12s)
PASS tests/csapi.TestRoomForget/Parallel/Can_forget_room_you've_been_kicked_from (0.15s)
FAIL tests/csapi.TestRoomForget/Parallel/Forgotten_room_messages_cannot_be_paginated (0.16s)
PASS tests/csapi.TestRoomForget/Parallel/Forgetting_room_does_not_show_up_in_v2_initial_/sync (0.31s)
FAIL tests/csapi.TestRoomForget/Parallel/Leave_for_forgotten_room_shows_up_in_v2_incremental_/sync (0.26s)
PASS tests/csapi.TestRoomForget/Parallel/Can_re-join_room_if_re-invited (0.39s)
FAIL tests/csapi.TestRoomForget/Parallel (0.00s)
FAIL tests/csapi.TestRoomForget (2.83s)
PASS tests/csapi.TestFetchEvent (1.80s)
PASS tests/csapi.TestFetchHistoricalJoinedEventDenied (1.66s)
FAIL tests/msc3874.TestFilterMessagesByRelType (15.62s)
  FAIL Package tests/msc3874 (19.49s)

PASS tests/csapi.TestFetchHistoricalSharedEvent (1.71s)
PASS tests/csapi.TestFetchHistoricalInvitedEventFromBetweenInvite (2.24s)
  EMPTY Package tests/msc3902 (2.811s)

PASS tests/csapi.TestFetchHistoricalInvitedEventFromBeforeInvite (3.11s)
PASS tests.TestACLs (44.26s)
FAIL tests/msc3890.TestDeletingDeviceRemovesDeviceLocalNotificationSettings/Deleting_a_user's_device_should_delete_any_local_notification_settings_entries_from_their_account_data (0.03s)
FAIL tests/msc3890.TestDeletingDeviceRemovesDeviceLocalNotificationSettings (15.95s)
  FAIL Package tests/msc3890 (17.792s)

PASS tests/csapi.TestFetchEventNonWorldReadable (2.06s)
PASS tests/csapi.TestFetchEventWorldReadable (2.43s)
PASS tests/csapi.TestRoomMembers/Parallel/POST_/rooms/:room_id/join_can_join_a_room (0.05s)
FAIL tests/csapi.TestRoomMembers/Parallel/POST_/join/:room_id_can_join_a_room_with_custom_content (0.11s)
PASS tests/csapi.TestRoomMembers/Parallel/POST_/rooms/:room_id/invite_can_send_an_invite (0.19s)
PASS tests/csapi.TestRoomMembers/Parallel/POST_/rooms/:room_id/leave_can_leave_a_room (0.23s)
FAIL tests/csapi.TestRoomMembers/Parallel/POST_/join/:room_alias_can_join_a_room_with_custom_content (0.18s)
PASS tests/csapi.TestRoomMembers/Parallel/POST_/rooms/:room_id/ban_can_ban_a_user (0.25s)
PASS tests/csapi.TestRoomMembers/Parallel/POST_/join/:room_alias_can_join_a_room (0.14s)
PASS tests/csapi.TestRoomMembers/Parallel/POST_/join/:room_id_can_join_a_room (0.13s)
PASS tests/csapi.TestRoomMembers/Parallel/Test_that_we_can_be_reinvited_to_a_room_we_created (0.37s)
FAIL tests/csapi.TestRoomMembers/Parallel (0.00s)
FAIL tests/csapi.TestRoomMembers (3.41s)
PASS tests/csapi.TestRoomReceipts/Receipts_DO_NOT_include_a_`room_id`_field (0.02s)
PASS tests/csapi.TestRoomReceipts (1.52s)
PASS tests/csapi.TestRoomReadMarkers (1.46s)
PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state/m.room.member/:user_id_fetches_my_membership (0.03s)
PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state_fetches_entire_room_state (0.06s)
PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/joined_members_is_forbidden_after_leaving_room (0.10s)
PASS tests/csapi.TestRoomState/Parallel/PUT_/createRoom_with_creation_content (0.11s)
PASS tests/csapi.TestRoomState/Parallel/GET_/publicRooms_lists_newly-created_room (0.12s)
PASS tests/csapi.TestRoomState/Parallel/GET_/joined_rooms_lists_newly-created_room (0.11s)
PASS tests/csapi.TestRoomState/Parallel/GET_/directory/room/:room_alias_yields_room_ID (0.11s)
PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state/m.room.power_levels_fetches_powerlevels (0.12s)
FAIL tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/joined_members_fetches_my_membership (0.11s)
PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state/m.room.topic_gets_topic (0.12s)
PASS tests/csapi.TestRoomState/Parallel/PUT_/rooms/:room_id/state/m.room.topic_sets_topic (0.12s)
PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state/m.room.member/:user_id?format=event_fetches_my_membership_event (0.11s)
PASS tests/csapi.TestRoomState/Parallel/POST_/rooms/:room_id/state/m.room.name_sets_name (0.11s)
PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state/m.room.name_gets_name (0.11s)
FAIL tests/csapi.TestRoomState/Parallel (0.00s)
FAIL tests/csapi.TestRoomState (2.86s)
PASS tests/csapi.TestSearch/parallel/Can_search_for_an_event_by_body (0.05s)
PASS tests/csapi.TestSearch/parallel/Search_works_across_an_upgraded_room_and_its_predecessor (0.19s)
PASS tests/csapi.TestSearch/parallel/Search_results_with_recent_ordering_do_not_include_redacted_events (0.23s)
PASS tests/csapi.TestSearch/parallel/Search_results_with_rank_ordering_do_not_include_redacted_events (0.30s)
FAIL tests/csapi.TestSearch/parallel/Can_get_context_around_search_results (0.39s)
FAIL tests/csapi.TestSearch/parallel/Can_back-paginate_search_results (1.23s)
FAIL tests/csapi.TestSearch/parallel (0.00s)
FAIL tests/csapi.TestSearch (3.57s)
PASS tests/csapi.TestServerCapabilities (1.59s)
FAIL tests/msc3930.TestPollsLocalPushRules/Polls_push_rules_are_correctly_presented_to_the_client (0.00s)
FAIL tests/msc3930.TestPollsLocalPushRules (15.87s)
  FAIL Package tests/msc3930 (21.093s)

PASS tests/msc3967.TestMSC3967 (15.61s)
  PASS Package tests/msc3967 (17.611s)

PASS tests/csapi.TestVersionStructure/Version_responds_200_OK_with_valid_structure (0.00s)
PASS tests/csapi.TestVersionStructure (2.25s)
FAIL tests/msc4140.TestDelayedEvents/delayed_events_are_empty_on_startup (0.51s)
FAIL tests/msc4140.TestDelayedEvents/delayed_event_lookups_are_authenticated (0.00s)
FAIL tests/msc4140.TestDelayedEvents/delayed_message_events_are_sent_on_timeout (0.02s)
FAIL tests/msc4140.TestDelayedEvents/delayed_state_events_are_sent_on_timeout (0.52s)
PASS tests/msc4140.TestDelayedEvents/cannot_update_a_delayed_event_without_an_action (0.00s)
PASS tests/msc4140.TestDelayedEvents/cannot_update_a_delayed_event_with_an_invalid_action (0.00s)
PASS tests/msc4140.TestDelayedEvents/parallel/cannot_cancel_a_delayed_event_without_a_matching_delay_ID (0.00s)
PASS tests/msc4140.TestDelayedEvents/parallel/cannot_send_a_delayed_event_without_a_matching_delay_ID (0.00s)
PASS tests/msc4140.TestDelayedEvents/parallel/cannot_restart_a_delayed_event_without_a_matching_delay_ID (0.00s)
PASS tests/msc4140.TestDelayedEvents/parallel (0.00s)
FAIL tests/msc4140.TestDelayedEvents/delayed_state_events_can_be_cancelled (0.01s)
FAIL tests/msc4140.TestDelayedEvents/delayed_state_events_can_be_sent_on_request (0.01s)
FAIL tests/msc4140.TestDelayedEvents/delayed_state_events_can_be_restarted (0.01s)
FAIL tests/msc4140.TestDelayedEvents/delayed_state_is_not_cancelled_by_new_state_from_the_same_user (0.52s)
FAIL tests/msc4140.TestDelayedEvents/delayed_state_is_cancelled_by_new_state_from_another_user (0.52s)
SKIP tests/msc4140.TestDelayedEvents/delayed_state_events_are_kept_on_server_restart (0.00s)
FAIL tests/msc4140.TestDelayedEvents (17.38s)
  FAIL Package tests/msc4140 (20.449s)

FAIL tests.TestDeviceListsUpdateOverFederation/good_connectivity (5.84s)
FAIL tests.TestDeviceListsUpdateOverFederation/interrupted_connectivity (5.35s)
FAIL tests.TestDeviceListsUpdateOverFederation/stopped_server (5.34s)
FAIL tests.TestDeviceListsUpdateOverFederation (46.80s)
PASS tests/msc4155.TestInviteFiltering/Can_invite_users_normally_without_any_rules (0.78s)
PASS tests/msc4155.TestInviteFiltering/Can_block_a_single_user (0.11s)
PASS tests/msc4155.TestInviteFiltering/Can_ignore_a_single_user (0.14s)
PASS tests/msc4155.TestInviteFiltering/Can_block_a_whole_server (0.16s)
PASS tests/msc4155.TestInviteFiltering/Can_ignore_a_whole_server (0.22s)
PASS tests/msc4155.TestInviteFiltering/Can_glob_serveral_servers (0.23s)
PASS tests/msc4155.TestInviteFiltering/Can_glob_serveral_users (0.21s)
PASS tests/msc4155.TestInviteFiltering/Can_allow_a_user_from_a_blocked_server (0.40s)
PASS tests/msc4155.TestInviteFiltering/Can_block_a_user_from_an_allowed_server (0.55s)
PASS tests/msc4155.TestInviteFiltering/Will_ignore_null_fields (0.47s)
PASS tests/msc4155.TestInviteFiltering/Will_allow_users_when_a_user_appears_in_multiple_fields (0.75s)
PASS tests/msc4155.TestInviteFiltering (30.69s)
  PASS Package tests/msc4155 (35.226s)

FAIL tests.TestDeviceListsUpdateOverFederationOnRoomJoin (15.91s)
FAIL tests.TestUserAppearsInChangedDeviceListOnJoinOverFederation (9.44s)
PASS tests.TestEventAuth/returns_auth_events_for_the_requested_event (0.01s)
PASS tests.TestEventAuth/returns_the_auth_chain_for_the_requested_event (0.01s)
PASS tests.TestEventAuth (3.71s)
PASS tests.TestInboundFederationKeys (1.46s)
PASS tests.TestContentMediaV1 (1.97s)
FAIL tests/msc4306.TestMSC4308ThreadSubscriptionsSlidingSync/Receives_thread_subscriptions_over_initial_sliding_sync (0.11s)
FAIL tests/msc4306.TestMSC4308ThreadSubscriptionsSlidingSync/Receives_thread_subscriptions_over_incremental_sliding_sync (30.08s)
FAIL tests/msc4306.TestMSC4308ThreadSubscriptionsSlidingSync (44.90s)
FAIL tests/msc4306.TestThreadSubscriptions/Can_subscribe_to_and_unsubscribe_from_a_thread (0.04s)
FAIL tests/msc4306.TestThreadSubscriptions/Cannot_use_thread_root_as_automatic_subscription_cause_event (0.05s)
FAIL tests/msc4306.TestThreadSubscriptions/Can_create_automatic_subscription_to_a_thread (0.08s)
FAIL tests/msc4306.TestThreadSubscriptions/Manual_subscriptions_overwrite_automatic_subscriptions (0.09s)
FAIL tests/msc4306.TestThreadSubscriptions/Error_when_using_invalid_automatic_event_ID (0.12s)
FAIL tests/msc4306.TestThreadSubscriptions/Unsubscribe_succeeds_even_with_no_subscription (0.06s)
PASS tests/msc4306.TestThreadSubscriptions/Nonexistent_threads_return_404 (0.03s)
FAIL tests/msc4306.TestThreadSubscriptions/Server-side_automatic_subscription_ordering_conflict (0.12s)
FAIL tests/msc4306.TestThreadSubscriptions (3.10s)
  FAIL Package tests/msc4306 (49.804s)

FAIL tests.TestRemotePresence/Presence_changes_are_also_reported_to_remote_room_members (5.06s)
FAIL tests.TestRemotePresence/Presence_changes_to_UNAVAILABLE_are_reported_to_remote_room_members (5.06s)
FAIL tests.TestRemotePresence (14.60s)
PASS tests.TestOutboundFederationProfile/Outbound_federation_can_query_profile_data (0.01s)
PASS tests.TestOutboundFederationProfile (2.41s)
PASS tests.TestInboundFederationProfile/Non-numeric_ports_in_server_names_are_rejected (0.06s)
PASS tests.TestInboundFederationProfile/Inbound_federation_can_query_profile_data (0.01s)
PASS tests.TestInboundFederationProfile (2.54s)
PASS tests.TestFederationRedactSendsWithoutEvent (3.09s)
FAIL tests/csapi.TestDeviceListUpdates/when_local_user_joins_a_room (5.42s)
FAIL tests/csapi.TestDeviceListUpdates/when_remote_user_joins_a_room (6.05s)
FAIL tests/csapi.TestDeviceListUpdates/when_joining_a_room_with_a_local_user (5.26s)
FAIL tests/csapi.TestDeviceListUpdates/when_joining_a_room_with_a_remote_user (5.59s)
FAIL tests/csapi.TestDeviceListUpdates/when_local_user_leaves_a_room (5.29s)
FAIL tests/csapi.TestDeviceListUpdates/when_remote_user_leaves_a_room (5.57s)
FAIL tests/csapi.TestDeviceListUpdates/when_leaving_a_room_with_a_local_user (5.36s)
FAIL tests/csapi.TestDeviceListUpdates/when_leaving_a_room_with_a_remote_user (5.49s)
FAIL tests/csapi.TestDeviceListUpdates/when_local_user_rejoins_a_room (5.28s)
FAIL tests/csapi.TestDeviceListUpdates/when_remote_user_rejoins_a_room (5.54s)
FAIL tests/csapi.TestDeviceListUpdates (84.05s)
PASS tests.TestRemoteAliasRequestsUnderstandUnicode (2.12s)
PASS tests/csapi.TestE2EKeyBackupReplaceRoomKeyRules/parallel/{isVerified:false_firstMessageIndex:10_forwardedCount:5} (0.01s)
PASS tests/csapi.TestE2EKeyBackupReplaceRoomKeyRules/parallel/{isVerified:true_firstMessageIndex:10_forwardedCount:5} (0.02s)
PASS tests/csapi.TestE2EKeyBackupReplaceRoomKeyRules/parallel (0.00s)
PASS tests/csapi.TestE2EKeyBackupReplaceRoomKeyRules (1.61s)
PASS tests/csapi.TestInviteFromIgnoredUsersDoesNotAppearInSync (1.67s)
FAIL tests/csapi.TestJson/Parallel/Invalid_numerical_values (0.00s)
FAIL tests/csapi.TestJson/Parallel/Invalid_JSON_special_values (0.00s)
FAIL tests/csapi.TestJson/Parallel (0.00s)
FAIL tests/csapi.TestJson (2.58s)
PASS tests/csapi.TestFilter (1.36s)
FAIL tests.TestInboundFederationRejectsEventsWithRejectedAuthEvents (8.77s)
PASS tests/csapi.TestEvent/Parallel/Large_Event (0.01s)
PASS tests/csapi.TestEvent/Parallel/Large_State_Event (0.02s)
PASS tests/csapi.TestEvent/Parallel (0.00s)
PASS tests/csapi.TestEvent (1.58s)
FAIL tests.TestGetMissingEventsGapFilling (3.38s)
FAIL tests/csapi.TestKeyChangesLocal/New_login_should_create_a_device_lists.changed_entry (5.18s)
FAIL tests/csapi.TestKeyChangesLocal (7.68s)
FAIL tests/csapi.TestAsyncUpload/Create_media (0.00s)
FAIL tests/csapi.TestAsyncUpload/Not_yet_uploaded (0.00s)
FAIL tests/csapi.TestAsyncUpload/Upload_media (0.00s)
FAIL tests/csapi.TestAsyncUpload/Cannot_upload_to_a_media_ID_that_has_already_been_uploaded_to (0.00s)
FAIL tests/csapi.TestAsyncUpload/Download_media (0.00s)
FAIL tests/csapi.TestAsyncUpload/Download_media_over__matrix/client/v1/media/download (0.00s)
FAIL tests/csapi.TestAsyncUpload (2.52s)
PASS tests/csapi.TestRoomImageRoundtrip (1.46s)
FAIL tests.TestOutboundFederationIgnoresMissingEventWithBadJSONForRoomVersion6 (9.46s)
PASS tests/csapi.TestMediaConfig (1.38s)
FAIL tests/csapi.TestMembershipOnEvents (2.71s)
PASS tests/csapi.TestDemotingUsersViaUsersDefault (2.13s)
FAIL tests.TestInboundCanReturnMissingEvents/Inbound_federation_can_return_missing_events_for_world_readable_visibility (0.22s)
FAIL tests.TestInboundCanReturnMissingEvents/Inbound_federation_can_return_missing_events_for_shared_visibility (0.17s)
FAIL tests.TestInboundCanReturnMissingEvents/Inbound_federation_can_return_missing_events_for_invited_visibility (0.20s)
FAIL tests.TestInboundCanReturnMissingEvents/Inbound_federation_can_return_missing_events_for_joined_visibility (0.21s)
FAIL tests.TestInboundCanReturnMissingEvents (5.95s)
PASS tests/csapi.TestPowerLevels/GET_/rooms/:room_id/state/m.room.power_levels_can_fetch_levels (0.00s)
PASS tests/csapi.TestPowerLevels/PUT_/rooms/:room_id/state/m.room.power_levels_can_set_levels (0.03s)
PASS tests/csapi.TestPowerLevels/PUT_power_levels_should_not_explode_if_the_old_power_levels_were_empty (0.05s)
PASS tests/csapi.TestPowerLevels (1.64s)
PASS tests/csapi.TestPublicRooms/Can_search_public_room_list (0.11s)
PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroomalias_no_name (0.04s)
PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroomalias_with_name (0.04s)
PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroomalias_with_topic (0.04s)
PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroomalias_with_name_topic (0.04s)
PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroom_with_unicode_chars_name (0.04s)
PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroom_with_unicode_chars_topic (0.04s)
PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroom_with_unicode_chars_name_topic (0.05s)
PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct (0.34s)
PASS tests/csapi.TestPublicRooms (1.84s)
PASS tests/csapi.TestPushRuleCacheHealth (1.48s)
PASS tests/csapi.TestPushSync/Push_rules_come_down_in_an_initial_/sync (0.01s)
PASS tests/csapi.TestPushSync/Adding_a_push_rule_wakes_up_an_incremental_/sync (0.01s)
PASS tests/csapi.TestPushSync/Disabling_a_push_rule_wakes_up_an_incremental_/sync (0.01s)
PASS tests/csapi.TestPushSync/Enabling_a_push_rule_wakes_up_an_incremental_/sync (0.01s)
PASS tests/csapi.TestPushSync/Setting_actions_for_a_push_rule_wakes_up_an_incremental_/sync (0.01s)
PASS tests/csapi.TestPushSync (1.32s)
PASS tests/csapi.TestNotPresentUserCannotBanOthers (1.58s)
FAIL tests/csapi.TestCannotKickNonPresentUser (2.42s)
FAIL tests.TestOutboundFederationEventSizeGetMissingEvents (9.58s)
PASS tests/csapi.TestCannotKickLeftUser (1.66s)
FAIL tests/csapi.TestLeftRoomFixture/Can_get_rooms/{roomId}/state_for_a_departed_room (0.00s)
FAIL tests/csapi.TestLeftRoomFixture/Can_get_rooms/{roomId}/members_for_a_departed_room (0.00s)
PASS tests/csapi.TestLeftRoomFixture/Can_get_rooms/{roomId}/messages_for_a_departed_room (0.01s)
FAIL tests/csapi.TestLeftRoomFixture/Can_get_'m.room.name'_state_for_a_departed_room (0.00s)
PASS tests/csapi.TestLeftRoomFixture/Getting_messages_going_forward_is_limited_for_a_departed_room (0.00s)
FAIL tests/csapi.TestLeftRoomFixture (3.07s)
PASS tests/csapi.TestGetRoomMembers (1.74s)
FAIL tests.TestCorruptedAuthChain (8.24s)
FAIL tests/csapi.TestGetRoomMembersAtPoint (2.74s)
PASS tests/csapi.TestGetFilteredRoomMembers/not_membership (0.00s)
PASS tests/csapi.TestGetFilteredRoomMembers/membership/leave (0.00s)
PASS tests/csapi.TestGetFilteredRoomMembers/membership/join (0.00s)
PASS tests/csapi.TestGetFilteredRoomMembers (2.00s)
PASS tests.TestFederationRejectInvite (3.49s)
FAIL tests/csapi.TestSendAndFetchMessage (2.72s)
PASS tests.TestJoinViaRoomIDAndServerName (2.82s)
PASS tests/csapi.TestFetchMessagesFromNonExistentRoom (1.79s)
PASS tests/csapi.TestSendMessageWithTxn (1.53s)
PASS tests.TestJoinFederatedRoomFailOver (3.42s)
PASS tests/csapi.TestRoomMessagesLazyLoading (1.81s)
PASS tests.TestJoinFederatedRoomWithUnverifiableEvents//send_join_response_missing_signatures_shouldn't_block_room_join (0.12s)
PASS tests.TestJoinFederatedRoomWithUnverifiableEvents//send_join_response_with_bad_signatures_shouldn't_block_room_join (0.09s)
PASS tests.TestJoinFederatedRoomWithUnverifiableEvents//send_join_response_with_unobtainable_keys_shouldn't_block_room_join (0.06s)
PASS tests.TestJoinFederatedRoomWithUnverifiableEvents//send_join_response_with_state_with_unverifiable_auth_events_shouldn't_block_room_join (0.06s)
PASS tests.TestJoinFederatedRoomWithUnverifiableEvents (2.35s)
PASS tests/csapi.TestRoomMessagesLazyLoadingLocalUser (1.55s)
PASS tests.TestBannedUserCannotSendJoin (6.97s)
PASS tests.TestCannotSendNonJoinViaSendJoinV1/regular_event (0.02s)
PASS tests.TestCannotSendNonJoinViaSendJoinV1/non-state_membership_event (0.01s)
PASS tests.TestCannotSendNonJoinViaSendJoinV1/leave_event (0.01s)
PASS tests.TestCannotSendNonJoinViaSendJoinV1/knock_event (0.01s)
PASS tests.TestCannotSendNonJoinViaSendJoinV1/invite_event (0.01s)
PASS tests.TestCannotSendNonJoinViaSendJoinV1/event_with_mismatched_state_key (0.01s)
PASS tests.TestCannotSendNonJoinViaSendJoinV1 (7.50s)
PASS tests.TestCannotSendNonJoinViaSendJoinV2/regular_event (0.02s)
PASS tests.TestCannotSendNonJoinViaSendJoinV2/non-state_membership_event (0.01s)
PASS tests.TestCannotSendNonJoinViaSendJoinV2/leave_event (0.01s)
PASS tests.TestCannotSendNonJoinViaSendJoinV2/knock_event (0.01s)
PASS tests.TestCannotSendNonJoinViaSendJoinV2/invite_event (0.02s)
PASS tests.TestCannotSendNonJoinViaSendJoinV2/event_with_mismatched_state_key (0.01s)
PASS tests.TestCannotSendNonJoinViaSendJoinV2 (2.34s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/regular_event (0.02s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/non-state_membership_event (0.01s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/join_event (0.01s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/knock_event (0.01s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/invite_event (0.01s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/event_with_mismatched_state_key (0.01s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV1 (3.38s)
PASS tests/csapi.TestMessagesOverFederation/Visible_shared_history_after_joining_new_room_(backfill)/`messagesRequestLimit`_is_lower_than_the_number_of_messages_backfilled_(assumed) (1.12s)
PASS tests/csapi.TestMessagesOverFederation/Visible_shared_history_after_joining_new_room_(backfill)/`messagesRequestLimit`_is_greater_than_the_number_of_messages_backfilled_(in_Synapse,_100) (14.79s)
PASS tests/csapi.TestMessagesOverFederation/Visible_shared_history_after_joining_new_room_(backfill) (15.91s)
FAIL tests/csapi.TestMessagesOverFederation/Visible_shared_history_after_re-joining_room_(backfill)/`messagesRequestLimit`_is_lower_than_the_number_of_messages_backfilled_(assumed) (1.34s)
FAIL tests/csapi.TestMessagesOverFederation/Visible_shared_history_after_re-joining_room_(backfill) (1.34s)
FAIL tests/csapi.TestMessagesOverFederation (21.41s)
PASS tests/csapi.TestAvatarUrlUpdate (1.61s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/regular_event (0.01s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/non-state_membership_event (0.02s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/join_event (0.01s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/knock_event (0.01s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/invite_event (0.01s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/event_with_mismatched_state_key (0.01s)
PASS tests.TestCannotSendNonLeaveViaSendLeaveV2 (4.40s)
PASS tests/csapi.TestDisplayNameUpdate (2.01s)
PASS tests/csapi.TestRelations (1.81s)
FAIL tests/csapi.TestRelationsPagination (2.87s)
FAIL tests.TestSendJoinPartialStateResponse (6.64s)
PASS tests/csapi.TestRelationsPaginationSync (1.66s)
FAIL tests/csapi.TestThreadsEndpoint (3.10s)
PASS tests/csapi.TestTyping/Typing_notification_sent_to_local_room_members (0.00s)
PASS tests/csapi.TestTyping/Typing_can_be_explicitly_stopped (0.00s)
PASS tests/csapi.TestTyping/Typing_events_DO_NOT_include_a_`room_id`_field (0.00s)
PASS tests/csapi.TestTyping (1.43s)
PASS tests/csapi.TestLeakyTyping (2.45s)
FAIL tests/csapi.TestPushRuleRoomUpgrade/parallel/joining_a_remote_manually_upgraded_room_carries_over_existing_push_rules (5.99s)
FAIL tests/csapi.TestPushRuleRoomUpgrade/parallel/joining_a_remote_upgraded_room_carries_over_existing_push_rules (6.01s)
FAIL tests/csapi.TestPushRuleRoomUpgrade/parallel/upgrading_a_room_carries_over_existing_push_rules_for_local_users (6.04s)
FAIL tests/csapi.TestPushRuleRoomUpgrade/parallel/manually_upgrading_a_room_carries_over_existing_push_rules_for_local_users (6.06s)
FAIL tests/csapi.TestPushRuleRoomUpgrade/parallel (0.00s)
FAIL tests/csapi.TestPushRuleRoomUpgrade (9.98s)
PASS tests/csapi.TestRoomsInvite/Parallel/Users_cannot_invite_themselves_to_a_room (0.06s)
PASS tests/csapi.TestRoomsInvite/Parallel/Can_invite_users_to_invite-only_rooms (0.08s)
PASS tests/csapi.TestRoomsInvite/Parallel/Invited_user_can_reject_invite (0.19s)
PASS tests/csapi.TestRoomsInvite/Parallel/Invited_user_can_see_room_metadata (0.16s)
PASS tests/csapi.TestRoomsInvite/Parallel/Uninvited_users_cannot_join_the_room (0.05s)
PASS tests/csapi.TestRoomsInvite/Parallel/Test_that_we_can_be_reinvited_to_a_room_we_created (0.28s)
PASS tests/csapi.TestRoomsInvite/Parallel/Users_cannot_invite_a_user_that_is_already_in_the_room (0.22s)
PASS tests/csapi.TestRoomsInvite/Parallel/Invited_user_can_reject_invite_for_empty_room (1.17s)
PASS tests/csapi.TestRoomsInvite/Parallel (0.00s)
PASS tests/csapi.TestRoomsInvite (2.97s)
PASS tests/csapi.TestMembersLocal/Parallel/Existing_members_see_new_members'_join_events (0.02s)
PASS tests/csapi.TestMembersLocal/Parallel/New_room_members_see_their_own_join_event (0.02s)
PASS tests/csapi.TestMembersLocal/Parallel/Existing_members_see_new_members'_presence_(in_initial_sync) (0.04s)
FAIL tests/csapi.TestMembersLocal/Parallel/Existing_members_see_new_members'_presence_(in_incremental_sync) (5.06s)
FAIL tests/csapi.TestMembersLocal/Parallel (0.00s)
FAIL tests/csapi.TestMembersLocal (7.60s)
FAIL tests.TestJoinFederatedRoomFromApplicationServiceBridgeUser/join_remote_federated_room_as_application_service_user (0.03s)
FAIL tests.TestJoinFederatedRoomFromApplicationServiceBridgeUser (29.70s)
FAIL tests/csapi.TestRoomCreationReportsEventsToMyself/parallel/Room_creation_reports_m.room.create_to_myself (0.02s)
PASS tests/csapi.TestRoomCreationReportsEventsToMyself/parallel/Room_creation_reports_m.room.member_to_myself (0.02s)
PASS tests/csapi.TestRoomCreationReportsEventsToMyself/parallel/Setting_room_topic_reports_m.room.topic_to_myself (0.05s)
FAIL tests/csapi.TestRoomCreationReportsEventsToMyself/parallel/Setting_state_twice_is_idempotent (0.06s)
PASS tests/csapi.TestRoomCreationReportsEventsToMyself/parallel/Joining_room_twice_is_idempotent (5.07s)
FAIL tests/csapi.TestRoomCreationReportsEventsToMyself/parallel (0.00s)
FAIL tests/csapi.TestRoomCreationReportsEventsToMyself (7.70s)
PASS tests.TestOutboundFederationSend (5.79s)
PASS tests/csapi.TestSyncLeaveSection/Left_rooms_appear_in_the_leave_section_of_sync (0.01s)
PASS tests/csapi.TestSyncLeaveSection/Left_rooms_appear_in_the_leave_section_of_full_state_sync (0.01s)
PASS tests/csapi.TestSyncLeaveSection/Newly_left_rooms_appear_in_the_leave_section_of_incremental_sync (0.01s)
PASS tests/csapi.TestSyncLeaveSection (1.64s)
PASS tests/csapi.TestGappedSyncLeaveSection (2.01s)
PASS tests.TestNetworkPartitionOrdering (6.23s)
FAIL tests/csapi.TestArchivedRoomsHistory/timeline_has_events/initial_sync (0.01s)
FAIL tests/csapi.TestArchivedRoomsHistory/timeline_has_events/incremental_sync (0.01s)
FAIL tests/csapi.TestArchivedRoomsHistory/timeline_has_events (0.01s)
FAIL tests/csapi.TestArchivedRoomsHistory/timeline_is_empty/initial_sync (0.01s)
SKIP tests/csapi.TestArchivedRoomsHistory/timeline_is_empty/incremental_sync (0.00s)
FAIL tests/csapi.TestArchivedRoomsHistory/timeline_is_empty (0.01s)
FAIL tests/csapi.TestArchivedRoomsHistory (2.69s)
PASS tests.TestRemoteTyping (2.85s)
FAIL tests/csapi.TestOlderLeftRoomsNotInLeaveSection (3.56s)
FAIL tests/csapi.TestLeaveEventVisibility (2.77s)
PASS tests/csapi.TestLeaveEventInviteRejection (1.86s)
PASS tests/csapi.TestSyncFilter/Can_create_filter (0.00s)
PASS tests/csapi.TestSyncFilter/Can_download_filter (0.00s)
PASS tests/csapi.TestSyncFilter (1.73s)
PASS tests/csapi.TestCumulativeJoinLeaveJoinSync (1.85s)
PASS tests.TestFederationRoomsInvite/Parallel/Invited_user_has_'is_direct'_flag_in_prev_content_after_joining (0.56s)
PASS tests.TestFederationRoomsInvite/Parallel/Invited_user_can_reject_invite_over_federation (0.16s)
PASS tests.TestFederationRoomsInvite/Parallel/Invited_user_can_reject_invite_over_federation_for_empty_room (0.35s)
PASS tests.TestFederationRoomsInvite/Parallel/Remote_invited_user_can_join_the_room_when_homeserver_is_already_participating_in_the_room (0.67s)
PASS tests.TestFederationRoomsInvite/Parallel/Non-invitee_user_cannot_rescind_invite_over_federation (0.91s)
PASS tests.TestFederationRoomsInvite/Parallel/Remote_invited_user_can_reject_invite_when_homeserver_is_already_participating_in_the_room (0.88s)
PASS tests.TestFederationRoomsInvite/Parallel/Remote_invited_user_can_see_room_metadata (0.33s)
PASS tests.TestFederationRoomsInvite/Parallel/Invited_user_can_reject_invite_over_federation_several_times (0.99s)
FAIL tests.TestFederationRoomsInvite/Parallel/Inviter_user_can_rescind_invite_over_federation (5.31s)
FAIL tests.TestFederationRoomsInvite/Parallel (0.56s)
FAIL tests.TestFederationRoomsInvite (10.49s)
PASS tests/csapi.TestTentativeEventualJoiningAfterRejecting (1.84s)
PASS tests.TestSyncOmitsStateChangeOnFilteredEvents (3.63s)
FAIL tests/csapi.TestSync/parallel/Newly_joined_room_includes_presence_in_incremental_sync (5.11s)
FAIL tests/csapi.TestSync/parallel/Get_presence_for_newly_joined_members_in_incremental_sync (5.16s)
FAIL tests/csapi.TestSync/parallel/Device_list_tracking/User_is_correctly_listed_when_they_leave,_even_when_lazy_loading_is_enabled (5.17s)
FAIL tests/csapi.TestSync/parallel/Device_list_tracking (5.17s)
PASS tests/csapi.TestSync/parallel/Can_sync_a_joined_room (0.12s)
PASS tests/csapi.TestSync/parallel/Newly_joined_room_is_included_in_an_incremental_sync (0.20s)
PASS tests/csapi.TestSync/parallel/Full_state_sync_includes_joined_rooms (0.17s)
FAIL tests/csapi.TestSync/parallel/Newly_joined_room_has_correct_timeline_in_incremental_sync (0.55s)
FAIL tests/csapi.TestSync/parallel/sync_should_succeed_even_if_the_sync_token_points_to_a_redaction_of_an_unknown_event (11.73s)
FAIL tests/csapi.TestSync/parallel (15.44s)
FAIL tests/csapi.TestSync (30.02s)
PASS tests/csapi.TestSyncTimelineGap/incremental (0.01s)
PASS tests/csapi.TestSyncTimelineGap/full (0.03s)
PASS tests/csapi.TestSyncTimelineGap (2.44s)
PASS tests/csapi.TestPresenceSyncDifferentRooms (1.78s)
PASS tests/csapi.TestRoomSummary (2.00s)
FAIL tests/csapi.TestThreadedReceipts (7.71s)
FAIL tests/csapi.TestThreadReceiptsInSyncMSC4102 (9.33s)
PASS tests/csapi.TestToDeviceMessages (1.41s)
PASS tests/csapi.TestTxnInEvent (1.28s)
PASS tests/csapi.TestTxnScopeOnLocalEcho (1.60s)
PASS tests/csapi.TestTxnIdempotencyScopedToDevice (1.47s)
FAIL tests/csapi.TestTxnIdempotency (2.58s)
FAIL tests/csapi.TestTxnIdWithRefreshToken (2.37s)
PASS tests/csapi.TestUploadKey/Parallel/Can_upload_device_keys (0.00s)
PASS tests/csapi.TestUploadKey/Parallel/Can_query_device_keys_using_POST (0.00s)
PASS tests/csapi.TestUploadKey/Parallel/Can_query_specific_device_keys_using_POST (0.00s)
PASS tests/csapi.TestUploadKey/Parallel/query_for_user_with_no_keys_returns_empty_key_dict (0.00s)
FAIL tests/csapi.TestUploadKey/Parallel/Can_claim_one_time_key_using_POST (0.00s)
PASS tests/csapi.TestUploadKey/Parallel/Rejects_invalid_device_keys (0.00s)
PASS tests/csapi.TestUploadKey/Parallel/Should_reject_keys_claiming_to_belong_to_a_different_user (0.00s)
FAIL tests/csapi.TestUploadKey/Parallel (0.01s)
FAIL tests/csapi.TestUploadKey (2.38s)
PASS tests/csapi.TestKeyClaimOrdering (2.33s)
FAIL tests/csapi.TestUploadKeyIdempotency (2.44s)
FAIL tests/csapi.TestUploadKeyIdempotencyOverlap (2.41s)
FAIL tests/csapi.TestUrlPreview (2.45s)
PASS tests/csapi.TestRoomSpecificUsernameChange/Eve_can_find_Alice_by_profile_display_name (0.00s)
PASS tests/csapi.TestRoomSpecificUsernameChange/Eve_can_find_Alice_by_mxid (0.00s)
PASS tests/csapi.TestRoomSpecificUsernameChange/Eve_cannot_find_Alice_by_room-specific_name_that_Eve_is_not_privy_to (0.00s)
PASS tests/csapi.TestRoomSpecificUsernameChange/Bob_can_find_Alice_by_profile_display_name (0.00s)
PASS tests/csapi.TestRoomSpecificUsernameChange/Bob_can_find_Alice_by_mxid (0.00s)
PASS tests/csapi.TestRoomSpecificUsernameChange (14.19s)
PASS tests/csapi.TestRoomSpecificUsernameAtJoin/Eve_can_find_Alice_by_profile_display_name (0.00s)
PASS tests/csapi.TestRoomSpecificUsernameAtJoin/Eve_can_find_Alice_by_mxid (0.00s)
PASS tests/csapi.TestRoomSpecificUsernameAtJoin/Eve_cannot_find_Alice_by_room-specific_name_that_Eve_is_not_privy_to (0.00s)
PASS tests/csapi.TestRoomSpecificUsernameAtJoin/Bob_can_find_Alice_by_profile_display_name (0.00s)
PASS tests/csapi.TestRoomSpecificUsernameAtJoin/Bob_can_find_Alice_by_mxid (0.00s)
PASS tests/csapi.TestRoomSpecificUsernameAtJoin (1.61s)
PASS tests/csapi.TestKeysQueryWithDeviceIDAsObjectFails (1.40s)
  FAIL Package tests/csapi (6m51.008s)

PASS tests.TestToDeviceMessagesOverFederation/good_connectivity (1.15s)
FAIL tests.TestToDeviceMessagesOverFederation/interrupted_connectivity (62.61s)
FAIL tests.TestToDeviceMessagesOverFederation/stopped_server (93.90s)
FAIL tests.TestToDeviceMessagesOverFederation (161.34s)
PASS tests.TestUnrejectRejectedEvents (3.54s)
FAIL tests.TestFederationKeyUploadQuery/Can_claim_remote_one_time_key_using_POST (0.02s)
FAIL tests.TestFederationKeyUploadQuery/Can_query_remote_device_keys_using_POST (5.04s)
FAIL tests.TestFederationKeyUploadQuery (9.38s)
PASS tests.TestKnockingInMSC3787Room/Knocking_on_a_room_with_a_join_rule_other_than_'knock'_should_fail (0.01s)
PASS tests.TestKnockingInMSC3787Room/Change_the_join_rule_of_a_room_from_'invite'_to_'knock' (0.02s)
PASS tests.TestKnockingInMSC3787Room/Attempting_to_join_a_room_with_join_rule_'knock'_without_an_invite_should_fail (0.00s)
FAIL tests.TestKnockingInMSC3787Room/Knocking_on_a_room_with_join_rule_'knock'_should_succeed (5.04s)
FAIL tests.TestKnockingInMSC3787Room/A_user_that_has_already_knocked_is_allowed_to_knock_again_on_the_same_room (5.04s)
FAIL tests.TestKnockingInMSC3787Room/Users_in_the_room_see_a_user's_membership_update_when_they_knock (0.01s)
FAIL tests.TestKnockingInMSC3787Room/A_user_that_has_knocked_on_a_local_room_can_rescind_their_knock_and_then_knock_again (5.06s)
FAIL tests.TestKnockingInMSC3787Room/A_user_in_the_room_can_reject_a_knock (5.07s)
FAIL tests.TestKnockingInMSC3787Room/A_user_can_knock_on_a_room_without_a_reason (5.05s)
PASS tests.TestKnockingInMSC3787Room/A_user_in_the_room_can_accept_a_knock (0.03s)
PASS tests.TestKnockingInMSC3787Room/A_user_cannot_knock_on_a_room_they_are_already_invited_to (0.00s)
PASS tests.TestKnockingInMSC3787Room/A_user_cannot_knock_on_a_room_they_are_already_in (0.01s)
PASS tests.TestKnockingInMSC3787Room/A_user_that_is_banned_from_a_room_cannot_knock_on_it (0.03s)
PASS tests.TestKnockingInMSC3787Room/Knocking_on_a_room_with_a_join_rule_other_than_'knock'_should_fail#01 (0.35s)
PASS tests.TestKnockingInMSC3787Room/Change_the_join_rule_of_a_room_from_'invite'_to_'knock'#01 (0.03s)
PASS tests.TestKnockingInMSC3787Room/Attempting_to_join_a_room_with_join_rule_'knock'_without_an_invite_should_fail#01 (0.01s)
FAIL tests.TestKnockingInMSC3787Room/Knocking_on_a_room_with_join_rule_'knock'_should_succeed#01 (5.17s)
FAIL tests.TestKnockingInMSC3787Room/A_user_that_has_already_knocked_is_allowed_to_knock_again_on_the_same_room#01 (5.13s)
FAIL tests.TestKnockingInMSC3787Room/Users_in_the_room_see_a_user's_membership_update_when_they_knock#01 (0.02s)
FAIL tests.TestKnockingInMSC3787Room/A_user_in_the_room_can_reject_a_knock#01 (5.23s)
FAIL tests.TestKnockingInMSC3787Room/A_user_can_knock_on_a_room_without_a_reason#01 (5.15s)
PASS tests.TestKnockingInMSC3787Room/A_user_in_the_room_can_accept_a_knock#01 (0.06s)
PASS tests.TestKnockingInMSC3787Room/A_user_cannot_knock_on_a_room_they_are_already_invited_to#01 (0.00s)
PASS tests.TestKnockingInMSC3787Room/A_user_cannot_knock_on_a_room_they_are_already_in#01 (0.18s)
PASS tests.TestKnockingInMSC3787Room/A_user_that_is_banned_from_a_room_cannot_knock_on_it#01 (0.05s)
FAIL tests.TestKnockingInMSC3787Room (51.96s)
FAIL tests.TestKnockRoomsInPublicRoomsDirectoryInMSC3787Room (2.60s)
PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/regular_event (0.02s)
PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/non-state_membership_event (0.01s)
PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/join_event (0.01s)
PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/leave_event (0.01s)
PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/invite_event (0.01s)
PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/event_with_mismatched_state_key (0.01s)
PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room (3.26s)
PASS tests.TestRestrictedRoomsLocalJoinInMSC3787Room/Join_should_fail_initially (0.01s)
FAIL tests.TestRestrictedRoomsLocalJoinInMSC3787Room/Join_should_succeed_when_joined_to_allowed_room (0.04s)
PASS tests.TestRestrictedRoomsLocalJoinInMSC3787Room/Join_should_fail_when_left_allowed_room (0.04s)
PASS tests.TestRestrictedRoomsLocalJoinInMSC3787Room/Join_should_succeed_when_invited (0.04s)
PASS tests.TestRestrictedRoomsLocalJoinInMSC3787Room/Join_should_fail_with_mangled_join_rules (0.06s)
FAIL tests.TestRestrictedRoomsLocalJoinInMSC3787Room (2.56s)
PASS tests.TestRestrictedRoomsRemoteJoinInMSC3787Room/Join_should_fail_initially (0.29s)
FAIL tests.TestRestrictedRoomsRemoteJoinInMSC3787Room/Join_should_succeed_when_joined_to_allowed_room (0.32s)
PASS tests.TestRestrictedRoomsRemoteJoinInMSC3787Room/Join_should_fail_when_left_allowed_room (0.10s)
PASS tests.TestRestrictedRoomsRemoteJoinInMSC3787Room/Join_should_succeed_when_invited (0.38s)
PASS tests.TestRestrictedRoomsRemoteJoinInMSC3787Room/Join_should_fail_with_mangled_join_rules (0.08s)
FAIL tests.TestRestrictedRoomsRemoteJoinInMSC3787Room (5.05s)
FAIL tests.TestRestrictedRoomsRemoteJoinLocalUserInMSC3787Room (4.43s)
PASS tests.TestRestrictedRoomsRemoteJoinFailOverInMSC3787Room (3.87s)
PASS tests.TestKnockRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV12 (2.49s)
PASS tests.TestKnockRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV11 (2.46s)
PASS tests.TestKnocking/Knocking_on_a_room_with_a_join_rule_other_than_'knock'_should_fail (0.01s)
PASS tests.TestKnocking/Change_the_join_rule_of_a_room_from_'invite'_to_'knock' (0.02s)
PASS tests.TestKnocking/Attempting_to_join_a_room_with_join_rule_'knock'_without_an_invite_should_fail (0.00s)
FAIL tests.TestKnocking/Knocking_on_a_room_with_join_rule_'knock'_should_succeed (5.03s)
FAIL tests.TestKnocking/A_user_that_has_already_knocked_is_allowed_to_knock_again_on_the_same_room (5.04s)
FAIL tests.TestKnocking/Users_in_the_room_see_a_user's_membership_update_when_they_knock (0.01s)
FAIL tests.TestKnocking/A_user_that_has_knocked_on_a_local_room_can_rescind_their_knock_and_then_knock_again (5.06s)
FAIL tests.TestKnocking/A_user_in_the_room_can_reject_a_knock (5.07s)
FAIL tests.TestKnocking/A_user_can_knock_on_a_room_without_a_reason (5.05s)
PASS tests.TestKnocking/A_user_in_the_room_can_accept_a_knock (0.03s)
PASS tests.TestKnocking/A_user_cannot_knock_on_a_room_they_are_already_invited_to (0.00s)
PASS tests.TestKnocking/A_user_cannot_knock_on_a_room_they_are_already_in (0.01s)
PASS tests.TestKnocking/A_user_that_is_banned_from_a_room_cannot_knock_on_it (0.03s)
PASS tests.TestKnocking/Knocking_on_a_room_with_a_join_rule_other_than_'knock'_should_fail#01 (0.18s)
PASS tests.TestKnocking/Change_the_join_rule_of_a_room_from_'invite'_to_'knock'#01 (0.03s)
PASS tests.TestKnocking/Attempting_to_join_a_room_with_join_rule_'knock'_without_an_invite_should_fail#01 (0.01s)
FAIL tests.TestKnocking/Knocking_on_a_room_with_join_rule_'knock'_should_succeed#01 (5.18s)
FAIL tests.TestKnocking/A_user_that_has_already_knocked_is_allowed_to_knock_again_on_the_same_room#01 (5.13s)
FAIL tests.TestKnocking/Users_in_the_room_see_a_user's_membership_update_when_they_knock#01 (0.02s)
FAIL tests.TestKnocking/A_user_in_the_room_can_reject_a_knock#01 (5.22s)
FAIL tests.TestKnocking/A_user_can_knock_on_a_room_without_a_reason#01 (5.15s)
PASS tests.TestKnocking/A_user_in_the_room_can_accept_a_knock#01 (0.07s)
PASS tests.TestKnocking/A_user_cannot_knock_on_a_room_they_are_already_invited_to#01 (0.00s)
PASS tests.TestKnocking/A_user_cannot_knock_on_a_room_they_are_already_in#01 (0.18s)
PASS tests.TestKnocking/A_user_that_is_banned_from_a_room_cannot_knock_on_it#01 (0.07s)
FAIL tests.TestKnocking (55.23s)
FAIL tests.TestKnockRoomsInPublicRoomsDirectory (2.37s)
PASS tests.TestCannotSendNonKnockViaSendKnock/regular_event (0.01s)
PASS tests.TestCannotSendNonKnockViaSendKnock/non-state_membership_event (0.01s)
PASS tests.TestCannotSendNonKnockViaSendKnock/join_event (0.01s)
PASS tests.TestCannotSendNonKnockViaSendKnock/leave_event (0.01s)
PASS tests.TestCannotSendNonKnockViaSendKnock/invite_event (0.01s)
PASS tests.TestCannotSendNonKnockViaSendKnock/event_with_mismatched_state_key (0.01s)
PASS tests.TestCannotSendNonKnockViaSendKnock (1.81s)
PASS tests.TestMediaFilenames/Parallel/ASCII/Can_upload_with_ASCII_file_name (0.01s)
PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'name;with;semicolons'_over_/_matrix/client/v1/media/download (0.01s)
FAIL tests.TestMediaFilenames/Parallel/ASCII/Can_download_specifying_a_different_ASCII_file_name_over__matrix/client/v1/media/download (0.01s)
PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_specifying_a_different_ASCII_file_name (0.01s)
PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'name;with;semicolons' (0.00s)
PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'name_with_spaces'_over_/_matrix/client/v1/media/download (0.00s)
PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'name_with_spaces' (0.00s)
PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'ascii'_over_/_matrix/client/v1/media/download (0.00s)
PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'ascii' (0.00s)
FAIL tests.TestMediaFilenames/Parallel/ASCII (0.00s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Can_upload_with_Unicode_file_name (0.00s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_unsafe_media_types_as_attachments (0.06s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_safe_media_types_with_parameters_as_inline (0.01s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_safe_media_types_as_inline_via__matrix/client/v1/media/download (0.07s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Can_download_with_Unicode_file_name_over_federation_via__matrix/client/v1/media/download (0.14s)
FAIL tests.TestMediaFilenames/Parallel/Unicode/Can_download_specifying_a_different_Unicode_file_name_over__matrix/client/v1/media/download (0.01s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_safe_media_types_as_inline (0.01s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Can_download_with_Unicode_file_name_over_federation (0.01s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Can_download_with_Unicode_file_name_locally_over__matrix/client/v1/media/download (0.01s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Can_download_with_Unicode_file_name_locally (0.00s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Can_download_specifying_a_different_Unicode_file_name (0.00s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_unsafe_media_types_as_attachments_via__matrix/client/v1/media/download (0.18s)
PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_safe_media_types_with_parameters_as_inline_via__matrix/client/v1/media/download (0.18s)
FAIL tests.TestMediaFilenames/Parallel/Unicode (0.00s)
FAIL tests.TestMediaFilenames/Parallel (0.00s)
FAIL tests.TestMediaFilenames (3.91s)
PASS tests.TestMediaWithoutFileName/parallel/Can_upload_without_a_file_name (0.00s)
PASS tests.TestMediaWithoutFileName/parallel/Can_download_without_a_file_name_locally (0.01s)
PASS tests.TestMediaWithoutFileName/parallel/Can_download_without_a_file_name_over_federation (0.01s)
PASS tests.TestMediaWithoutFileName/parallel (0.00s)
PASS tests.TestMediaWithoutFileName (4.25s)
PASS tests.TestMediaWithoutFileNameCSMediaV1/parallel/Can_upload_without_a_file_name (0.00s)
PASS tests.TestMediaWithoutFileNameCSMediaV1/parallel/Can_download_without_a_file_name_locally (0.00s)
PASS tests.TestMediaWithoutFileNameCSMediaV1/parallel/Can_download_without_a_file_name_over_federation (0.19s)
PASS tests.TestMediaWithoutFileNameCSMediaV1/parallel (0.00s)
PASS tests.TestMediaWithoutFileNameCSMediaV1 (2.17s)
PASS tests.TestLocalPngThumbnail/test_/_matrix/media/v3_endpoint (0.08s)
PASS tests.TestLocalPngThumbnail/test_/_matrix/client/v1/media_endpoint (0.00s)
PASS tests.TestLocalPngThumbnail (1.92s)
PASS tests.TestRemotePngThumbnail/test_/_matrix/media/v3_endpoint (0.14s)
PASS tests.TestRemotePngThumbnail/test_/_matrix/client/v1/media_endpoint (0.00s)
PASS tests.TestRemotePngThumbnail (1.85s)
PASS tests.TestFederationThumbnail (4.11s)
FAIL tests.TestRestrictedRoomsSpacesSummaryLocal (2.44s)
PASS tests.TestRestrictedRoomsSpacesSummaryFederation (2.41s)
PASS tests.TestRestrictedRoomsLocalJoin/Join_should_fail_initially (0.01s)
FAIL tests.TestRestrictedRoomsLocalJoin/Join_should_succeed_when_joined_to_allowed_room (0.04s)
PASS tests.TestRestrictedRoomsLocalJoin/Join_should_fail_when_left_allowed_room (0.04s)
PASS tests.TestRestrictedRoomsLocalJoin/Join_should_succeed_when_invited (0.04s)
PASS tests.TestRestrictedRoomsLocalJoin/Join_should_fail_with_mangled_join_rules (0.06s)
FAIL tests.TestRestrictedRoomsLocalJoin (2.71s)
PASS tests.TestRestrictedRoomsRemoteJoin/Join_should_fail_initially (0.39s)
FAIL tests.TestRestrictedRoomsRemoteJoin/Join_should_succeed_when_joined_to_allowed_room (0.36s)
PASS tests.TestRestrictedRoomsRemoteJoin/Join_should_fail_when_left_allowed_room (0.09s)
PASS tests.TestRestrictedRoomsRemoteJoin/Join_should_succeed_when_invited (0.31s)
PASS tests.TestRestrictedRoomsRemoteJoin/Join_should_fail_with_mangled_join_rules (0.07s)
FAIL tests.TestRestrictedRoomsRemoteJoin (5.26s)
FAIL tests.TestRestrictedRoomsRemoteJoinLocalUser (4.43s)
PASS tests.TestRestrictedRoomsRemoteJoinFailOver (3.96s)
PASS tests.TestRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV12 (2.60s)
PASS tests.TestRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV11 (2.57s)
FAIL tests.TestClientSpacesSummary/query_whole_graph (0.02s)
PASS tests.TestClientSpacesSummary/max_depth (0.00s)
FAIL tests.TestClientSpacesSummary/suggested_only (0.00s)
FAIL tests.TestClientSpacesSummary/pagination (0.00s)
FAIL tests.TestClientSpacesSummary/redact_link (0.04s)
FAIL tests.TestClientSpacesSummary (3.01s)
FAIL tests.TestClientSpacesSummaryJoinRules (2.93s)
FAIL tests.TestFederatedClientSpaces (4.47s)
FAIL tests.TestJumpToDateEndpoint/parallel/federation/when_looking_backwards_before_the_room_was_created,_should_be_able_to_find_event_that_was_imported (0.06s)
FAIL tests.TestJumpToDateEndpoint/parallel/federation/looking_forwards,_should_be_able_to_find_event_that_was_sent_before_we_joined (0.42s)
FAIL tests.TestJumpToDateEndpoint/parallel/federation/looking_backwards,_should_be_able_to_find_event_that_was_sent_before_we_joined (0.45s)
FAIL tests.TestJumpToDateEndpoint/parallel/federation/can_paginate_after_getting_remote_event_from_timestamp_to_event_endpoint (0.50s)
FAIL tests.TestJumpToDateEndpoint/parallel/federation (0.00s)
FAIL tests.TestJumpToDateEndpoint/parallel/should_not_be_able_to_query_a_private_room_you_are_not_a_member_of (0.11s)
FAIL tests.TestJumpToDateEndpoint/parallel/should_find_event_after_given_timestamp (0.11s)
FAIL tests.TestJumpToDateEndpoint/parallel/should_not_be_able_to_query_a_public_room_you_are_not_a_member_of (0.14s)
FAIL tests.TestJumpToDateEndpoint/parallel/should_find_next_event_topologically_after_given_timestamp_when_all_message_timestamps_are_the_same (0.26s)
PASS tests.TestJumpToDateEndpoint/parallel/should_find_nothing_after_the_latest_timestamp (0.19s)
FAIL tests.TestJumpToDateEndpoint/parallel/should_find_next_event_topologically_before_given_timestamp_when_all_message_timestamps_are_the_same (0.22s)
PASS tests.TestJumpToDateEndpoint/parallel/should_find_nothing_before_the_earliest_timestamp (0.23s)
FAIL tests.TestJumpToDateEndpoint/parallel/should_find_event_before_given_timestamp (0.18s)
FAIL tests.TestJumpToDateEndpoint/parallel (0.50s)
FAIL tests.TestJumpToDateEndpoint (4.72s)
PASS tests.TestUnknownEndpoints/Unknown_prefix (0.00s)
PASS tests.TestUnknownEndpoints/Client-server_endpoints (0.00s)
PASS tests.TestUnknownEndpoints/Server-server_endpoints (0.00s)
FAIL tests.TestUnknownEndpoints/Key_endpoints (0.00s)
PASS tests.TestUnknownEndpoints/Media_endpoints (0.00s)
FAIL tests.TestUnknownEndpoints (2.41s)
PASS tests.TestMSC4289PrivilegedRoomCreators/PL_event_is_missing_creator_in_users_map (0.03s)
PASS tests.TestMSC4289PrivilegedRoomCreators/m.room.tombstone_needs_PL150_in_the_PL_event (0.02s)
FAIL tests.TestMSC4289PrivilegedRoomCreators/creator_cannot_set_self_in_PL_event (0.03s)
PASS tests.TestMSC4289PrivilegedRoomCreators/creator_can_kick_admin (0.08s)
PASS tests.TestMSC4289PrivilegedRoomCreators/creator_can_kick_admin_above_PL100 (0.08s)
PASS tests.TestMSC4289PrivilegedRoomCreators/creator_can_kick_admin_at_JSON_max_value (0.09s)
PASS tests.TestMSC4289PrivilegedRoomCreators/power_level_cannot_be_set_beyond_max_canonical_JSON_int (0.04s)
PASS tests.TestMSC4289PrivilegedRoomCreators/admin_with_>PL100_cannot_kick_creator (0.09s)
FAIL tests.TestMSC4289PrivilegedRoomCreators/admin_with_>PL100_sorts_after_the_room_creator_for_state_resolution (2.31s)
PASS tests.TestMSC4289PrivilegedRoomCreators/power_level_content_override_can_be_set (0.04s)
FAIL tests.TestMSC4289PrivilegedRoomCreators/power_level_content_override_cannot_set_the_room_creator (0.03s)
FAIL tests.TestMSC4289PrivilegedRoomCreators (5.25s)
FAIL tests.TestMSC4289PrivilegedRoomCreators_Additional (2.49s)
FAIL tests.TestMSC4289PrivilegedRoomCreators_InvitedAreCreators (2.36s)
FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalCreatorsAndInvited (2.46s)
FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation/additional_creators_isn't_an_array (0.00s)
FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation/additional_creators_elements_aren't_strings (0.00s)
FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation/additional_creators_elements_aren't_user_ID_strings (0.00s)
FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation/additional_creators_elements_aren't_valid_user_ID_strings_(domain) (0.00s)
PASS tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation/additional_creators_are_valid (0.02s)
FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation (2.76s)
FAIL tests.TestMSC4289PrivilegedRoomCreators_Upgrades (2.86s)
PASS tests.TestMSC4291RoomIDAsHashOfCreateEvent (1.39s)
PASS tests.TestComplementCanCreateValidV12Rooms (2.30s)
PASS tests.TestMSC4291RoomIDAsHashOfCreateEvent_AuthEventsOmitsCreateEvent (4.63s)
PASS tests.TestMSC4291RoomIDAsHashOfCreateEvent_UpgradedRooms (1.74s)
PASS tests.TestMSC4291RoomIDAsHashOfCreateEvent_CannotSendCreateEvent (1.53s)
PASS tests.TestMSC4291RoomIDAsHashOfCreateEvent_RoomIDIsOnCreateEvent (1.32s)
FAIL tests.TestMSC4297StateResolutionV2_1_starts_from_empty_set (15.55s)
FAIL tests.TestMSC4297StateResolutionV2_1_includes_conflicted_subgraph (19.47s)
FAIL tests.TestMSC4311FullCreateEventOnStrippedState (3.87s)
  FAIL Package tests (12m45.767s)


=== Skipped
=== SKIP: tests/csapi TestCanRegisterAdmin (1.71s)
    admin_test.go:21: Deploy times: 1.852881ms blueprints, 1.518405072s containers
    client.go:845: [CSAPI] GET hs1/_synapse/admin/v1/register => 404 Not Found (1.770363ms)
    auth.go:130: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404

=== SKIP: tests/csapi TestServerNotices (1.77s)
    admin_test.go:30: Deploy times: 1.59209ms blueprints, 1.55048693s containers
    client.go:845: [CSAPI] GET hs1/_synapse/admin/v1/register => 404 Not Found (2.949981ms)
    auth.go:130: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404

=== SKIP: tests/csapi TestRegistration/parallel/POST_/_synapse/admin/v1/register_admin_with_shared_secret (0.00s)
    apidoc_register_test.go:318: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404
        --- SKIP: TestRegistration/parallel/POST_/_synapse/admin/v1/register_admin_with_shared_secret (0.00s)

=== SKIP: tests/csapi TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret (0.00s)
    apidoc_register_test.go:318: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404
        --- SKIP: TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret (0.00s)

=== SKIP: tests/csapi TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_disallows_symbols (0.00s)
    apidoc_register_test.go:318: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404
        --- SKIP: TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_disallows_symbols (0.00s)

=== SKIP: tests/csapi TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_downcases_capitals (0.00s)
    apidoc_register_test.go:318: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404
        --- SKIP: TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_downcases_capitals (0.00s)

=== SKIP: tests/csapi TestArchivedRoomsHistory/timeline_is_empty/incremental_sync (0.00s)
    sync_archive_test.go:293: Synapse doesn't return the room at all!
2026/02/25 13:51:29 ============================================


2026/02/25 13:51:29 bf27bbc3bdba3dccda26f912b176ddb1b793b58f08f49bd545877226be3cfcd3 : Server logs:
Guys, i'm very excited to announce my first major run of the complement test suite. It is a partial run, but with about 75% of tests passing, I'm very excited and surprised at how little work may remain to bring that number to 95% or more. Log summary is below. Link to run (logs held for 90 days is here). I'm now able to see exactly which tests pass, fail, or are skipped, and to compare major code changes I make on other branches with the baseline `main` branch. https://github.com/gamesguru/continuwuity/actions/runs/22398947097/job/64839874933 ```log DONE 739 tests, 8 skipped, 245 failures in 765.767s Run ./bin/complement ./complement-src removed 'complement_test_logs.jsonl' removed 'complement_test_results.jsonl' running go test with: $COMPLEMENT_SRC: ./complement-src $COMPLEMENT_BASE_IMAGE: continuwuity:complement $RESULTS_FILE: complement_test_results.jsonl $LOG_FILE: complement_test_logs.jsonl PASS tests.TestWriteMDirectAccountData (15.79s) PASS tests.TestIsDirectFlagLocal (2.06s) PASS tests/csapi.TestChangePasswordPushers/Pushers_created_with_a_different_access_token_are_deleted_on_password_change (0.16s) PASS tests/csapi.TestChangePasswordPushers/Pushers_created_with_the_same_access_token_are_not_deleted_on_password_change (0.10s) PASS tests/csapi.TestChangePasswordPushers (16.03s) FAIL tests/msc3391.TestRemovingAccountData/Deleting_a_user's_account_data_via_DELETE_works (0.05s) FAIL tests/msc3391.TestRemovingAccountData/Deleting_a_user's_account_data_via_PUT_works (0.05s) FAIL tests/msc3391.TestRemovingAccountData/Deleting_a_user's_room_data_via_DELETE_works (0.05s) FAIL tests/msc3391.TestRemovingAccountData/Deleting_a_user's_room_account_data_via_PUT_works (0.05s) FAIL tests/msc3391.TestRemovingAccountData (15.20s) PASS tests/csapi.TestChangePassword/After_changing_password,_can't_log_in_with_old_password (0.11s) PASS tests/csapi.TestChangePassword/After_changing_password,_can_log_in_with_new_password (0.04s) PASS tests/csapi.TestChangePassword/After_changing_password,_existing_session_still_works (0.00s) PASS tests/csapi.TestChangePassword/After_changing_password,_a_different_session_no_longer_works_by_default (0.00s) PASS tests/csapi.TestChangePassword/After_changing_password,_different_sessions_can_optionally_be_kept (0.14s) PASS tests/csapi.TestChangePassword (1.92s) FAIL Package tests/msc3391 (20.552s) PASS tests/csapi.TestAddAccountData/Can_add_global_account_data (0.00s) PASS tests/csapi.TestAddAccountData/Can_add_room_account_data (0.05s) PASS tests/csapi.TestAddAccountData (1.68s) PASS tests/csapi.TestDeactivateAccount/Password_flow_is_available (0.00s) PASS tests/csapi.TestDeactivateAccount/Can't_deactivate_account_with_wrong_password (0.04s) PASS tests/csapi.TestDeactivateAccount/Can_deactivate_account (0.05s) PASS tests/csapi.TestDeactivateAccount/After_deactivating_account,_can't_log_in_with_password (0.00s) PASS tests/csapi.TestDeactivateAccount (2.05s) PASS tests.TestIsDirectFlagFederation (6.55s) SKIP tests/csapi.TestCanRegisterAdmin (1.71s) SKIP tests/csapi.TestServerNotices (1.77s) PASS tests/csapi.TestContent (2.17s) PASS tests/csapi.TestContentCSAPIMediaV1 (1.58s) FAIL tests/msc2836.TestEventRelationships (32.13s) PASS tests/csapi.TestDeviceManagement/GET_/device/{deviceId} (0.06s) PASS tests/csapi.TestDeviceManagement/GET_/device/{deviceId}_gives_a_404_for_unknown_devices (0.00s) PASS tests/csapi.TestDeviceManagement/GET_/devices (0.04s) PASS tests/csapi.TestDeviceManagement/PUT_/device/{deviceId}_updates_device_fields (0.00s) PASS tests/csapi.TestDeviceManagement/PUT_/device/{deviceId}_gives_a_404_for_unknown_devices (0.00s) PASS tests/csapi.TestDeviceManagement/DELETE_/device/{deviceId} (0.15s) PASS tests/csapi.TestDeviceManagement/DELETE_/device/{deviceId}_requires_UI_auth_user_to_match_device_owner (0.15s) PASS tests/csapi.TestDeviceManagement (1.82s) PASS tests/csapi.TestLogin/parallel/GET_/login_yields_a_set_of_flows (0.00s) PASS tests/csapi.TestLogin/parallel/POST_/login_as_non-existing_user_is_rejected (0.00s) PASS tests/csapi.TestLogin/parallel/POST_/login_can_log_in_as_a_user_with_just_the_local_part_of_the_id (0.06s) PASS tests/csapi.TestLogin/parallel/POST_/login_can_login_as_user (0.07s) PASS tests/csapi.TestLogin/parallel/Login_with_uppercase_username_works_and_GET_/whoami_afterwards_also (0.07s) FAIL tests/csapi.TestLogin/parallel/POST_/login_returns_the_same_device_id_as_that_in_the_request (0.00s) PASS tests/csapi.TestLogin/parallel/POST_/login_wrong_password_is_rejected (0.07s) FAIL tests/csapi.TestLogin/parallel (0.00s) FAIL tests/csapi.TestLogin (2.55s) PASS tests/csapi.TestLogout/Can_logout_current_device (0.05s) PASS tests/csapi.TestLogout/Can_logout_all_devices (0.05s) PASS tests/csapi.TestLogout/Request_to_logout_with_invalid_an_access_token_is_rejected (0.05s) PASS tests/csapi.TestLogout/Request_to_logout_without_an_access_token_is_rejected (0.05s) PASS tests/csapi.TestLogout (1.76s) PASS tests/msc3757.TestWithoutOwnedState/parallel/user_can_set_state_with_their_own_user_ID_as_state_key (0.01s) PASS tests/msc3757.TestWithoutOwnedState/parallel/room_creator_cannot_set_state_with_a_non-member_user_ID_as_state_key (0.01s) PASS tests/msc3757.TestWithoutOwnedState/parallel/room_creator_cannot_set_state_with_their_own_suffixed_user_ID_as_state_key (0.02s) PASS tests/msc3757.TestWithoutOwnedState/parallel/room_creator_cannot_set_state_with_another_suffixed_user_ID_as_state_key (0.02s) PASS tests/msc3757.TestWithoutOwnedState/parallel/room_creator_cannot_set_state_with_another_user_ID_as_state_key (0.02s) PASS tests/msc3757.TestWithoutOwnedState/parallel/room_creator_cannot_set_state_with_malformed_user_ID_as_state_key (0.02s) PASS tests/msc3757.TestWithoutOwnedState/parallel (0.00s) PASS tests/msc3757.TestWithoutOwnedState (14.53s) PASS tests/csapi.TestPresence/GET_/presence/:user_id/status_fetches_initial_status (0.00s) PASS tests/csapi.TestPresence/PUT_/presence/:user_id/status_updates_my_presence (0.00s) PASS tests/csapi.TestPresence/Presence_can_be_set_from_sync (0.03s) PASS tests/csapi.TestPresence/Presence_changes_are_reported_to_local_room_members (0.02s) PASS tests/csapi.TestPresence/Presence_changes_to_UNAVAILABLE_are_reported_to_local_room_members (0.01s) PASS tests/csapi.TestPresence (1.79s) PASS tests/csapi.TestProfileAvatarURL/PUT_/profile/:user_id/avatar_url_sets_my_avatar (0.01s) PASS tests/csapi.TestProfileAvatarURL/GET_/profile/:user_id/avatar_url_publicly_accessible (0.00s) PASS tests/csapi.TestProfileAvatarURL (1.71s) FAIL tests/msc3757.TestMSC3757OwnedState (3.02s) FAIL Package tests/msc3757 (21.211s) PASS tests/csapi.TestProfileDisplayName/PUT_/profile/:user_id/displayname_sets_my_name (0.01s) PASS tests/csapi.TestProfileDisplayName/GET_/profile/:user_id/displayname_publicly_accessible (0.00s) PASS tests/csapi.TestProfileDisplayName (1.44s) PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/q (0.07s) PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/3 (0.06s) PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/. (0.06s) PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/_ (0.06s) PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/= (0.06s) PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_/- (0.06s) PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_// (0.06s) PASS tests/csapi.TestRegistration/parallel/POST_/register_allows_registration_of_usernames_with_ (0.44s) SKIP tests/csapi.TestRegistration/parallel/POST_/_synapse/admin/v1/register_admin_with_shared_secret (0.00s) SKIP tests/csapi.TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret (0.00s) SKIP tests/csapi.TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_disallows_symbols (0.00s) SKIP tests/csapi.TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_downcases_capitals (0.00s) PASS tests/csapi.TestRegistration/parallel/Registration_accepts_non-ascii_passwords (0.05s) PASS tests/csapi.TestRegistration/parallel/POST_{}_returns_a_set_of_flows (0.00s) PASS tests/csapi.TestRegistration/parallel/POST_/register_can_create_a_user (0.09s) PASS tests/csapi.TestRegistration/parallel/POST_/register_downcases_capitals_in_usernames (0.10s) PASS tests/csapi.TestRegistration/parallel/GET_/register/available_returns_available_for_unregistered_user_name (0.00s) PASS tests/csapi.TestRegistration/parallel/GET_/register/available_returns_M_INVALID_USERNAME_for_invalid_user_name (0.00s) PASS tests/csapi.TestRegistration/parallel/POST_/register_rejects_if_user_already_exists (0.14s) PASS tests/csapi.TestRegistration/parallel/POST_/register_returns_the_same_device_id_as_that_in_the_request (0.16s) PASS tests/csapi.TestRegistration/parallel/POST_/register_rejects_usernames_with_special_characters (0.09s) PASS tests/csapi.TestRegistration/parallel/GET_/register/available_returns_M_USER_IN_USE_for_registered_user_name (0.09s) PASS tests/csapi.TestRegistration/parallel (0.49s) PASS tests/csapi.TestRegistration (2.02s) PASS tests/csapi.TestRequestEncodingFails/POST_rejects_invalid_utf-8_in_JSON (0.00s) PASS tests/csapi.TestRequestEncodingFails (1.49s) PASS tests/csapi.TestRoomAlias/Parallel/PUT_/directory/room/:room_alias_creates_alias (0.03s) PASS tests/csapi.TestRoomAlias/Parallel/Room_aliases_can_contain_Unicode (0.07s) PASS tests/csapi.TestRoomAlias/Parallel/Only_room_members_can_list_aliases_of_a_room (0.10s) PASS tests/csapi.TestRoomAlias/Parallel/GET_/rooms/:room_id/aliases_lists_aliases (0.13s) PASS tests/csapi.TestRoomAlias/Parallel (0.00s) PASS tests/csapi.TestRoomAlias (1.93s) PASS tests/csapi.TestRoomDeleteAlias/Parallel/Deleting_a_non-existent_alias_should_return_a_404 (0.01s) PASS tests/csapi.TestRoomDeleteAlias/Parallel/Alias_creators_can_delete_alias_with_no_ops (0.06s) PASS tests/csapi.TestRoomDeleteAlias/Parallel/Regular_users_can_add_and_delete_aliases_in_the_default_room_configuration (0.11s) PASS tests/csapi.TestRoomDeleteAlias/Parallel/Users_can't_delete_other's_aliases (0.14s) PASS tests/csapi.TestRoomDeleteAlias/Parallel/Alias_creators_can_delete_canonical_alias_with_no_ops (0.20s) PASS tests/csapi.TestRoomDeleteAlias/Parallel (0.00s) PASS tests/csapi.TestRoomDeleteAlias (1.73s) FAIL tests/msc2836.TestFederatedEventRelationships (18.73s) PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_missing_aliases (0.03s) PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_invalid_aliases (0.03s) PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_alias_pointing_to_different_local_room (0.06s) PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_setting_rejects_deleted_aliases (0.04s) PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_missing_aliases#01 (0.03s) PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_alt_alias_pointing_to_different_local_room (0.08s) PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_rejects_invalid_aliases#01 (0.04s) PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_accepts_present_aliases (0.12s) PASS tests/csapi.TestRoomCanonicalAlias/Parallel/m.room.canonical_alias_accepts_present_alt_aliases (0.12s) PASS tests/csapi.TestRoomCanonicalAlias/Parallel (0.30s) PASS tests/csapi.TestRoomCanonicalAlias (1.81s) FAIL Package tests/msc2836 (51.994s) PASS tests/csapi.TestRoomCreate/Parallel/Rooms_can_be_created_with_an_initial_invite_list_(SYN-205) (0.04s) PASS tests/csapi.TestRoomCreate/Parallel/Can_/sync_newly_created_room (0.05s) PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_ignores_attempts_to_set_the_room_version_via_creation_content (0.08s) PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_public_room (0.03s) PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_room_with_a_name (0.06s) FAIL tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_creates_a_room_with_the_given_version (0.06s) PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_room_with_a_topic_via_initial_state (0.04s) PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_private_room_with_invites (0.13s) FAIL tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_room_with_a_topic_and_writes_rich_topic_representation (0.13s) FAIL tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_room_with_a_topic_via_initial_state_overwritten_by_topic (0.13s) PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_room_with_a_topic (0.13s) PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_rejects_attempts_to_create_rooms_with_unknown_versions (0.10s) PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_makes_a_private_room (0.09s) PASS tests/csapi.TestRoomCreate/Parallel/POST_/createRoom_rejects_attempts_to_create_rooms_with_numeric_versions (0.06s) FAIL tests/csapi.TestRoomCreate/Parallel (0.16s) FAIL tests/csapi.TestRoomCreate (2.88s) PASS tests/csapi.TestRoomForget/Parallel/Can't_forget_room_you're_still_in (0.03s) PASS tests/csapi.TestRoomForget/Parallel/Can_forget_room_we_weren't_an_actual_member (0.12s) PASS tests/csapi.TestRoomForget/Parallel/Can_forget_room_you've_been_kicked_from (0.15s) FAIL tests/csapi.TestRoomForget/Parallel/Forgotten_room_messages_cannot_be_paginated (0.16s) PASS tests/csapi.TestRoomForget/Parallel/Forgetting_room_does_not_show_up_in_v2_initial_/sync (0.31s) FAIL tests/csapi.TestRoomForget/Parallel/Leave_for_forgotten_room_shows_up_in_v2_incremental_/sync (0.26s) PASS tests/csapi.TestRoomForget/Parallel/Can_re-join_room_if_re-invited (0.39s) FAIL tests/csapi.TestRoomForget/Parallel (0.00s) FAIL tests/csapi.TestRoomForget (2.83s) PASS tests/csapi.TestFetchEvent (1.80s) PASS tests/csapi.TestFetchHistoricalJoinedEventDenied (1.66s) FAIL tests/msc3874.TestFilterMessagesByRelType (15.62s) FAIL Package tests/msc3874 (19.49s) PASS tests/csapi.TestFetchHistoricalSharedEvent (1.71s) PASS tests/csapi.TestFetchHistoricalInvitedEventFromBetweenInvite (2.24s) EMPTY Package tests/msc3902 (2.811s) PASS tests/csapi.TestFetchHistoricalInvitedEventFromBeforeInvite (3.11s) PASS tests.TestACLs (44.26s) FAIL tests/msc3890.TestDeletingDeviceRemovesDeviceLocalNotificationSettings/Deleting_a_user's_device_should_delete_any_local_notification_settings_entries_from_their_account_data (0.03s) FAIL tests/msc3890.TestDeletingDeviceRemovesDeviceLocalNotificationSettings (15.95s) FAIL Package tests/msc3890 (17.792s) PASS tests/csapi.TestFetchEventNonWorldReadable (2.06s) PASS tests/csapi.TestFetchEventWorldReadable (2.43s) PASS tests/csapi.TestRoomMembers/Parallel/POST_/rooms/:room_id/join_can_join_a_room (0.05s) FAIL tests/csapi.TestRoomMembers/Parallel/POST_/join/:room_id_can_join_a_room_with_custom_content (0.11s) PASS tests/csapi.TestRoomMembers/Parallel/POST_/rooms/:room_id/invite_can_send_an_invite (0.19s) PASS tests/csapi.TestRoomMembers/Parallel/POST_/rooms/:room_id/leave_can_leave_a_room (0.23s) FAIL tests/csapi.TestRoomMembers/Parallel/POST_/join/:room_alias_can_join_a_room_with_custom_content (0.18s) PASS tests/csapi.TestRoomMembers/Parallel/POST_/rooms/:room_id/ban_can_ban_a_user (0.25s) PASS tests/csapi.TestRoomMembers/Parallel/POST_/join/:room_alias_can_join_a_room (0.14s) PASS tests/csapi.TestRoomMembers/Parallel/POST_/join/:room_id_can_join_a_room (0.13s) PASS tests/csapi.TestRoomMembers/Parallel/Test_that_we_can_be_reinvited_to_a_room_we_created (0.37s) FAIL tests/csapi.TestRoomMembers/Parallel (0.00s) FAIL tests/csapi.TestRoomMembers (3.41s) PASS tests/csapi.TestRoomReceipts/Receipts_DO_NOT_include_a_`room_id`_field (0.02s) PASS tests/csapi.TestRoomReceipts (1.52s) PASS tests/csapi.TestRoomReadMarkers (1.46s) PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state/m.room.member/:user_id_fetches_my_membership (0.03s) PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state_fetches_entire_room_state (0.06s) PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/joined_members_is_forbidden_after_leaving_room (0.10s) PASS tests/csapi.TestRoomState/Parallel/PUT_/createRoom_with_creation_content (0.11s) PASS tests/csapi.TestRoomState/Parallel/GET_/publicRooms_lists_newly-created_room (0.12s) PASS tests/csapi.TestRoomState/Parallel/GET_/joined_rooms_lists_newly-created_room (0.11s) PASS tests/csapi.TestRoomState/Parallel/GET_/directory/room/:room_alias_yields_room_ID (0.11s) PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state/m.room.power_levels_fetches_powerlevels (0.12s) FAIL tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/joined_members_fetches_my_membership (0.11s) PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state/m.room.topic_gets_topic (0.12s) PASS tests/csapi.TestRoomState/Parallel/PUT_/rooms/:room_id/state/m.room.topic_sets_topic (0.12s) PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state/m.room.member/:user_id?format=event_fetches_my_membership_event (0.11s) PASS tests/csapi.TestRoomState/Parallel/POST_/rooms/:room_id/state/m.room.name_sets_name (0.11s) PASS tests/csapi.TestRoomState/Parallel/GET_/rooms/:room_id/state/m.room.name_gets_name (0.11s) FAIL tests/csapi.TestRoomState/Parallel (0.00s) FAIL tests/csapi.TestRoomState (2.86s) PASS tests/csapi.TestSearch/parallel/Can_search_for_an_event_by_body (0.05s) PASS tests/csapi.TestSearch/parallel/Search_works_across_an_upgraded_room_and_its_predecessor (0.19s) PASS tests/csapi.TestSearch/parallel/Search_results_with_recent_ordering_do_not_include_redacted_events (0.23s) PASS tests/csapi.TestSearch/parallel/Search_results_with_rank_ordering_do_not_include_redacted_events (0.30s) FAIL tests/csapi.TestSearch/parallel/Can_get_context_around_search_results (0.39s) FAIL tests/csapi.TestSearch/parallel/Can_back-paginate_search_results (1.23s) FAIL tests/csapi.TestSearch/parallel (0.00s) FAIL tests/csapi.TestSearch (3.57s) PASS tests/csapi.TestServerCapabilities (1.59s) FAIL tests/msc3930.TestPollsLocalPushRules/Polls_push_rules_are_correctly_presented_to_the_client (0.00s) FAIL tests/msc3930.TestPollsLocalPushRules (15.87s) FAIL Package tests/msc3930 (21.093s) PASS tests/msc3967.TestMSC3967 (15.61s) PASS Package tests/msc3967 (17.611s) PASS tests/csapi.TestVersionStructure/Version_responds_200_OK_with_valid_structure (0.00s) PASS tests/csapi.TestVersionStructure (2.25s) FAIL tests/msc4140.TestDelayedEvents/delayed_events_are_empty_on_startup (0.51s) FAIL tests/msc4140.TestDelayedEvents/delayed_event_lookups_are_authenticated (0.00s) FAIL tests/msc4140.TestDelayedEvents/delayed_message_events_are_sent_on_timeout (0.02s) FAIL tests/msc4140.TestDelayedEvents/delayed_state_events_are_sent_on_timeout (0.52s) PASS tests/msc4140.TestDelayedEvents/cannot_update_a_delayed_event_without_an_action (0.00s) PASS tests/msc4140.TestDelayedEvents/cannot_update_a_delayed_event_with_an_invalid_action (0.00s) PASS tests/msc4140.TestDelayedEvents/parallel/cannot_cancel_a_delayed_event_without_a_matching_delay_ID (0.00s) PASS tests/msc4140.TestDelayedEvents/parallel/cannot_send_a_delayed_event_without_a_matching_delay_ID (0.00s) PASS tests/msc4140.TestDelayedEvents/parallel/cannot_restart_a_delayed_event_without_a_matching_delay_ID (0.00s) PASS tests/msc4140.TestDelayedEvents/parallel (0.00s) FAIL tests/msc4140.TestDelayedEvents/delayed_state_events_can_be_cancelled (0.01s) FAIL tests/msc4140.TestDelayedEvents/delayed_state_events_can_be_sent_on_request (0.01s) FAIL tests/msc4140.TestDelayedEvents/delayed_state_events_can_be_restarted (0.01s) FAIL tests/msc4140.TestDelayedEvents/delayed_state_is_not_cancelled_by_new_state_from_the_same_user (0.52s) FAIL tests/msc4140.TestDelayedEvents/delayed_state_is_cancelled_by_new_state_from_another_user (0.52s) SKIP tests/msc4140.TestDelayedEvents/delayed_state_events_are_kept_on_server_restart (0.00s) FAIL tests/msc4140.TestDelayedEvents (17.38s) FAIL Package tests/msc4140 (20.449s) FAIL tests.TestDeviceListsUpdateOverFederation/good_connectivity (5.84s) FAIL tests.TestDeviceListsUpdateOverFederation/interrupted_connectivity (5.35s) FAIL tests.TestDeviceListsUpdateOverFederation/stopped_server (5.34s) FAIL tests.TestDeviceListsUpdateOverFederation (46.80s) PASS tests/msc4155.TestInviteFiltering/Can_invite_users_normally_without_any_rules (0.78s) PASS tests/msc4155.TestInviteFiltering/Can_block_a_single_user (0.11s) PASS tests/msc4155.TestInviteFiltering/Can_ignore_a_single_user (0.14s) PASS tests/msc4155.TestInviteFiltering/Can_block_a_whole_server (0.16s) PASS tests/msc4155.TestInviteFiltering/Can_ignore_a_whole_server (0.22s) PASS tests/msc4155.TestInviteFiltering/Can_glob_serveral_servers (0.23s) PASS tests/msc4155.TestInviteFiltering/Can_glob_serveral_users (0.21s) PASS tests/msc4155.TestInviteFiltering/Can_allow_a_user_from_a_blocked_server (0.40s) PASS tests/msc4155.TestInviteFiltering/Can_block_a_user_from_an_allowed_server (0.55s) PASS tests/msc4155.TestInviteFiltering/Will_ignore_null_fields (0.47s) PASS tests/msc4155.TestInviteFiltering/Will_allow_users_when_a_user_appears_in_multiple_fields (0.75s) PASS tests/msc4155.TestInviteFiltering (30.69s) PASS Package tests/msc4155 (35.226s) FAIL tests.TestDeviceListsUpdateOverFederationOnRoomJoin (15.91s) FAIL tests.TestUserAppearsInChangedDeviceListOnJoinOverFederation (9.44s) PASS tests.TestEventAuth/returns_auth_events_for_the_requested_event (0.01s) PASS tests.TestEventAuth/returns_the_auth_chain_for_the_requested_event (0.01s) PASS tests.TestEventAuth (3.71s) PASS tests.TestInboundFederationKeys (1.46s) PASS tests.TestContentMediaV1 (1.97s) FAIL tests/msc4306.TestMSC4308ThreadSubscriptionsSlidingSync/Receives_thread_subscriptions_over_initial_sliding_sync (0.11s) FAIL tests/msc4306.TestMSC4308ThreadSubscriptionsSlidingSync/Receives_thread_subscriptions_over_incremental_sliding_sync (30.08s) FAIL tests/msc4306.TestMSC4308ThreadSubscriptionsSlidingSync (44.90s) FAIL tests/msc4306.TestThreadSubscriptions/Can_subscribe_to_and_unsubscribe_from_a_thread (0.04s) FAIL tests/msc4306.TestThreadSubscriptions/Cannot_use_thread_root_as_automatic_subscription_cause_event (0.05s) FAIL tests/msc4306.TestThreadSubscriptions/Can_create_automatic_subscription_to_a_thread (0.08s) FAIL tests/msc4306.TestThreadSubscriptions/Manual_subscriptions_overwrite_automatic_subscriptions (0.09s) FAIL tests/msc4306.TestThreadSubscriptions/Error_when_using_invalid_automatic_event_ID (0.12s) FAIL tests/msc4306.TestThreadSubscriptions/Unsubscribe_succeeds_even_with_no_subscription (0.06s) PASS tests/msc4306.TestThreadSubscriptions/Nonexistent_threads_return_404 (0.03s) FAIL tests/msc4306.TestThreadSubscriptions/Server-side_automatic_subscription_ordering_conflict (0.12s) FAIL tests/msc4306.TestThreadSubscriptions (3.10s) FAIL Package tests/msc4306 (49.804s) FAIL tests.TestRemotePresence/Presence_changes_are_also_reported_to_remote_room_members (5.06s) FAIL tests.TestRemotePresence/Presence_changes_to_UNAVAILABLE_are_reported_to_remote_room_members (5.06s) FAIL tests.TestRemotePresence (14.60s) PASS tests.TestOutboundFederationProfile/Outbound_federation_can_query_profile_data (0.01s) PASS tests.TestOutboundFederationProfile (2.41s) PASS tests.TestInboundFederationProfile/Non-numeric_ports_in_server_names_are_rejected (0.06s) PASS tests.TestInboundFederationProfile/Inbound_federation_can_query_profile_data (0.01s) PASS tests.TestInboundFederationProfile (2.54s) PASS tests.TestFederationRedactSendsWithoutEvent (3.09s) FAIL tests/csapi.TestDeviceListUpdates/when_local_user_joins_a_room (5.42s) FAIL tests/csapi.TestDeviceListUpdates/when_remote_user_joins_a_room (6.05s) FAIL tests/csapi.TestDeviceListUpdates/when_joining_a_room_with_a_local_user (5.26s) FAIL tests/csapi.TestDeviceListUpdates/when_joining_a_room_with_a_remote_user (5.59s) FAIL tests/csapi.TestDeviceListUpdates/when_local_user_leaves_a_room (5.29s) FAIL tests/csapi.TestDeviceListUpdates/when_remote_user_leaves_a_room (5.57s) FAIL tests/csapi.TestDeviceListUpdates/when_leaving_a_room_with_a_local_user (5.36s) FAIL tests/csapi.TestDeviceListUpdates/when_leaving_a_room_with_a_remote_user (5.49s) FAIL tests/csapi.TestDeviceListUpdates/when_local_user_rejoins_a_room (5.28s) FAIL tests/csapi.TestDeviceListUpdates/when_remote_user_rejoins_a_room (5.54s) FAIL tests/csapi.TestDeviceListUpdates (84.05s) PASS tests.TestRemoteAliasRequestsUnderstandUnicode (2.12s) PASS tests/csapi.TestE2EKeyBackupReplaceRoomKeyRules/parallel/{isVerified:false_firstMessageIndex:10_forwardedCount:5} (0.01s) PASS tests/csapi.TestE2EKeyBackupReplaceRoomKeyRules/parallel/{isVerified:true_firstMessageIndex:10_forwardedCount:5} (0.02s) PASS tests/csapi.TestE2EKeyBackupReplaceRoomKeyRules/parallel (0.00s) PASS tests/csapi.TestE2EKeyBackupReplaceRoomKeyRules (1.61s) PASS tests/csapi.TestInviteFromIgnoredUsersDoesNotAppearInSync (1.67s) FAIL tests/csapi.TestJson/Parallel/Invalid_numerical_values (0.00s) FAIL tests/csapi.TestJson/Parallel/Invalid_JSON_special_values (0.00s) FAIL tests/csapi.TestJson/Parallel (0.00s) FAIL tests/csapi.TestJson (2.58s) PASS tests/csapi.TestFilter (1.36s) FAIL tests.TestInboundFederationRejectsEventsWithRejectedAuthEvents (8.77s) PASS tests/csapi.TestEvent/Parallel/Large_Event (0.01s) PASS tests/csapi.TestEvent/Parallel/Large_State_Event (0.02s) PASS tests/csapi.TestEvent/Parallel (0.00s) PASS tests/csapi.TestEvent (1.58s) FAIL tests.TestGetMissingEventsGapFilling (3.38s) FAIL tests/csapi.TestKeyChangesLocal/New_login_should_create_a_device_lists.changed_entry (5.18s) FAIL tests/csapi.TestKeyChangesLocal (7.68s) FAIL tests/csapi.TestAsyncUpload/Create_media (0.00s) FAIL tests/csapi.TestAsyncUpload/Not_yet_uploaded (0.00s) FAIL tests/csapi.TestAsyncUpload/Upload_media (0.00s) FAIL tests/csapi.TestAsyncUpload/Cannot_upload_to_a_media_ID_that_has_already_been_uploaded_to (0.00s) FAIL tests/csapi.TestAsyncUpload/Download_media (0.00s) FAIL tests/csapi.TestAsyncUpload/Download_media_over__matrix/client/v1/media/download (0.00s) FAIL tests/csapi.TestAsyncUpload (2.52s) PASS tests/csapi.TestRoomImageRoundtrip (1.46s) FAIL tests.TestOutboundFederationIgnoresMissingEventWithBadJSONForRoomVersion6 (9.46s) PASS tests/csapi.TestMediaConfig (1.38s) FAIL tests/csapi.TestMembershipOnEvents (2.71s) PASS tests/csapi.TestDemotingUsersViaUsersDefault (2.13s) FAIL tests.TestInboundCanReturnMissingEvents/Inbound_federation_can_return_missing_events_for_world_readable_visibility (0.22s) FAIL tests.TestInboundCanReturnMissingEvents/Inbound_federation_can_return_missing_events_for_shared_visibility (0.17s) FAIL tests.TestInboundCanReturnMissingEvents/Inbound_federation_can_return_missing_events_for_invited_visibility (0.20s) FAIL tests.TestInboundCanReturnMissingEvents/Inbound_federation_can_return_missing_events_for_joined_visibility (0.21s) FAIL tests.TestInboundCanReturnMissingEvents (5.95s) PASS tests/csapi.TestPowerLevels/GET_/rooms/:room_id/state/m.room.power_levels_can_fetch_levels (0.00s) PASS tests/csapi.TestPowerLevels/PUT_/rooms/:room_id/state/m.room.power_levels_can_set_levels (0.03s) PASS tests/csapi.TestPowerLevels/PUT_power_levels_should_not_explode_if_the_old_power_levels_were_empty (0.05s) PASS tests/csapi.TestPowerLevels (1.64s) PASS tests/csapi.TestPublicRooms/Can_search_public_room_list (0.11s) PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroomalias_no_name (0.04s) PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroomalias_with_name (0.04s) PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroomalias_with_topic (0.04s) PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroomalias_with_name_topic (0.04s) PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroom_with_unicode_chars_name (0.04s) PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroom_with_unicode_chars_topic (0.04s) PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct/Creating_room_with_alias_publicroom_with_unicode_chars_name_topic (0.05s) PASS tests/csapi.TestPublicRooms/Name/topic_keys_are_correct (0.34s) PASS tests/csapi.TestPublicRooms (1.84s) PASS tests/csapi.TestPushRuleCacheHealth (1.48s) PASS tests/csapi.TestPushSync/Push_rules_come_down_in_an_initial_/sync (0.01s) PASS tests/csapi.TestPushSync/Adding_a_push_rule_wakes_up_an_incremental_/sync (0.01s) PASS tests/csapi.TestPushSync/Disabling_a_push_rule_wakes_up_an_incremental_/sync (0.01s) PASS tests/csapi.TestPushSync/Enabling_a_push_rule_wakes_up_an_incremental_/sync (0.01s) PASS tests/csapi.TestPushSync/Setting_actions_for_a_push_rule_wakes_up_an_incremental_/sync (0.01s) PASS tests/csapi.TestPushSync (1.32s) PASS tests/csapi.TestNotPresentUserCannotBanOthers (1.58s) FAIL tests/csapi.TestCannotKickNonPresentUser (2.42s) FAIL tests.TestOutboundFederationEventSizeGetMissingEvents (9.58s) PASS tests/csapi.TestCannotKickLeftUser (1.66s) FAIL tests/csapi.TestLeftRoomFixture/Can_get_rooms/{roomId}/state_for_a_departed_room (0.00s) FAIL tests/csapi.TestLeftRoomFixture/Can_get_rooms/{roomId}/members_for_a_departed_room (0.00s) PASS tests/csapi.TestLeftRoomFixture/Can_get_rooms/{roomId}/messages_for_a_departed_room (0.01s) FAIL tests/csapi.TestLeftRoomFixture/Can_get_'m.room.name'_state_for_a_departed_room (0.00s) PASS tests/csapi.TestLeftRoomFixture/Getting_messages_going_forward_is_limited_for_a_departed_room (0.00s) FAIL tests/csapi.TestLeftRoomFixture (3.07s) PASS tests/csapi.TestGetRoomMembers (1.74s) FAIL tests.TestCorruptedAuthChain (8.24s) FAIL tests/csapi.TestGetRoomMembersAtPoint (2.74s) PASS tests/csapi.TestGetFilteredRoomMembers/not_membership (0.00s) PASS tests/csapi.TestGetFilteredRoomMembers/membership/leave (0.00s) PASS tests/csapi.TestGetFilteredRoomMembers/membership/join (0.00s) PASS tests/csapi.TestGetFilteredRoomMembers (2.00s) PASS tests.TestFederationRejectInvite (3.49s) FAIL tests/csapi.TestSendAndFetchMessage (2.72s) PASS tests.TestJoinViaRoomIDAndServerName (2.82s) PASS tests/csapi.TestFetchMessagesFromNonExistentRoom (1.79s) PASS tests/csapi.TestSendMessageWithTxn (1.53s) PASS tests.TestJoinFederatedRoomFailOver (3.42s) PASS tests/csapi.TestRoomMessagesLazyLoading (1.81s) PASS tests.TestJoinFederatedRoomWithUnverifiableEvents//send_join_response_missing_signatures_shouldn't_block_room_join (0.12s) PASS tests.TestJoinFederatedRoomWithUnverifiableEvents//send_join_response_with_bad_signatures_shouldn't_block_room_join (0.09s) PASS tests.TestJoinFederatedRoomWithUnverifiableEvents//send_join_response_with_unobtainable_keys_shouldn't_block_room_join (0.06s) PASS tests.TestJoinFederatedRoomWithUnverifiableEvents//send_join_response_with_state_with_unverifiable_auth_events_shouldn't_block_room_join (0.06s) PASS tests.TestJoinFederatedRoomWithUnverifiableEvents (2.35s) PASS tests/csapi.TestRoomMessagesLazyLoadingLocalUser (1.55s) PASS tests.TestBannedUserCannotSendJoin (6.97s) PASS tests.TestCannotSendNonJoinViaSendJoinV1/regular_event (0.02s) PASS tests.TestCannotSendNonJoinViaSendJoinV1/non-state_membership_event (0.01s) PASS tests.TestCannotSendNonJoinViaSendJoinV1/leave_event (0.01s) PASS tests.TestCannotSendNonJoinViaSendJoinV1/knock_event (0.01s) PASS tests.TestCannotSendNonJoinViaSendJoinV1/invite_event (0.01s) PASS tests.TestCannotSendNonJoinViaSendJoinV1/event_with_mismatched_state_key (0.01s) PASS tests.TestCannotSendNonJoinViaSendJoinV1 (7.50s) PASS tests.TestCannotSendNonJoinViaSendJoinV2/regular_event (0.02s) PASS tests.TestCannotSendNonJoinViaSendJoinV2/non-state_membership_event (0.01s) PASS tests.TestCannotSendNonJoinViaSendJoinV2/leave_event (0.01s) PASS tests.TestCannotSendNonJoinViaSendJoinV2/knock_event (0.01s) PASS tests.TestCannotSendNonJoinViaSendJoinV2/invite_event (0.02s) PASS tests.TestCannotSendNonJoinViaSendJoinV2/event_with_mismatched_state_key (0.01s) PASS tests.TestCannotSendNonJoinViaSendJoinV2 (2.34s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/regular_event (0.02s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/non-state_membership_event (0.01s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/join_event (0.01s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/knock_event (0.01s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/invite_event (0.01s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV1/event_with_mismatched_state_key (0.01s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV1 (3.38s) PASS tests/csapi.TestMessagesOverFederation/Visible_shared_history_after_joining_new_room_(backfill)/`messagesRequestLimit`_is_lower_than_the_number_of_messages_backfilled_(assumed) (1.12s) PASS tests/csapi.TestMessagesOverFederation/Visible_shared_history_after_joining_new_room_(backfill)/`messagesRequestLimit`_is_greater_than_the_number_of_messages_backfilled_(in_Synapse,_100) (14.79s) PASS tests/csapi.TestMessagesOverFederation/Visible_shared_history_after_joining_new_room_(backfill) (15.91s) FAIL tests/csapi.TestMessagesOverFederation/Visible_shared_history_after_re-joining_room_(backfill)/`messagesRequestLimit`_is_lower_than_the_number_of_messages_backfilled_(assumed) (1.34s) FAIL tests/csapi.TestMessagesOverFederation/Visible_shared_history_after_re-joining_room_(backfill) (1.34s) FAIL tests/csapi.TestMessagesOverFederation (21.41s) PASS tests/csapi.TestAvatarUrlUpdate (1.61s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/regular_event (0.01s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/non-state_membership_event (0.02s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/join_event (0.01s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/knock_event (0.01s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/invite_event (0.01s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV2/event_with_mismatched_state_key (0.01s) PASS tests.TestCannotSendNonLeaveViaSendLeaveV2 (4.40s) PASS tests/csapi.TestDisplayNameUpdate (2.01s) PASS tests/csapi.TestRelations (1.81s) FAIL tests/csapi.TestRelationsPagination (2.87s) FAIL tests.TestSendJoinPartialStateResponse (6.64s) PASS tests/csapi.TestRelationsPaginationSync (1.66s) FAIL tests/csapi.TestThreadsEndpoint (3.10s) PASS tests/csapi.TestTyping/Typing_notification_sent_to_local_room_members (0.00s) PASS tests/csapi.TestTyping/Typing_can_be_explicitly_stopped (0.00s) PASS tests/csapi.TestTyping/Typing_events_DO_NOT_include_a_`room_id`_field (0.00s) PASS tests/csapi.TestTyping (1.43s) PASS tests/csapi.TestLeakyTyping (2.45s) FAIL tests/csapi.TestPushRuleRoomUpgrade/parallel/joining_a_remote_manually_upgraded_room_carries_over_existing_push_rules (5.99s) FAIL tests/csapi.TestPushRuleRoomUpgrade/parallel/joining_a_remote_upgraded_room_carries_over_existing_push_rules (6.01s) FAIL tests/csapi.TestPushRuleRoomUpgrade/parallel/upgrading_a_room_carries_over_existing_push_rules_for_local_users (6.04s) FAIL tests/csapi.TestPushRuleRoomUpgrade/parallel/manually_upgrading_a_room_carries_over_existing_push_rules_for_local_users (6.06s) FAIL tests/csapi.TestPushRuleRoomUpgrade/parallel (0.00s) FAIL tests/csapi.TestPushRuleRoomUpgrade (9.98s) PASS tests/csapi.TestRoomsInvite/Parallel/Users_cannot_invite_themselves_to_a_room (0.06s) PASS tests/csapi.TestRoomsInvite/Parallel/Can_invite_users_to_invite-only_rooms (0.08s) PASS tests/csapi.TestRoomsInvite/Parallel/Invited_user_can_reject_invite (0.19s) PASS tests/csapi.TestRoomsInvite/Parallel/Invited_user_can_see_room_metadata (0.16s) PASS tests/csapi.TestRoomsInvite/Parallel/Uninvited_users_cannot_join_the_room (0.05s) PASS tests/csapi.TestRoomsInvite/Parallel/Test_that_we_can_be_reinvited_to_a_room_we_created (0.28s) PASS tests/csapi.TestRoomsInvite/Parallel/Users_cannot_invite_a_user_that_is_already_in_the_room (0.22s) PASS tests/csapi.TestRoomsInvite/Parallel/Invited_user_can_reject_invite_for_empty_room (1.17s) PASS tests/csapi.TestRoomsInvite/Parallel (0.00s) PASS tests/csapi.TestRoomsInvite (2.97s) PASS tests/csapi.TestMembersLocal/Parallel/Existing_members_see_new_members'_join_events (0.02s) PASS tests/csapi.TestMembersLocal/Parallel/New_room_members_see_their_own_join_event (0.02s) PASS tests/csapi.TestMembersLocal/Parallel/Existing_members_see_new_members'_presence_(in_initial_sync) (0.04s) FAIL tests/csapi.TestMembersLocal/Parallel/Existing_members_see_new_members'_presence_(in_incremental_sync) (5.06s) FAIL tests/csapi.TestMembersLocal/Parallel (0.00s) FAIL tests/csapi.TestMembersLocal (7.60s) FAIL tests.TestJoinFederatedRoomFromApplicationServiceBridgeUser/join_remote_federated_room_as_application_service_user (0.03s) FAIL tests.TestJoinFederatedRoomFromApplicationServiceBridgeUser (29.70s) FAIL tests/csapi.TestRoomCreationReportsEventsToMyself/parallel/Room_creation_reports_m.room.create_to_myself (0.02s) PASS tests/csapi.TestRoomCreationReportsEventsToMyself/parallel/Room_creation_reports_m.room.member_to_myself (0.02s) PASS tests/csapi.TestRoomCreationReportsEventsToMyself/parallel/Setting_room_topic_reports_m.room.topic_to_myself (0.05s) FAIL tests/csapi.TestRoomCreationReportsEventsToMyself/parallel/Setting_state_twice_is_idempotent (0.06s) PASS tests/csapi.TestRoomCreationReportsEventsToMyself/parallel/Joining_room_twice_is_idempotent (5.07s) FAIL tests/csapi.TestRoomCreationReportsEventsToMyself/parallel (0.00s) FAIL tests/csapi.TestRoomCreationReportsEventsToMyself (7.70s) PASS tests.TestOutboundFederationSend (5.79s) PASS tests/csapi.TestSyncLeaveSection/Left_rooms_appear_in_the_leave_section_of_sync (0.01s) PASS tests/csapi.TestSyncLeaveSection/Left_rooms_appear_in_the_leave_section_of_full_state_sync (0.01s) PASS tests/csapi.TestSyncLeaveSection/Newly_left_rooms_appear_in_the_leave_section_of_incremental_sync (0.01s) PASS tests/csapi.TestSyncLeaveSection (1.64s) PASS tests/csapi.TestGappedSyncLeaveSection (2.01s) PASS tests.TestNetworkPartitionOrdering (6.23s) FAIL tests/csapi.TestArchivedRoomsHistory/timeline_has_events/initial_sync (0.01s) FAIL tests/csapi.TestArchivedRoomsHistory/timeline_has_events/incremental_sync (0.01s) FAIL tests/csapi.TestArchivedRoomsHistory/timeline_has_events (0.01s) FAIL tests/csapi.TestArchivedRoomsHistory/timeline_is_empty/initial_sync (0.01s) SKIP tests/csapi.TestArchivedRoomsHistory/timeline_is_empty/incremental_sync (0.00s) FAIL tests/csapi.TestArchivedRoomsHistory/timeline_is_empty (0.01s) FAIL tests/csapi.TestArchivedRoomsHistory (2.69s) PASS tests.TestRemoteTyping (2.85s) FAIL tests/csapi.TestOlderLeftRoomsNotInLeaveSection (3.56s) FAIL tests/csapi.TestLeaveEventVisibility (2.77s) PASS tests/csapi.TestLeaveEventInviteRejection (1.86s) PASS tests/csapi.TestSyncFilter/Can_create_filter (0.00s) PASS tests/csapi.TestSyncFilter/Can_download_filter (0.00s) PASS tests/csapi.TestSyncFilter (1.73s) PASS tests/csapi.TestCumulativeJoinLeaveJoinSync (1.85s) PASS tests.TestFederationRoomsInvite/Parallel/Invited_user_has_'is_direct'_flag_in_prev_content_after_joining (0.56s) PASS tests.TestFederationRoomsInvite/Parallel/Invited_user_can_reject_invite_over_federation (0.16s) PASS tests.TestFederationRoomsInvite/Parallel/Invited_user_can_reject_invite_over_federation_for_empty_room (0.35s) PASS tests.TestFederationRoomsInvite/Parallel/Remote_invited_user_can_join_the_room_when_homeserver_is_already_participating_in_the_room (0.67s) PASS tests.TestFederationRoomsInvite/Parallel/Non-invitee_user_cannot_rescind_invite_over_federation (0.91s) PASS tests.TestFederationRoomsInvite/Parallel/Remote_invited_user_can_reject_invite_when_homeserver_is_already_participating_in_the_room (0.88s) PASS tests.TestFederationRoomsInvite/Parallel/Remote_invited_user_can_see_room_metadata (0.33s) PASS tests.TestFederationRoomsInvite/Parallel/Invited_user_can_reject_invite_over_federation_several_times (0.99s) FAIL tests.TestFederationRoomsInvite/Parallel/Inviter_user_can_rescind_invite_over_federation (5.31s) FAIL tests.TestFederationRoomsInvite/Parallel (0.56s) FAIL tests.TestFederationRoomsInvite (10.49s) PASS tests/csapi.TestTentativeEventualJoiningAfterRejecting (1.84s) PASS tests.TestSyncOmitsStateChangeOnFilteredEvents (3.63s) FAIL tests/csapi.TestSync/parallel/Newly_joined_room_includes_presence_in_incremental_sync (5.11s) FAIL tests/csapi.TestSync/parallel/Get_presence_for_newly_joined_members_in_incremental_sync (5.16s) FAIL tests/csapi.TestSync/parallel/Device_list_tracking/User_is_correctly_listed_when_they_leave,_even_when_lazy_loading_is_enabled (5.17s) FAIL tests/csapi.TestSync/parallel/Device_list_tracking (5.17s) PASS tests/csapi.TestSync/parallel/Can_sync_a_joined_room (0.12s) PASS tests/csapi.TestSync/parallel/Newly_joined_room_is_included_in_an_incremental_sync (0.20s) PASS tests/csapi.TestSync/parallel/Full_state_sync_includes_joined_rooms (0.17s) FAIL tests/csapi.TestSync/parallel/Newly_joined_room_has_correct_timeline_in_incremental_sync (0.55s) FAIL tests/csapi.TestSync/parallel/sync_should_succeed_even_if_the_sync_token_points_to_a_redaction_of_an_unknown_event (11.73s) FAIL tests/csapi.TestSync/parallel (15.44s) FAIL tests/csapi.TestSync (30.02s) PASS tests/csapi.TestSyncTimelineGap/incremental (0.01s) PASS tests/csapi.TestSyncTimelineGap/full (0.03s) PASS tests/csapi.TestSyncTimelineGap (2.44s) PASS tests/csapi.TestPresenceSyncDifferentRooms (1.78s) PASS tests/csapi.TestRoomSummary (2.00s) FAIL tests/csapi.TestThreadedReceipts (7.71s) FAIL tests/csapi.TestThreadReceiptsInSyncMSC4102 (9.33s) PASS tests/csapi.TestToDeviceMessages (1.41s) PASS tests/csapi.TestTxnInEvent (1.28s) PASS tests/csapi.TestTxnScopeOnLocalEcho (1.60s) PASS tests/csapi.TestTxnIdempotencyScopedToDevice (1.47s) FAIL tests/csapi.TestTxnIdempotency (2.58s) FAIL tests/csapi.TestTxnIdWithRefreshToken (2.37s) PASS tests/csapi.TestUploadKey/Parallel/Can_upload_device_keys (0.00s) PASS tests/csapi.TestUploadKey/Parallel/Can_query_device_keys_using_POST (0.00s) PASS tests/csapi.TestUploadKey/Parallel/Can_query_specific_device_keys_using_POST (0.00s) PASS tests/csapi.TestUploadKey/Parallel/query_for_user_with_no_keys_returns_empty_key_dict (0.00s) FAIL tests/csapi.TestUploadKey/Parallel/Can_claim_one_time_key_using_POST (0.00s) PASS tests/csapi.TestUploadKey/Parallel/Rejects_invalid_device_keys (0.00s) PASS tests/csapi.TestUploadKey/Parallel/Should_reject_keys_claiming_to_belong_to_a_different_user (0.00s) FAIL tests/csapi.TestUploadKey/Parallel (0.01s) FAIL tests/csapi.TestUploadKey (2.38s) PASS tests/csapi.TestKeyClaimOrdering (2.33s) FAIL tests/csapi.TestUploadKeyIdempotency (2.44s) FAIL tests/csapi.TestUploadKeyIdempotencyOverlap (2.41s) FAIL tests/csapi.TestUrlPreview (2.45s) PASS tests/csapi.TestRoomSpecificUsernameChange/Eve_can_find_Alice_by_profile_display_name (0.00s) PASS tests/csapi.TestRoomSpecificUsernameChange/Eve_can_find_Alice_by_mxid (0.00s) PASS tests/csapi.TestRoomSpecificUsernameChange/Eve_cannot_find_Alice_by_room-specific_name_that_Eve_is_not_privy_to (0.00s) PASS tests/csapi.TestRoomSpecificUsernameChange/Bob_can_find_Alice_by_profile_display_name (0.00s) PASS tests/csapi.TestRoomSpecificUsernameChange/Bob_can_find_Alice_by_mxid (0.00s) PASS tests/csapi.TestRoomSpecificUsernameChange (14.19s) PASS tests/csapi.TestRoomSpecificUsernameAtJoin/Eve_can_find_Alice_by_profile_display_name (0.00s) PASS tests/csapi.TestRoomSpecificUsernameAtJoin/Eve_can_find_Alice_by_mxid (0.00s) PASS tests/csapi.TestRoomSpecificUsernameAtJoin/Eve_cannot_find_Alice_by_room-specific_name_that_Eve_is_not_privy_to (0.00s) PASS tests/csapi.TestRoomSpecificUsernameAtJoin/Bob_can_find_Alice_by_profile_display_name (0.00s) PASS tests/csapi.TestRoomSpecificUsernameAtJoin/Bob_can_find_Alice_by_mxid (0.00s) PASS tests/csapi.TestRoomSpecificUsernameAtJoin (1.61s) PASS tests/csapi.TestKeysQueryWithDeviceIDAsObjectFails (1.40s) FAIL Package tests/csapi (6m51.008s) PASS tests.TestToDeviceMessagesOverFederation/good_connectivity (1.15s) FAIL tests.TestToDeviceMessagesOverFederation/interrupted_connectivity (62.61s) FAIL tests.TestToDeviceMessagesOverFederation/stopped_server (93.90s) FAIL tests.TestToDeviceMessagesOverFederation (161.34s) PASS tests.TestUnrejectRejectedEvents (3.54s) FAIL tests.TestFederationKeyUploadQuery/Can_claim_remote_one_time_key_using_POST (0.02s) FAIL tests.TestFederationKeyUploadQuery/Can_query_remote_device_keys_using_POST (5.04s) FAIL tests.TestFederationKeyUploadQuery (9.38s) PASS tests.TestKnockingInMSC3787Room/Knocking_on_a_room_with_a_join_rule_other_than_'knock'_should_fail (0.01s) PASS tests.TestKnockingInMSC3787Room/Change_the_join_rule_of_a_room_from_'invite'_to_'knock' (0.02s) PASS tests.TestKnockingInMSC3787Room/Attempting_to_join_a_room_with_join_rule_'knock'_without_an_invite_should_fail (0.00s) FAIL tests.TestKnockingInMSC3787Room/Knocking_on_a_room_with_join_rule_'knock'_should_succeed (5.04s) FAIL tests.TestKnockingInMSC3787Room/A_user_that_has_already_knocked_is_allowed_to_knock_again_on_the_same_room (5.04s) FAIL tests.TestKnockingInMSC3787Room/Users_in_the_room_see_a_user's_membership_update_when_they_knock (0.01s) FAIL tests.TestKnockingInMSC3787Room/A_user_that_has_knocked_on_a_local_room_can_rescind_their_knock_and_then_knock_again (5.06s) FAIL tests.TestKnockingInMSC3787Room/A_user_in_the_room_can_reject_a_knock (5.07s) FAIL tests.TestKnockingInMSC3787Room/A_user_can_knock_on_a_room_without_a_reason (5.05s) PASS tests.TestKnockingInMSC3787Room/A_user_in_the_room_can_accept_a_knock (0.03s) PASS tests.TestKnockingInMSC3787Room/A_user_cannot_knock_on_a_room_they_are_already_invited_to (0.00s) PASS tests.TestKnockingInMSC3787Room/A_user_cannot_knock_on_a_room_they_are_already_in (0.01s) PASS tests.TestKnockingInMSC3787Room/A_user_that_is_banned_from_a_room_cannot_knock_on_it (0.03s) PASS tests.TestKnockingInMSC3787Room/Knocking_on_a_room_with_a_join_rule_other_than_'knock'_should_fail#01 (0.35s) PASS tests.TestKnockingInMSC3787Room/Change_the_join_rule_of_a_room_from_'invite'_to_'knock'#01 (0.03s) PASS tests.TestKnockingInMSC3787Room/Attempting_to_join_a_room_with_join_rule_'knock'_without_an_invite_should_fail#01 (0.01s) FAIL tests.TestKnockingInMSC3787Room/Knocking_on_a_room_with_join_rule_'knock'_should_succeed#01 (5.17s) FAIL tests.TestKnockingInMSC3787Room/A_user_that_has_already_knocked_is_allowed_to_knock_again_on_the_same_room#01 (5.13s) FAIL tests.TestKnockingInMSC3787Room/Users_in_the_room_see_a_user's_membership_update_when_they_knock#01 (0.02s) FAIL tests.TestKnockingInMSC3787Room/A_user_in_the_room_can_reject_a_knock#01 (5.23s) FAIL tests.TestKnockingInMSC3787Room/A_user_can_knock_on_a_room_without_a_reason#01 (5.15s) PASS tests.TestKnockingInMSC3787Room/A_user_in_the_room_can_accept_a_knock#01 (0.06s) PASS tests.TestKnockingInMSC3787Room/A_user_cannot_knock_on_a_room_they_are_already_invited_to#01 (0.00s) PASS tests.TestKnockingInMSC3787Room/A_user_cannot_knock_on_a_room_they_are_already_in#01 (0.18s) PASS tests.TestKnockingInMSC3787Room/A_user_that_is_banned_from_a_room_cannot_knock_on_it#01 (0.05s) FAIL tests.TestKnockingInMSC3787Room (51.96s) FAIL tests.TestKnockRoomsInPublicRoomsDirectoryInMSC3787Room (2.60s) PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/regular_event (0.02s) PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/non-state_membership_event (0.01s) PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/join_event (0.01s) PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/leave_event (0.01s) PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/invite_event (0.01s) PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room/event_with_mismatched_state_key (0.01s) PASS tests.TestCannotSendKnockViaSendKnockInMSC3787Room (3.26s) PASS tests.TestRestrictedRoomsLocalJoinInMSC3787Room/Join_should_fail_initially (0.01s) FAIL tests.TestRestrictedRoomsLocalJoinInMSC3787Room/Join_should_succeed_when_joined_to_allowed_room (0.04s) PASS tests.TestRestrictedRoomsLocalJoinInMSC3787Room/Join_should_fail_when_left_allowed_room (0.04s) PASS tests.TestRestrictedRoomsLocalJoinInMSC3787Room/Join_should_succeed_when_invited (0.04s) PASS tests.TestRestrictedRoomsLocalJoinInMSC3787Room/Join_should_fail_with_mangled_join_rules (0.06s) FAIL tests.TestRestrictedRoomsLocalJoinInMSC3787Room (2.56s) PASS tests.TestRestrictedRoomsRemoteJoinInMSC3787Room/Join_should_fail_initially (0.29s) FAIL tests.TestRestrictedRoomsRemoteJoinInMSC3787Room/Join_should_succeed_when_joined_to_allowed_room (0.32s) PASS tests.TestRestrictedRoomsRemoteJoinInMSC3787Room/Join_should_fail_when_left_allowed_room (0.10s) PASS tests.TestRestrictedRoomsRemoteJoinInMSC3787Room/Join_should_succeed_when_invited (0.38s) PASS tests.TestRestrictedRoomsRemoteJoinInMSC3787Room/Join_should_fail_with_mangled_join_rules (0.08s) FAIL tests.TestRestrictedRoomsRemoteJoinInMSC3787Room (5.05s) FAIL tests.TestRestrictedRoomsRemoteJoinLocalUserInMSC3787Room (4.43s) PASS tests.TestRestrictedRoomsRemoteJoinFailOverInMSC3787Room (3.87s) PASS tests.TestKnockRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV12 (2.49s) PASS tests.TestKnockRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV11 (2.46s) PASS tests.TestKnocking/Knocking_on_a_room_with_a_join_rule_other_than_'knock'_should_fail (0.01s) PASS tests.TestKnocking/Change_the_join_rule_of_a_room_from_'invite'_to_'knock' (0.02s) PASS tests.TestKnocking/Attempting_to_join_a_room_with_join_rule_'knock'_without_an_invite_should_fail (0.00s) FAIL tests.TestKnocking/Knocking_on_a_room_with_join_rule_'knock'_should_succeed (5.03s) FAIL tests.TestKnocking/A_user_that_has_already_knocked_is_allowed_to_knock_again_on_the_same_room (5.04s) FAIL tests.TestKnocking/Users_in_the_room_see_a_user's_membership_update_when_they_knock (0.01s) FAIL tests.TestKnocking/A_user_that_has_knocked_on_a_local_room_can_rescind_their_knock_and_then_knock_again (5.06s) FAIL tests.TestKnocking/A_user_in_the_room_can_reject_a_knock (5.07s) FAIL tests.TestKnocking/A_user_can_knock_on_a_room_without_a_reason (5.05s) PASS tests.TestKnocking/A_user_in_the_room_can_accept_a_knock (0.03s) PASS tests.TestKnocking/A_user_cannot_knock_on_a_room_they_are_already_invited_to (0.00s) PASS tests.TestKnocking/A_user_cannot_knock_on_a_room_they_are_already_in (0.01s) PASS tests.TestKnocking/A_user_that_is_banned_from_a_room_cannot_knock_on_it (0.03s) PASS tests.TestKnocking/Knocking_on_a_room_with_a_join_rule_other_than_'knock'_should_fail#01 (0.18s) PASS tests.TestKnocking/Change_the_join_rule_of_a_room_from_'invite'_to_'knock'#01 (0.03s) PASS tests.TestKnocking/Attempting_to_join_a_room_with_join_rule_'knock'_without_an_invite_should_fail#01 (0.01s) FAIL tests.TestKnocking/Knocking_on_a_room_with_join_rule_'knock'_should_succeed#01 (5.18s) FAIL tests.TestKnocking/A_user_that_has_already_knocked_is_allowed_to_knock_again_on_the_same_room#01 (5.13s) FAIL tests.TestKnocking/Users_in_the_room_see_a_user's_membership_update_when_they_knock#01 (0.02s) FAIL tests.TestKnocking/A_user_in_the_room_can_reject_a_knock#01 (5.22s) FAIL tests.TestKnocking/A_user_can_knock_on_a_room_without_a_reason#01 (5.15s) PASS tests.TestKnocking/A_user_in_the_room_can_accept_a_knock#01 (0.07s) PASS tests.TestKnocking/A_user_cannot_knock_on_a_room_they_are_already_invited_to#01 (0.00s) PASS tests.TestKnocking/A_user_cannot_knock_on_a_room_they_are_already_in#01 (0.18s) PASS tests.TestKnocking/A_user_that_is_banned_from_a_room_cannot_knock_on_it#01 (0.07s) FAIL tests.TestKnocking (55.23s) FAIL tests.TestKnockRoomsInPublicRoomsDirectory (2.37s) PASS tests.TestCannotSendNonKnockViaSendKnock/regular_event (0.01s) PASS tests.TestCannotSendNonKnockViaSendKnock/non-state_membership_event (0.01s) PASS tests.TestCannotSendNonKnockViaSendKnock/join_event (0.01s) PASS tests.TestCannotSendNonKnockViaSendKnock/leave_event (0.01s) PASS tests.TestCannotSendNonKnockViaSendKnock/invite_event (0.01s) PASS tests.TestCannotSendNonKnockViaSendKnock/event_with_mismatched_state_key (0.01s) PASS tests.TestCannotSendNonKnockViaSendKnock (1.81s) PASS tests.TestMediaFilenames/Parallel/ASCII/Can_upload_with_ASCII_file_name (0.01s) PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'name;with;semicolons'_over_/_matrix/client/v1/media/download (0.01s) FAIL tests.TestMediaFilenames/Parallel/ASCII/Can_download_specifying_a_different_ASCII_file_name_over__matrix/client/v1/media/download (0.01s) PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_specifying_a_different_ASCII_file_name (0.01s) PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'name;with;semicolons' (0.00s) PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'name_with_spaces'_over_/_matrix/client/v1/media/download (0.00s) PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'name_with_spaces' (0.00s) PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'ascii'_over_/_matrix/client/v1/media/download (0.00s) PASS tests.TestMediaFilenames/Parallel/ASCII/Can_download_file_'ascii' (0.00s) FAIL tests.TestMediaFilenames/Parallel/ASCII (0.00s) PASS tests.TestMediaFilenames/Parallel/Unicode/Can_upload_with_Unicode_file_name (0.00s) PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_unsafe_media_types_as_attachments (0.06s) PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_safe_media_types_with_parameters_as_inline (0.01s) PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_safe_media_types_as_inline_via__matrix/client/v1/media/download (0.07s) PASS tests.TestMediaFilenames/Parallel/Unicode/Can_download_with_Unicode_file_name_over_federation_via__matrix/client/v1/media/download (0.14s) FAIL tests.TestMediaFilenames/Parallel/Unicode/Can_download_specifying_a_different_Unicode_file_name_over__matrix/client/v1/media/download (0.01s) PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_safe_media_types_as_inline (0.01s) PASS tests.TestMediaFilenames/Parallel/Unicode/Can_download_with_Unicode_file_name_over_federation (0.01s) PASS tests.TestMediaFilenames/Parallel/Unicode/Can_download_with_Unicode_file_name_locally_over__matrix/client/v1/media/download (0.01s) PASS tests.TestMediaFilenames/Parallel/Unicode/Can_download_with_Unicode_file_name_locally (0.00s) PASS tests.TestMediaFilenames/Parallel/Unicode/Can_download_specifying_a_different_Unicode_file_name (0.00s) PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_unsafe_media_types_as_attachments_via__matrix/client/v1/media/download (0.18s) PASS tests.TestMediaFilenames/Parallel/Unicode/Will_serve_safe_media_types_with_parameters_as_inline_via__matrix/client/v1/media/download (0.18s) FAIL tests.TestMediaFilenames/Parallel/Unicode (0.00s) FAIL tests.TestMediaFilenames/Parallel (0.00s) FAIL tests.TestMediaFilenames (3.91s) PASS tests.TestMediaWithoutFileName/parallel/Can_upload_without_a_file_name (0.00s) PASS tests.TestMediaWithoutFileName/parallel/Can_download_without_a_file_name_locally (0.01s) PASS tests.TestMediaWithoutFileName/parallel/Can_download_without_a_file_name_over_federation (0.01s) PASS tests.TestMediaWithoutFileName/parallel (0.00s) PASS tests.TestMediaWithoutFileName (4.25s) PASS tests.TestMediaWithoutFileNameCSMediaV1/parallel/Can_upload_without_a_file_name (0.00s) PASS tests.TestMediaWithoutFileNameCSMediaV1/parallel/Can_download_without_a_file_name_locally (0.00s) PASS tests.TestMediaWithoutFileNameCSMediaV1/parallel/Can_download_without_a_file_name_over_federation (0.19s) PASS tests.TestMediaWithoutFileNameCSMediaV1/parallel (0.00s) PASS tests.TestMediaWithoutFileNameCSMediaV1 (2.17s) PASS tests.TestLocalPngThumbnail/test_/_matrix/media/v3_endpoint (0.08s) PASS tests.TestLocalPngThumbnail/test_/_matrix/client/v1/media_endpoint (0.00s) PASS tests.TestLocalPngThumbnail (1.92s) PASS tests.TestRemotePngThumbnail/test_/_matrix/media/v3_endpoint (0.14s) PASS tests.TestRemotePngThumbnail/test_/_matrix/client/v1/media_endpoint (0.00s) PASS tests.TestRemotePngThumbnail (1.85s) PASS tests.TestFederationThumbnail (4.11s) FAIL tests.TestRestrictedRoomsSpacesSummaryLocal (2.44s) PASS tests.TestRestrictedRoomsSpacesSummaryFederation (2.41s) PASS tests.TestRestrictedRoomsLocalJoin/Join_should_fail_initially (0.01s) FAIL tests.TestRestrictedRoomsLocalJoin/Join_should_succeed_when_joined_to_allowed_room (0.04s) PASS tests.TestRestrictedRoomsLocalJoin/Join_should_fail_when_left_allowed_room (0.04s) PASS tests.TestRestrictedRoomsLocalJoin/Join_should_succeed_when_invited (0.04s) PASS tests.TestRestrictedRoomsLocalJoin/Join_should_fail_with_mangled_join_rules (0.06s) FAIL tests.TestRestrictedRoomsLocalJoin (2.71s) PASS tests.TestRestrictedRoomsRemoteJoin/Join_should_fail_initially (0.39s) FAIL tests.TestRestrictedRoomsRemoteJoin/Join_should_succeed_when_joined_to_allowed_room (0.36s) PASS tests.TestRestrictedRoomsRemoteJoin/Join_should_fail_when_left_allowed_room (0.09s) PASS tests.TestRestrictedRoomsRemoteJoin/Join_should_succeed_when_invited (0.31s) PASS tests.TestRestrictedRoomsRemoteJoin/Join_should_fail_with_mangled_join_rules (0.07s) FAIL tests.TestRestrictedRoomsRemoteJoin (5.26s) FAIL tests.TestRestrictedRoomsRemoteJoinLocalUser (4.43s) PASS tests.TestRestrictedRoomsRemoteJoinFailOver (3.96s) PASS tests.TestRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV12 (2.60s) PASS tests.TestRestrictedRoomsLocalJoinNoCreatorsUsesPowerLevelsV11 (2.57s) FAIL tests.TestClientSpacesSummary/query_whole_graph (0.02s) PASS tests.TestClientSpacesSummary/max_depth (0.00s) FAIL tests.TestClientSpacesSummary/suggested_only (0.00s) FAIL tests.TestClientSpacesSummary/pagination (0.00s) FAIL tests.TestClientSpacesSummary/redact_link (0.04s) FAIL tests.TestClientSpacesSummary (3.01s) FAIL tests.TestClientSpacesSummaryJoinRules (2.93s) FAIL tests.TestFederatedClientSpaces (4.47s) FAIL tests.TestJumpToDateEndpoint/parallel/federation/when_looking_backwards_before_the_room_was_created,_should_be_able_to_find_event_that_was_imported (0.06s) FAIL tests.TestJumpToDateEndpoint/parallel/federation/looking_forwards,_should_be_able_to_find_event_that_was_sent_before_we_joined (0.42s) FAIL tests.TestJumpToDateEndpoint/parallel/federation/looking_backwards,_should_be_able_to_find_event_that_was_sent_before_we_joined (0.45s) FAIL tests.TestJumpToDateEndpoint/parallel/federation/can_paginate_after_getting_remote_event_from_timestamp_to_event_endpoint (0.50s) FAIL tests.TestJumpToDateEndpoint/parallel/federation (0.00s) FAIL tests.TestJumpToDateEndpoint/parallel/should_not_be_able_to_query_a_private_room_you_are_not_a_member_of (0.11s) FAIL tests.TestJumpToDateEndpoint/parallel/should_find_event_after_given_timestamp (0.11s) FAIL tests.TestJumpToDateEndpoint/parallel/should_not_be_able_to_query_a_public_room_you_are_not_a_member_of (0.14s) FAIL tests.TestJumpToDateEndpoint/parallel/should_find_next_event_topologically_after_given_timestamp_when_all_message_timestamps_are_the_same (0.26s) PASS tests.TestJumpToDateEndpoint/parallel/should_find_nothing_after_the_latest_timestamp (0.19s) FAIL tests.TestJumpToDateEndpoint/parallel/should_find_next_event_topologically_before_given_timestamp_when_all_message_timestamps_are_the_same (0.22s) PASS tests.TestJumpToDateEndpoint/parallel/should_find_nothing_before_the_earliest_timestamp (0.23s) FAIL tests.TestJumpToDateEndpoint/parallel/should_find_event_before_given_timestamp (0.18s) FAIL tests.TestJumpToDateEndpoint/parallel (0.50s) FAIL tests.TestJumpToDateEndpoint (4.72s) PASS tests.TestUnknownEndpoints/Unknown_prefix (0.00s) PASS tests.TestUnknownEndpoints/Client-server_endpoints (0.00s) PASS tests.TestUnknownEndpoints/Server-server_endpoints (0.00s) FAIL tests.TestUnknownEndpoints/Key_endpoints (0.00s) PASS tests.TestUnknownEndpoints/Media_endpoints (0.00s) FAIL tests.TestUnknownEndpoints (2.41s) PASS tests.TestMSC4289PrivilegedRoomCreators/PL_event_is_missing_creator_in_users_map (0.03s) PASS tests.TestMSC4289PrivilegedRoomCreators/m.room.tombstone_needs_PL150_in_the_PL_event (0.02s) FAIL tests.TestMSC4289PrivilegedRoomCreators/creator_cannot_set_self_in_PL_event (0.03s) PASS tests.TestMSC4289PrivilegedRoomCreators/creator_can_kick_admin (0.08s) PASS tests.TestMSC4289PrivilegedRoomCreators/creator_can_kick_admin_above_PL100 (0.08s) PASS tests.TestMSC4289PrivilegedRoomCreators/creator_can_kick_admin_at_JSON_max_value (0.09s) PASS tests.TestMSC4289PrivilegedRoomCreators/power_level_cannot_be_set_beyond_max_canonical_JSON_int (0.04s) PASS tests.TestMSC4289PrivilegedRoomCreators/admin_with_>PL100_cannot_kick_creator (0.09s) FAIL tests.TestMSC4289PrivilegedRoomCreators/admin_with_>PL100_sorts_after_the_room_creator_for_state_resolution (2.31s) PASS tests.TestMSC4289PrivilegedRoomCreators/power_level_content_override_can_be_set (0.04s) FAIL tests.TestMSC4289PrivilegedRoomCreators/power_level_content_override_cannot_set_the_room_creator (0.03s) FAIL tests.TestMSC4289PrivilegedRoomCreators (5.25s) FAIL tests.TestMSC4289PrivilegedRoomCreators_Additional (2.49s) FAIL tests.TestMSC4289PrivilegedRoomCreators_InvitedAreCreators (2.36s) FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalCreatorsAndInvited (2.46s) FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation/additional_creators_isn't_an_array (0.00s) FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation/additional_creators_elements_aren't_strings (0.00s) FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation/additional_creators_elements_aren't_user_ID_strings (0.00s) FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation/additional_creators_elements_aren't_valid_user_ID_strings_(domain) (0.00s) PASS tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation/additional_creators_are_valid (0.02s) FAIL tests.TestMSC4289PrivilegedRoomCreators_AdditionalValidation (2.76s) FAIL tests.TestMSC4289PrivilegedRoomCreators_Upgrades (2.86s) PASS tests.TestMSC4291RoomIDAsHashOfCreateEvent (1.39s) PASS tests.TestComplementCanCreateValidV12Rooms (2.30s) PASS tests.TestMSC4291RoomIDAsHashOfCreateEvent_AuthEventsOmitsCreateEvent (4.63s) PASS tests.TestMSC4291RoomIDAsHashOfCreateEvent_UpgradedRooms (1.74s) PASS tests.TestMSC4291RoomIDAsHashOfCreateEvent_CannotSendCreateEvent (1.53s) PASS tests.TestMSC4291RoomIDAsHashOfCreateEvent_RoomIDIsOnCreateEvent (1.32s) FAIL tests.TestMSC4297StateResolutionV2_1_starts_from_empty_set (15.55s) FAIL tests.TestMSC4297StateResolutionV2_1_includes_conflicted_subgraph (19.47s) FAIL tests.TestMSC4311FullCreateEventOnStrippedState (3.87s) FAIL Package tests (12m45.767s) === Skipped === SKIP: tests/csapi TestCanRegisterAdmin (1.71s) admin_test.go:21: Deploy times: 1.852881ms blueprints, 1.518405072s containers client.go:845: [CSAPI] GET hs1/_synapse/admin/v1/register => 404 Not Found (1.770363ms) auth.go:130: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404 === SKIP: tests/csapi TestServerNotices (1.77s) admin_test.go:30: Deploy times: 1.59209ms blueprints, 1.55048693s containers client.go:845: [CSAPI] GET hs1/_synapse/admin/v1/register => 404 Not Found (2.949981ms) auth.go:130: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404 === SKIP: tests/csapi TestRegistration/parallel/POST_/_synapse/admin/v1/register_admin_with_shared_secret (0.00s) apidoc_register_test.go:318: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404 --- SKIP: TestRegistration/parallel/POST_/_synapse/admin/v1/register_admin_with_shared_secret (0.00s) === SKIP: tests/csapi TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret (0.00s) apidoc_register_test.go:318: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404 --- SKIP: TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret (0.00s) === SKIP: tests/csapi TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_disallows_symbols (0.00s) apidoc_register_test.go:318: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404 --- SKIP: TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_disallows_symbols (0.00s) === SKIP: tests/csapi TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_downcases_capitals (0.00s) apidoc_register_test.go:318: Homeserver image does not support shared secret registration, /_synapse/admin/v1/register returned HTTP 404 --- SKIP: TestRegistration/parallel/POST_/_synapse/admin/v1/register_with_shared_secret_downcases_capitals (0.00s) === SKIP: tests/csapi TestArchivedRoomsHistory/timeline_is_empty/incremental_sync (0.00s) sync_archive_test.go:293: Synapse doesn't return the room at all! 2026/02/25 13:51:29 ============================================ 2026/02/25 13:51:29 bf27bbc3bdba3dccda26f912b176ddb1b793b58f08f49bd545877226be3cfcd3 : Server logs: ```
Author
Contributor

There are more speculative "fixes" or tweaks to get more tests working.

I will push those up on top of this branch for general feedback. I will not seriously expect them all to go in unmodified. That would be a totally reckless by my own estimate.

There are more speculative "fixes" or tweaks to get more tests working. I will push those up on top of this branch for general feedback. I will not seriously expect them all to go in unmodified. That would be a totally reckless by my own estimate.
Jade changed title from fix(testing): fix DB path for Matrix Complement test and enable easier first-time registration for automation to WIP: fix(testing): fix DB path for Matrix Complement test and enable easier first-time registration for automation 2026-03-03 18:31:55 +00:00
nex requested changes 2026-03-03 18:50:51 +00:00
nex left a comment
Owner

Fine with the DB path change, but the first-run change voids one of the main purposes of first-run

Fine with the DB path change, but the first-run change voids one of the main purposes of first-run
@ -320,0 +319,4 @@
.config
.yes_i_am_very_very_sure_i_want_an_open_registration_server_prone_to_abuse;
if services.firstrun.is_first_run() && !open_registration {
Owner

You cannot have a completely open registration server while first-run is active

You cannot have a completely open registration server while first-run is active
Author
Contributor

I'm confused then. How does Synapse pass the Complement tests?

If a custom token of sufficient length is set, the user requests open registration, and enables the yes_i_am_very_very_sure_i_want_an_open_registration_server_prone_to_abuse... then why are we not allowing them to have a custom-token gated auth flow from the first boot? Seems perfectly reasonable to me.

What are your other suggestions for allowing automation and the Complement tests to register accounts, test the login endpoint, and run the full suite of tests?

I'm confused then. How does Synapse pass the Complement tests? If a custom token of sufficient length is set, the user requests open registration, _and_ enables the `yes_i_am_very_very_sure_i_want_an_open_registration_server_prone_to_abuse`... then why are we not allowing them to have a custom-token gated auth flow from the first boot? Seems perfectly reasonable to me. What are your other suggestions for allowing automation and the Complement tests to register accounts, test the login endpoint, and run the full suite of tests?
Owner
https://forgejo.ellis.link/continuwuation/continuwuity/pulls/1449
Author
Contributor

ok, so we jsut want a better named config then? that i can do in no time surely.

force_disable_first_run_mode_if_you_enable_this_i_will_yell_at_you gets preference since Jade beat nexy this time :)

ok, so we jsut want a better named config then? that i can do in no time surely. `force_disable_first_run_mode_if_you_enable_this_i_will_yell_at_you` gets preference since Jade beat nexy this time :)
gamesguru marked this conversation as resolved
ginger left a comment
Owner

The database path change is fine, but the first-run changes need to be removed. !1449 already addressed that issue.

The database path change is fine, but the first-run changes need to be removed. !1449 already addressed that issue.
ginger changed title from WIP: fix(testing): fix DB path for Matrix Complement test and enable easier first-time registration for automation to fix(testing): fix DB path for Matrix Complement test and enable easier first-time registration for automation 2026-03-04 15:03:41 +00:00
Author
Contributor

@ginger wrote in #1453 (comment):

The database path change is fine, but the first-run changes need to be removed. !1449 already addressed that issue.

Hi yes, I agree your variable naming and handling of that logic is far better. I'm putting this on my list but realistically may not be today

@ginger wrote in https://forgejo.ellis.link/continuwuation/continuwuity/pulls/1453#issuecomment-25535: > The database path change is fine, but the first-run changes need to be removed. !1449 already addressed that issue. Hi yes, I agree your variable naming and handling of that logic is far better. I'm putting this on my list but realistically may not be today
gamesguru force-pushed guru/fix/first-time-registration-and-Matrix-Complement-Test-Suite from 03d13a489c
Some checks failed
Documentation / Build and Deploy Documentation (pull_request) Has been skipped
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 3m19s
Checks / Prek / Clippy and Cargo Tests (pull_request) Failing after 41m0s
to 70b6ffb7d1
All checks were successful
Documentation / Build and Deploy Documentation (pull_request) Has been skipped
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 2m4s
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 38m34s
2026-03-04 20:37:13 +00:00
Compare
Author
Contributor

I have more commits coming to this branch shortly.

I have more commits coming to this branch shortly.
All checks were successful
Documentation / Build and Deploy Documentation (pull_request) Has been skipped
Checks / Prek / Pre-commit & Formatting (pull_request) Successful in 2m4s
Required
Details
Checks / Prek / Clippy and Cargo Tests (pull_request) Successful in 38m34s
Required
Details
This pull request has changes requested by an official reviewer.
This branch is out-of-date with the base branch
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u guru/fix/first-time-registration-and-Matrix-Complement-Test-Suite:gamesguru-guru/fix/first-time-registration-and-Matrix-Complement-Test-Suite
git switch gamesguru-guru/fix/first-time-registration-and-Matrix-Complement-Test-Suite
Sign in to join this conversation.
No reviewers
No milestone
No project
No assignees
4 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
continuwuation/continuwuity!1453
No description provided.