No audio/video in Element X call #1306
Labels
No labels
Blocked
Bug
Cherry-picking
Database
Dependencies
Dependencies/Renovate
Difficulty
Easy
Difficulty
Hard
Difficulty
Medium
Documentation
Enhancement
Good first issue
Help wanted
Inherited
Matrix/Administration
Matrix/Appservices
Matrix/Auth
Matrix/Client
Matrix/Core
Matrix/E2EE
Matrix/Federation
Matrix/Hydra
Matrix/MSC
Matrix/Media
Matrix/T&S
Meta
Meta/CI
Meta/Packaging
Priority
Blocking
Priority
High
Priority
Low
Security
Status
Confirmed
Status
Duplicate
Status
Invalid
Status
Needs Investigation
Support
To-Merge
Wont fix
old/ci/cd
old/rust
No project
No assignees
6 participants
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
continuwuation/continuwuity#1306
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
The issue description points to missing video, as it is more obvious immediately, but audio is also missing in the same way.
Self-hosted Matrix server setup:
Continuwuity, LiveKit, LiveKit-wjt, Element web and element call.
Test case: call between two clients, at least one of them uses Element X. Minimal setup is to create a room, not invite anybody and start video call in it.
Expected functionality (for simplified single user room call) - call starts and shows video from camera in it. It works for Element X with room at matrix.org (presumably uses Synapse) and it works for self-hosted setup when using element call web client.
When using Element X android client in a room hosted by Continuwuity server, picture from camera is only displayed in preview (join call button) but after joining there is empty screen.

Mention of issue specific to Element X client: 763#issuecomment-22001
Additional symptoms. Not sure if these are connected:

When other client calls me (I am using Element X) and I have the chat open there is no button to answer the call, only a message appears in the chat that call started.
LiveKit-jwt logs on start of single user room call from Element X (redacted)
LiveKit SFU logs on start of single user room call from Element X (redacted)
Redacted example of the same test case but successfully performed when using element call web client on the same private server (for comparison)
No video in Element X callto No audio/video in Element X callContinuity does not support the delayed event functionality required by Element Call (https://github.com/matrix-org/matrix-spec-proposals/blob/toger5/expiring-events-keep-alive/proposals/4140-delayed-events-futures.md), which causes stuttering during video and voice calls in ElementX. Although this issue was raised six months ago, Continuity seems to have made no progress in resolving it. However, tuwunel has solved the Element Call problem.
Delayed events are unrelated to this issue, not required for functionality, and a lack of them doesn't cause the issues described?
We can't have voice calls. We can't migrate to tuwunel. What can we do to be able to have voice calls?
You can help us figure out what isn't working in our sliding sync implementation so that we can fix it, but other than that, nothing but wait. If it's a critical issue for you I suggest using something out of band like Jitsi in the meantime. I promise we're looking into this but just stretched for development bandwidth.
I found the issue in the sliding sync impl. I'm not really an expert on the spec, but seems wildcards weren't being properly handled with the state_key. I was able to call between two accounts with my changes. I'm going to open a PR in the morning once I ensure it all works and that my changes fit the CONTRIBUTING.md
I believe this is now fixed in latest! Can probably be closed.