Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Per-conference "only forward audio packets of the loudest speakers" #1681

Open
jbg opened this issue Jul 12, 2021 · 1 comment
Open

Per-conference "only forward audio packets of the loudest speakers" #1681

jbg opened this issue Jul 12, 2021 · 1 comment

Comments

@jbg
Copy link

jbg commented Jul 12, 2021

#1677 adds the very nice feature to only forward audio for the loudest speakers, making very large audio calls possible. However, there are some deployments using JVB with custom frontends where this implementation won't work. An example is where users are moving around some spatial area (e.g. a virtual world), and they should only hear the participants closest to them. At the moment this is implemented by doing the mixing on the client side, which is based on the assumption that JVB forwards all audio all the time, which makes it incompatible with the feature in #1677.

  1. What would be the best approach to enable/disable this feature on a per-conference basis ("best" in terms of being consistent with other features that are enabled per-room)?
  2. Would there be any interest in a patch to make clients able to signal (presumably via Colibri) the endpoints they'd like to receive audio from, in a similar manner to the existing mechanisms for doing that with video?

We're happy to do implementation work for either or both the above; would just like to ensure that we don't duplicate any effort and that our work would be considered for merging once done.

@jbg jbg changed the title Allow enabling Per-conference "only forward audio packets of the loudest speakers" Jul 12, 2021
@maxired
Copy link

maxired commented Jan 19, 2022

Hey.

You might be interested to have a look at what @hasevr did in https://github.com/BinauralMeet/jitsi-videobridge
basically I added new setPerceptibles command so frontend can require specific streams

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants