How can I get audio byte on WhepExample use kDummyAudio？

[Dange1]

AudioDeviceModule audioDeviceModule = new AudioDeviceModule(AudioLayer.kPlatformDefaultAudio);
factory = new PeerConnectionFactory(audioDeviceModule);

how can I get audio byte？

[Dange1]

sorry with kDummyAudio
AudioDeviceModule audioDeviceModule = new AudioDeviceModule(AudioLayer.kDummyAudio);
factory = new PeerConnectionFactory(audioDeviceModule);

[devopvoid]

You can't get local audio, neither microphone nor speaker. This will completely disable audio processing in your WebRTC application, as stated here. If you want to get remote audio, you wont hear it, as the speakers are disabled.

But, if you want to receive remote audio and get the incoming audio frames:

• Create an audio track
• In the PeerConnectionObserver register a callback in onTrack() on the remote audio track to receive remote audio. Reference here.

[devopvoid]

Closing this, as all the documentation regarding this issue is there.

[Dange1]

In the PeerConnectionObserver register a callback in onTrack()
it worked when I use AudioLayer.kPlatformDefaultAudio
but it does not work when I use AudioLayer.kDummyAudio on the same code
System： macos

[Dange1]

In the WhepExample, I replace VideoDeviceSource with AudioTrackSource
AudioOptions audioOptions = new AudioOptions();
audioOptions.echoCancellation = false;
audioOptions.autoGainControl = false;
audioOptions.noiseSuppression = false;

AudioTrackSource audioSource = factory.createAudioSource(audioOptions);
AudioTrack audioTrack = factory.createAudioTrack("audioTrack", audioSource);
RTCRtpTransceiverInit transceiverInit = new RTCRtpTransceiverInit();
transceiverInit.direction = RTCRtpTransceiverDirection.RECV_ONLY;
RTCRtpTransceiver transceiver = peerConnection.addTransceiver(audioTrack, transceiverInit);

factory init like this
AudioDeviceModule audioDeviceModule = new AudioDeviceModule(AudioLayer.kPlatformDefaultAudio);
factory = new PeerConnectionFactory(audioDeviceModule);

register a callback like this:
MediaStreamTrack track = transceiver.getReceiver().getTrack();
if (track instanceof AudioTrack vTrack) {
vTrack.addSink(new AudioFrameProcessSink(new SessionManager(), "a"));
}

AudioFrameProcessSink implements AudioTrackSink

when factory init with AudioLayer.kPlatformDefaultAudio, My AudioFrameProcessSink can get byte[] data onData
when factory init with AudioLayer.kDummyAudio, My AudioFrameProcessSink can not get byte[] data onData

@devopvoid help me please

[devopvoid]

I am elaborating this right now and will report back when there are results. What you need is possible but with some code changes.

[Dange1]

I also want to get byte[] data onData with Linux System, can you elaborating this by using kLinuxAlsaAudio or kDummyAudio on Linux System
@devopvoid

[devopvoid]

This support has landed in the current 0.14.0-SNAPSHOT and will be available in the upcoming release 0.14.0. Please refer to the already existing documentation: https://jrtc.dev/guide/audio/headless-audio