4.0 Changelog: Twilio Video Android

Bug Fixes

• Fixed an SCTP related WebRTC security vulnerability detailed here.

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants. As a result, tracks published after a Room.State.RECONNECTED event might not be subscribed to by a RemoteParticipant.
• Using Camera2Capturer with a camera ID that does not support ImageFormat.PRIVATE capture outputs results in a runtime exception. Reference this issue for guidance on a temporary work around.

Size Report

API Changes

• Implemented the Network Quality functionality for Group Rooms.
• The Network Quality feature is disabled by default, to enable it set the ConnectOptions.Builder.enableNetworkQuality property to true when connecting to a Group Room.
  • To determine the current network quality level for your Local Participant, call LocalParticipant.getNetworkQualityLevel(). Note, this will return NETWORK_QUALITY_LEVEL_UNKNOWN if:
    • The ConnectOptions.networkQualityEnabled property was set to false
    • Using a Peer-to-Peer room
    • The network quality level has not yet been computed
  • Network Quality Level for Remote Participants will be available in a future release
  • Implementing the onNetworkQualityLevelChanged method on your LocalParticipant.Listener will allow you to receive callbacks when the network quality level changes

1
// Enable network quality
2
ConnectOptions connectOptions =
3
                new ConnectOptions.Builder(token)
4
                        .roomName(roomName)
5
                        .enableNetworkQuality(true)
6
                        .build();
7

8
// Override onNetworkLevelChanged to observe network quality level changes
9
LocalParticipant.Listener localParticipantListener = new LocalParticipant.Listener() {
10
    ...
11

12
    @Override
13
    public void onNetworkQualityLevelChanged(
14
        @NonNull LocalParticipant localParticipant,
15
        @NonNull NetworkQualityLevel networkQualityLevel) {}
16
}
17

18
// Connect to room and register listener
19
Room room = Video.connect(context, connectOptions, roomListener);
20
LocalParticipant localParticipant = room.getLocalParticipant();
21
localParticipant.setListener(localParticipantListener);
22

23
// Get current network quality
24
localParticipant.getNetworkQualityLevel();

For more information, refer to the API docs and to the Network Quality Tutorial.

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants. As a result, tracks published after a Room.State.RECONNECTED event might not be subscribed to by a RemoteParticipant.
• Using Camera2Capturer with a camera ID that does not support ImageFormat.PRIVATE capture outputs results in a runtime exception. Reference this issue for guidance on a temporary work around.

Size Report

• Programmable Video Android SDK 4.3.2 [bintray], [docs]

Enhancement

• Upgraded the Gradle plugin used to build the SDK to 3.5.0.

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants. As a result, tracks published after a Room.State.RECONNECTED event might not be subscribed to by a RemoteParticipant.
• Using Camera2Capturer with a camera ID that does not support ImageFormat.PRIVATE capture outputs results in a runtime exception. Reference this issue for guidance on a temporary work around.

Size Report

• Programmable Video Android SDK 4.3.1 [bintray], [docs]

Bug Fixes

• Fixed updating CameraCapturer.State when error occurs.

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants. As a result, tracks published after a Room.State.RECONNECTED event might not be subscribed to by a RemoteParticipant.
• Using Camera2Capturer with a camera ID that does not support ImageFormat.PRIVATE capture outputs results in a runtime exception. Reference this issue for guidance on a temporary work around.

Size Report

The Dominant Speaker Detection API sends events to your application every time the dominant speaker changes. You can use those events to improve the end user's experience by, for example, highlighting which participant is currently talking.

The Dominant Speaker Detection API is only available for Group Rooms. To enable dominant speaker detection, set the ConnectOptions.dominantSpeakerEnabled property to true. Use Room.getDominantSpeaker() to determine the current dominant speaker. Implement Room.Listener.onDominantSpeakerChanged() method to receive callbacks when the dominant speaker changes.

For more information, refer to the API docs and to the dominant speaker tutorial

This release is available here

1
 ConnectOptions connectOptions =
2
                new ConnectOptions.Builder(token)
3
                        .roomName(roomName)
4
                        .enableDominantSpeaker(true)
5
                        .build();
6
Room room = Video.connect(context, connectOptions, roomListener);
7

8
@Override
9
void onDominantSpeakerChanged(
10
                @NonNull Room room, @Nullable RemoteParticipant remoteParticipant) {
11
                // Handle dominant speaker change
12
        }
13

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants. As a result, tracks published after a Room.State.RECONNECTED event might not be subscribed to by a RemoteParticipant.

Size Report

Improvements

• Added field enableAutomaticSubscription to ConnectOptions. enableAutomaticSubscription toggles automatic track subscription. If set to false, the LocalParticipant will receive notifications of track publish events, but will not automatically subscribe to them. If set to true, the LocalParticipant will automatically subscribe to tracks as they are published. If unset, the default is true. Note: This feature is only available for Group Rooms. Toggling the flag in a P2P room does not modify subscription behavior.

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants. As a result, tracks published after a Room.State.RECONNECTED event might not be subscribed to by a RemoteParticipant.

Size Report

Bug Fixes

• Fixed stuck aspect ratio when switching orientations with ScreenCapturer.
• Fixed a bug where media reconnection might fail when the loopback interface is mistakenly chosen as a preferred network interface.

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants. As a result, tracks published after a Room.State.RECONNECTED event might not be subscribed to by a RemoteParticipant.

Size Report

Improvements

• Fixed various Lint errors / warnings.

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants. As a result, tracks published after a Room.State.RECONNECTED event might not be subscribed to by a RemoteParticipant.

Size Report

Improvements

• Added the AudioSink interface. When added to a LocalAudioTrack or RemoteAudioTrack, developers will receive a callback with the raw audio byte buffer from each audio frame. The example below demonstrates adding an AudioSink to a LocalAudioTrack.

1
AudioSink audioSink = (audioSample, encoding, sampleRate, channels) -> {
2
    Log.v("AudioSink", "Received audio frame");
3
};
4
localAudioTrack.addSink(audioSink);

The AudioSink can then be removed with the following code.

localAudioTrack.removeSink(audioSink);

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants. As a result, tracks published after a Room.State.RECONNECTED event might not be subscribed to by a RemoteParticipant.

Size Report

Bug Fixes

• Fixed bug in Camera2Capturer.switchCamera which resulted in onCameraSwitched being invoked with a null camera ID #379

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants. As a result, tracks published after a Room.State.RECONNECTED event might not be subscribed to by a RemoteParticipant.

Size Report

Bug Fixes

• Room.getStats() will raise a callback to the provided StatsObserver if called while Room.getState() == Room.State.RECONNECTING.
• Fixed a crash related to stats gathering which could occur when insights reporting is enabled.
• Fixed a crash related to media state summarization which could occur when disconnecting from a Room.
• Fixed a crash related to stats gathering which could occur in the media monitor component.

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants.

Size Report

Improvements

• Added new state Reconnecting to Room.State and new callbacks onReconnecting, onReconnected to Room.Listener. When the LocalParticipant experiences a network interruption in signaling or media, the room will transition to Reconnecting and Room.Listener will notify the developer of this new state via onReconnecting. If the connection is successfully restored, Room.Listener will notify the developer via onReconnected. However, if the connection could not be reestablished Room.Listener will notify the developer via onDisconnected.
• Added and updated public API nullability annotations.
• Changed OpusCodec.NAME and IsacCodec.NAME to lowercase

Known issues

• Network handoff, and subsequent connection renegotiation is not supported for IPv6 networks #72
• Participant disconnect event can take up to 120 seconds to occur #80 #73
• The SDK is not side-by-side compatible with other WebRTC based libraries #340
• Codec preferences do not function correctly in a hybrid codec Group Room with the following codecs:
  • ISAC
  • PCMA
  • G722
  • VP9
• Unpublishing and republishing a LocalAudioTrack or LocalVideoTrack might not be seen by Participants.

Size Report