AI noise suppression

AI Noise Suppression enables you to suppress hundreds of types of noise and reduce distortion in human voices when multiple people speak at the same time. In scenarios such as online meetings, online chat rooms, video consultations with doctors, and online gaming, AI Noise Suppression makes virtual communication as smooth as face-to-face interaction.

AI Noise Suppression reduces the following types of noise:

• Television
• Kitchen
• Street, such as birds chirping, traffic, and subway sounds
• Machine, such as fans, air conditioners, vacuum cleaners, and copiers
• Office, such as keyboard and mouse clicks
• Household, such as doors opening, creaking chairs, crying babies, and house renovations
• Constant knocking
• Beeps and clapping
• Music

You can choose following noise reduction strategies:

• Default: Reduces noise to a comfortable level without distorting human voice.
• Custom: A more enhanced or customized noise reduction strategy for your business scenario. Contact support@agora.io for details.

Want to try out AI Noise Suppression? Use the online demo.

In the pre-processing stage, AI Noise Suppression uses deep learning noise reduction algorithms to modify data in the extensions pipeline.

Ensure that you have implemented the SDK quickstart in your project.

This section shows you how to integrate AI Noise Suppression into your app.

Call setAINSMode to enable the AI noise suppression feature, and select a noise suppression mode:

_7

// Noise reductions modes

_7

// 0 -> Balance mode

_7

// 1 -> Aggressive mode

_7

// 2 -> Aggressive mode with low latency

_7

int mode = 1;

_7

// Set the mode for Audio AI Noise Suppression

_7

int result = rtcEngine.setAINSMode(true, mode);

This section completes the information on this page, or points you to documentation that explains other aspects about this product.

• setAINSMode

Currently, AI Noise Suppression has the following limitations:

• If the sample rate of the input signal is not 16 kHz, AI Noise Suppression:

  1. Down-samples the signal to 16 kHz.
  2. Removes noise.
  3. Resamples the output signal to the original sample rate.

  This means that audio data above 8 kHz is removed in the output signal.

• In some scenarios, AI Noise Suppression may cause audio quality to decrease by a certain degree.

• When multiple people speak at the same time, the audio quality of lowest human voices could be decreased by a certain degree.