Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Echo cancellation #10

Open
RASPIAUDIO opened this issue Dec 27, 2024 · 7 comments
Open

Echo cancellation #10

RASPIAUDIO opened this issue Dec 27, 2024 · 7 comments

Comments

@RASPIAUDIO
Copy link

RASPIAUDIO commented Dec 27, 2024

I made it work on the ESP32 S3 Muse Radio but it’s picking up it’s own response, I think webrtc has built-in noise cancellation but how to activate it?

https://www.youtube.com/watch?v=Q9BVurtly_M&embeds_referring_euri=https%3A%2F%2Fcommunity.openai.com%2F&source_ve_path=Mjg2NjY

@juberti-oai
Copy link

There's no echo cancellation built into ESP32, you'll need to find an external AEC library like https://www.espressif.com/en/solutions/audio-solutions/esp-afe.

@shenxiaozheng
Copy link

We can refer to these examples to implement the echo cancellation functionality. https://github.com/espressif/esp-skainet/tree/master/examples

@nischalj10
Copy link

hey all, I tried echo cancellation (AEC) via ESP-AFE but its too slow for realtime needs. I think the esp32s3 chipset is not capable of doing wifi+realtime audio+ noise cancellation all at the same time.

were any of you successful in accomplishing noise cancellation?

@RASPIAUDIO
Copy link
Author

hey all, I tried echo cancellation (AEC) via ESP-AFE but its too slow for realtime needs. I think the esp32s3 chipset is not capable of doing wifi+realtime audio+ noise cancellation all at the same time.

were any of you successful in accomplishing noise cancellation?

@nischalj10 can you share your code ? I can try to run AEC on one core and webrtc on the other

@shenxiaozheng
Copy link

I have tested the AEC algorithm of ESP before. CPU usage is less than 20% of a single core. Do you have any tests in this area.

@nischalj10
Copy link

@nischalj10 can you share your code ? I can try to run AEC on one core and webrtc on the other

hey @RASPIAUDIO - i have done a simple from scratch implementation of just aec (without realtime webrtc) on my setup and that also does not seem to work. here's the project.

here's my hardware details -

  • seeed xiao esp32s3
  • inmp 441 mems mic
  • max98357a amp for audio out

could you try to run this and mod it so it works?

@nischalj10
Copy link

I have tested the AEC algorithm of ESP before. CPU usage is less than 20% of a single core. Do you have any tests in this area.

hey @shenxiaozheng, is it possble to share your implementation, maybe i have missed something here?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants