Can CLAP encode audio in languages other than English?

[suimuc]

I wish you could answer my question. Thank you very much.

[piyushsinghpasi]

Hii, I feel audios are mostly universal sounds (assuming you don't mean speech) and given a lot of data is collected from AudioCaps, it should work. Did you find any significant difference when encoding audio from different languages?

[lukewys]

I think CLAP is not explicitly trained on speech in other languages. As @piyushsinghpasi said, if you want to distinguish between speech as a sound vs. other sounds (e.g. dog barking), it could probably work. But if you want to transcribe speech or detect the language of the speech, I don't think CLAP is a good model for those tasks.