mmWave Radar Aware Dual-Conditioned GAN for Speech Reconstruction of Signals With Low SNR

RAD-GAN comparisons on 4-second validation clips with clean references, noisy radar captures, and generated reconstructions.

Tip: If your browser blocks local media when opening via file://, serve this folder locally (e.g., python -m http.server) and open the shown URL.

Task 1

Direct diaphragm vibration capture.

Example 1 (2428-83705-0014)

Transcript (4 s clip)

"There she owns a cottage or it may be a pigsty for all I know"

Audio + Figures

Clean assets/ex1/clean.wav

Waveform (clean), Example 1 — Waveform (clean)

Mel spectrogram (clean), Example 1 — Mel spectrogram (clean)

Noisy assets/ex1/noisy.wav

Waveform (noisy), Example 1 — Waveform (noisy)

Mel spectrogram (noisy), Example 1 — Mel spectrogram (noisy)

RAD-GAN assets/ex1/enhanced.wav

Waveform (enhanced), Example 1 — Waveform (enhanced)

Mel spectrogram (enhanced), Example 1 — Mel spectrogram (enhanced)

Example 2 (116-288045-0005)

Transcript (4 s clip)

"Yes, he answered. I conduct the worship"

Audio + Figures

Clean assets/ex2/clean.wav

Waveform (clean), Example 2 — Waveform (clean)

Mel spectrogram (clean), Example 2 — Mel spectrogram (clean)

Noisy assets/ex2/noisy.wav

Waveform (noisy), Example 2 — Waveform (noisy)

Mel spectrogram (noisy), Example 2 — Mel spectrogram (noisy)

RAD-GAN assets/ex2/enhanced.wav

Waveform (enhanced), Example 2 — Waveform (enhanced)

Mel spectrogram (enhanced), Example 2 — Mel spectrogram (enhanced)

Task 2

Secondary surface vibration capture from aluminum foil near the speaker diaphragm.

Example 3 (2277-149896-0026)

Transcript (4 s clip)

"The long drizzle had begun. Pedestrians had turned up collars and trousers at the"

Audio + Figures

Clean assets/ex3/clean.wav

Waveform (clean), Example 3 — Waveform (clean)

Mel spectrogram (clean), Example 3 — Mel spectrogram (clean)

Noisy assets/ex3/noisy.wav

Waveform (noisy), Example 3 — Waveform (noisy)

Mel spectrogram (noisy), Example 3 — Mel spectrogram (noisy)

RAD-GAN assets/ex3/enhanced.wav

Waveform (enhanced), Example 3 — Waveform (enhanced)

Mel spectrogram (enhanced), Example 3 — Mel spectrogram (enhanced)

Example 4 (3000-15664-0003)

Transcript (4 s clip)

"Go quietly. Alone. No harm will befall you."

Audio + Figures

Clean assets/ex4/clean.wav

Waveform (clean), Example 4 — Waveform (clean)

Mel spectrogram (clean), Example 4 — Mel spectrogram (clean)

Noisy assets/ex4/noisy.wav

Waveform (noisy), Example 4 — Waveform (noisy)

Mel spectrogram (noisy), Example 4 — Mel spectrogram (noisy)

RAD-GAN assets/ex4/enhanced.wav

Waveform (enhanced), Example 4 — Waveform (enhanced)

Mel spectrogram (enhanced), Example 4 — Mel spectrogram (enhanced)