rhasspy/docs/audio-input.md

Audio Input

Rhasspy can listen to audio input from a local microphone or from a remote audio stream. Most of the local audio testing has been done with a USB PlayStation Eye camera.

PyAudio

Streams microphone data from a PyAudio device. This is the default audio input system, and should work with both ALSA and PulseAudio.

Add to your profile:

"microphone": {
  "system": "pyaudio",
  "pyaudio": {
    "device": "",
    "frames_per_buffer": 480
  }
}

Set microphone.pyaudio.device to a PyAudio device number or leave blank for the default device. Streams 30ms chunks of 16-bit, 16 Khz mono audio by default (480 frames).

See rhasspy.audio_recorder.PyAudioRecorder for details.

ALSA

Starts an arecord process locally and reads audio data from its standard out. Works best with ALSA.

Add to your profile:

"microphone": {
  "system": "arecord",
  "arecord": {
    "device": "",
    "chunk_size": 960
  }
}

Set microphone.arecord.device to the name of the ALSA device to use (-D flag to arecord) or leave blank for the default device. By default, calls arecord -t raw -r 16000 -f S16_LE -c 1 and reads 30ms (960 bytes) of audio data at a time.

See rhasspy.audio_recorder.ARecordAudioRecorder for details.

MQTT/Hermes

Listens to the hermes/audioServer/<SITE_ID>/audioFrame topic for WAV data (Hermes protocol). This allows Rhasspy to receive audio from Snips.AI. Audio data is automatically converted to 16-bit, 16Khz mono with sox.

Add to your profile:

"microphone": {
  "system": "hermes"
},

"mqtt": {
  "enabled": true,
  "host": "localhost",
  "username": "",
  "port": 1883,
  "password": "",
  "site_id": "default"
}

Adjust the mqtt configuration to connect to your MQTT broker. Set mqtt.site_id to match your Snips.AI siteId.

See rhasspy.audio_recorder.HermesAudioRecorder for details.

Dummy

Disables microphone recording.

Add to your profile:

"microphone": {
  "system": "dummy"
}

See rhasspy.audio_recorder.DummyAudioRecorder for details.