Bugsounet Coding

    • Register
    • Login
    • Search
    This Forum is now reserved to registred users!

    Unsolved Problems with speech recognition

    Issues
    2
    11
    92
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B
      Blane last edited by

      Hello bugsounet, first of all many thanks for your great work. Do you have any idea where the problem could be? The google assistant does not respond to any voice input. In the terminal output of gateway there is a warning from arecord(screenshot1) every second. As I understand it does not find the micro. So I started looking for the device name in your files and found the following entry in three files:

      /MagicMirror/modules/EXT-Detector/components/porcupine.js
      ./MagicMirror/modules/EXT-Detector/node_modules/@bugsounet/snowboy/index.js:
      ./MagicMirror/modules/EXT-Detector/node_modules/@bugsounet/snowboy/sample.js:

      device=“plughw:1”

      When I tried to start a recording with arecord --device =plughw:1 --format… I tried to start a recording and got an error. So I searched for my device name, it is “plughw:2,0”. At least I can start a recording with arecord --device =plughw:2,0 --format…(screenshot2) and record sound. After I have adjusted the entries in the three files (screenshot3), unfortunately the message still appears and the voice input still does not work. Maybe you have an idea what else it could be?Screenshot1.png
      Screenshot2.png Screenshot3.png

      1 Reply Last reply Reply Quote 0
      • bugsounet
        bugsounet Main Coder last edited by

        Hi,

        there is no micConfig to do
        why ?

        since last version of buster and now bulleyes, RPI os (like all linux debian compliant) use a program named pulseaudio
        this program is able to::

        • determinate what recorder is plugged (with device name)
        • record and use all recorder at the same time without comflit of take hand

        the device name is default

        You can discover it with arecord -L command

        default
            Playback/recording through the PulseAudio sound server
        

        After if you modify .asoundrc file , you break the configuration and it can’t works
        If you remove /disable or uninstall pulse audio server, it will not works too

        Finaly, I force this configuration (and you can’t change it)
        mic: { recorder: 'auto', device: 'default' }

        1 Reply Last reply Reply Quote 0
        • B
          Blane last edited by

          I had no intention of changing the micro configuration. The voice input did not work and then I came across the warning in the gateway terminal output. I just wonder why the voice input does not work. I have installed and configured everything according to your instructions. When I make a request to google via the gateway tools, it is answered and displayed on the mirror.

          1 Reply Last reply Reply Quote 0
          • bugsounet
            bugsounet Main Coder last edited by bugsounet

            first thing to verify is this:

            Gateway v3.0.1 (230316.fr) 
            
            pi@raspberrypi:~/MagicMirror $ ps aux | grep pulse
            pi         686  0.2  0.4 648580  8612 ?        S<sl Mar15   3:49 /usr/bin/pulseaudio --daemonize=no --log-target=journal
            pi        6775  0.0  0.0   4892   572 pts/0    S+   22:47   0:00 grep --color=auto pulse
            

            and this:

            pi@raspberrypi:~ $ arecord -L               
            null
                Discard all samples (playback) or generate zero samples (capture)
            default
                Playback/recording through the PulseAudio sound server
            lavrate
                Rate Converter Plugin Using Libav/FFmpeg Library
            samplerate
                Rate Converter Plugin Using Samplerate Library
            speexrate
                Rate Converter Plugin Using Speex Resampler
            jack
                JACK Audio Connection Kit
            ....
            

            and OS version:

            pi@raspberrypi:~ $ uname -a
            Linux raspberrypi 5.15.84-v7l+ #1613 SMP Thu Jan 5 12:01:26 GMT 2023 armv7l GNU/Linux
            
            pi@raspberrypi:~ $ cat /etc/os-release   
            PRETTY_NAME="Raspbian GNU/Linux 11 (bullseye)"
            NAME="Raspbian GNU/Linux"
            VERSION_ID="11"
            VERSION="11 (bullseye)"
            VERSION_CODENAME=bullseye
            ID=raspbian
            ID_LIKE=debian
            HOME_URL="http://www.raspbian.org/"
            SUPPORT_URL="http://www.raspbian.org/RaspbianForums"
            BUG_REPORT_URL="http://www.raspbian.org/RaspbianBugs"
            

            and verify if:

            .soundrc is NOT created

            pi@raspberrypi:~ $ cd ~
            pi@raspberrypi:~ $ cat .soundrc
            cat: .soundrc: No such file or directory
            
            1 Reply Last reply Reply Quote 0
            • B
              Blane last edited by

              Here are the outputs

              admin@raspberrypi:~/MagicMirror $ ps aux | grep pulse
              admin      721  0.0  0.4 920580  7928 ?        S<sl 15:58   0:16 /usr/bin/pulseaudio --daemonize=no --log-target=journal
              admin    13587  0.0  0.0   3536  1624 pts/0    S+   22:54   0:00 grep --color=auto pulse
              
              admin@raspberrypi:~ $ arecord -L
              null
                  Discard all samples (playback) or generate zero samples (capture)
              default
                  Playback/recording through the PulseAudio sound server
              lavrate
                  Rate Converter Plugin Using Libav/FFmpeg Library
              samplerate
                  Rate Converter Plugin Using Samplerate Library
              speexrate
                  Rate Converter Plugin Using Speex Resampler
              jack
                  JACK Audio Connection Kit
              oss
                  Open Sound System
              pulse
                  PulseAudio Sound Server
              upmix
                  Plugin for channel upmix (4,6,8)
              vdownmix
                  Plugin for channel downmix (stereo) with a simple spacialization
              usbstream:CARD=b1
                  bcm2835 HDMI 1
                  USB Stream Output
              usbstream:CARD=Headphones
                  bcm2835 Headphones
                  USB Stream Output
              hw:CARD=Device,DEV=0
                  USB PnP Sound Device, USB Audio
                  Direct hardware device without any conversions
              plughw:CARD=Device,DEV=0
                  USB PnP Sound Device, USB Audio
                  Hardware device with all software conversions
              sysdefault:CARD=Device
                  USB PnP Sound Device, USB Audio
                  Default Audio Device
              front:CARD=Device,DEV=0
                  USB PnP Sound Device, USB Audio
                  Front output / input
              dsnoop:CARD=Device,DEV=0
                  USB PnP Sound Device, USB Audio
                  Direct sample snooping device
              usbstream:CARD=Device
                  USB PnP Sound Device
                  USB Stream Output
              usbstream:CARD=UACDemoV10
                  UACDemoV1.0
                  USB Stream Output
              
              admin@raspberrypi:~ $ uname -a
              Linux raspberrypi 5.15.84-v7l+ #1613 SMP Thu Jan 5 12:01:26 GMT 2023 armv7l GNU/Linux
              
              admin@raspberrypi:~ $ cat /etc/os-release 
              PRETTY_NAME="Raspbian GNU/Linux 11 (bullseye)"
              NAME="Raspbian GNU/Linux"
              VERSION_ID="11"
              VERSION="11 (bullseye)"
              VERSION_CODENAME=bullseye
              ID=raspbian
              ID_LIKE=debian
              HOME_URL="http://www.raspbian.org/"
              SUPPORT_URL="http://www.raspbian.org/RaspbianForums"
              BUG_REPORT_URL="http://www.raspbian.org/RaspbianBugs"
              
              admin@raspberrypi:~ $ cat .soundrc
              cat: .soundrc: No such file or directory
              
              1 Reply Last reply Reply Quote 0
              • bugsounet
                bugsounet Main Coder last edited by

                ok perfect !

                Can you retry with this:

                pi@raspberrypi:~ $ cd ~ && cat .asoundrc 
                cat: .asoundrc: No such file or directory
                

                sorry

                1 Reply Last reply Reply Quote 0
                • bugsounet
                  bugsounet Main Coder last edited by

                  After, I think to this:

                  Maybe you use another process or module in MagicMirror that uses your microphone with old protocol.
                  In this case, your micro phone will be not available

                  You can try this:

                  • turn off MagicMirror app
                  • open a terminal and try this:
                  arecord -D default -q -r 16000 -c 1 -t wav -f S16_LE -d 3 test.wav && aplay test.wav
                  

                  it will use pulse audio for opening the mic, record 3 seconds and play test.wav file

                  tell me if any error ?

                  If error can give me the result of this:

                  pi@raspberrypi:~ $ ps aux | grep record
                  
                  1 Reply Last reply Reply Quote 0
                  • B
                    Blane last edited by

                    Thank you very much for your support, unfortunately I can’t work on the mirror again until Monday. I will try and post the outputs on Monday

                    1 Reply Last reply Reply Quote 0
                    • B
                      Blane last edited by

                      Hello bugsounet, tried what you wrote, the file .asoundrc does not exist and the recording started and played back without error.

                      cd ~ && cat .asoundrc 
                      cat: .asoundrc: No such file or directory
                      
                      admin@raspberrypi:~ $ arecord -D default -q -r 16000 -c 1 -t wav -f S16_LE -d 3 test.wav && aplay test.wav
                      Wiedergabe: WAVE 'test.wav' : Signed 16 bit Little Endian, Rate: 16000 Hz, mono
                      
                      
                      admin@raspberrypi:~ $ ps aux | grep record
                      admin     3575  0.0  0.0   3536  1552 pts/0    S+   12:53   0:00 grep --color=auto record
                      
                      
                      1 Reply Last reply Reply Quote 0
                      • bugsounet
                        bugsounet Main Coder last edited by

                        Hi,

                        For me it’s good.

                        So, Can you try to disable all modules in your config except:

                        • MMM-GoogleAssistant
                        • EXT-Detector
                        • Gateway
                        • EXT-Alert

                        and retry ?

                        1 Reply Last reply Reply Quote 0
                        • B
                          Blane last edited by

                          Hello bugsounet, unfortunately, nothing has changed. The file is still not present and the recording worked and was played back. After deactivating the modules, the MagicMirror just stays black and I can no longer reach the gateway

                          admin@raspberrypi:~ $ cd ~ && cat .asoundrc 
                          cat: .asoundrc: No such file or directory
                          
                          admin@raspberrypi:~ $ arecord -D default -q -r 16000 -c 1 -t wav -f S16_LE -d 3 test.wav && aplay test.wav
                          Wiedergabe: WAVE 'test.wav' : Signed 16 bit Little Endian, Rate: 16000 Hz, mono
                          
                          
                          admin@raspberrypi:~ $ ps aux | grep record
                          admin     2602  0.0  0.0   3536  1660 pts/0    S+   23:48   0:00 grep --color=auto record
                          
                          
                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post
                          Powered by NodeBB | @bugsounet ©2022