Unsolved MMM-GoogleAssistant not responding to "jarvis"
-
Hi, Ive had my bugsounet GoogleAssitant work before but after moving around my mirror it seems that it no longer works when I call it. I’m using a USB microphone and have tried each port and called it but to no response. I’ve tested my mic and created a new .arsound file in home/pi. I also changed from MMM-Detector to the new EXT-Detector as listed on the bugusonet wiki. I also downloaded and added the config for the EXT-Gateway module. Here is what my console displays
{ module: "MMM-GoogleAssistant", position: "top_right", configDeepMerge: true, config: { debug:false, assistantConfig: { lang: "en-CA", latitude: 43.656243, longitude: -79.801591, }, responseConfig: { useFullscreen: true, useResponseOutput: true, responseOutputCSS: "response_output.css", screenOutputTimer: 5000, activateDelay: 250, useAudioOutput: true, useChime: true, confirmationChime: true, useInformations: true }, micConfig: {}, Extented: { Welcome: { useWelcome: true, Welcome: "Hello, sir", }, useEXT: true, volume: { useVolume: true, }, }, recipes: ["with-BackgroundStatus.js", "Reboot-Restart-Shutdown.js"], NPMCheck: {} }, }, { module: "MMM-Detector", position: "top_left", configDeepMerge: true, config: { debug: true, autoStart: true, useLogos: true, micConfig: { recorder: "arecord", device: "default", // only for snowboy: audioGain: 2.0, applyFrontend: true // When you use only `snowboy` and `smart_mirror`, `false` is better. But with other models, `true` is better. }, newLogos: { default: "default.png" }, detectors: [ { detector: "Snowboy", Model: "jarvis", Sensitivity: null, Logo: "google", autoRestart: false, onDetected: { notification: "GA_ACTIVATE" } }, { detector: "Porcupine", Model: "Hey jarvis", Sensitivity: null, Logo: "google", autoRestart: false, onDetected: { notification: "GA_ACTIVATE" } }, { detector: "Porcupine", Model: "hey google", Sensitivity: null, Logo: "google", autoRestart: false, onDetected: { notification: "GA_ACTIVATE" } } ], NPMCheck: { useChecker: true, delay: 10 * 60 * 1000, useAlert: true } } }, { module: 'Gateway', config: { debug: false, port: 8081, username: "admin", password: "admin", noLogin: false, usePM2: false, PM2Id: 0, useMapping: false, portMapping: 8081 } },
Config.js
I also see a error for GABackground not loading and the Github link for it is no longer there, is there a new module for the background? thanks in advance community!
-
Hi, better way is actually reading wiki because it don’t really know what do you search to do with your config
Actually, You have a Mix with GA v3 and GA v4 and it can’t works
-
@bugsounet is the GA background the issue? if so how can i get the new one?
-
It’s on wiki page
-
@bugsounet Hi, ive updated and fix my errors but i seem to be having a issue with the new EXT module
[19.07.2022 17:43.16.101] [ERROR] [GATEWAY] node-pty Loading error! Error: Cannot find module '../build/Release/pty.node'
any idea?
-
Hi, this is not related to the current topic.
This will not prevent Gateway from working and doing its job GoogleAssistant <-> Gateway <-> EXTs plugins
Your error only impacts the Gateway application (it runs independently of magicmirror) -
@bugsounet so what can be the issue with Google Assitant? It said the token expired so i created a new one and it still wont reply to jarvis
-
Can you past all logs from start?
-
@bugsounet ```
[20.07.2022 15:25.18.131] [LOG] Starting MagicMirror: v2.20.0
[20.07.2022 15:25.18.140] [LOG] Loading config …
[20.07.2022 15:25.18.147] [LOG] Loading module helpers …
[20.07.2022 15:25.18.150] [LOG] No helper found for module: clock.
[20.07.2022 15:25.18.152] [LOG] No helper found for module: weather.
[20.07.2022 15:25.18.563] [LOG] Initializing new module helper …
[20.07.2022 15:25.18.564] [LOG] Module helper loaded: MMM-Screencast
[20.07.2022 15:25.18.783] [LOG] Initializing new module helper …
[20.07.2022 15:25.18.785] [LOG] Module helper loaded: MMM-Remote-Control
[20.07.2022 15:25.18.999] [LOG] Initializing new module helper …
[20.07.2022 15:25.19.000] [LOG] Module helper loaded: calendar
[20.07.2022 15:25.19.336] [LOG] Initializing new module helper …
[20.07.2022 15:25.19.338] [LOG] Check MagicMirror² version for node helper ‘MMM-CoinMarketCap’ - Minimum version: 2.2.1 - Current version: 2.20.0
[20.07.2022 15:25.19.339] [LOG] Version is ok!
[20.07.2022 15:25.19.339] [LOG] Module helper loaded: MMM-CoinMarketCap
[20.07.2022 15:25.19.764] [LOG] Initializing new module helper …
[20.07.2022 15:25.19.765] [LOG] Module helper loaded: MMM-GoogleAssistant
[20.07.2022 15:25.19.766] [LOG] No helper found for module: MMM-Detector.
[20.07.2022 15:25.19.768] [LOG] Initializing new module helper …
[20.07.2022 15:25.19.769] [LOG] Module helper loaded: EXT-Background
[20.07.2022 15:25.20.012] [LOG] Initializing new module helper …
[20.07.2022 15:25.20.013] [LOG] Module helper loaded: Gateway
[20.07.2022 15:25.20.370] [LOG] Initializing new module helper …
[20.07.2022 15:25.20.371] [LOG] Module helper loaded: MMM-NowPlayingOnSpotify
[20.07.2022 15:25.20.371] [LOG] All module helpers loaded.
[20.07.2022 15:25.20.379] [LOG] Starting server on port 8080 …
[20.07.2022 15:25.20.393] [LOG] Server started …
[20.07.2022 15:25.20.394] [LOG] Connecting socket for: MMM-Screencast
[20.07.2022 15:25.20.396] [LOG] Connecting socket for: MMM-Remote-Control
[20.07.2022 15:25.20.396] [LOG] Starting node helper for: MMM-Remote-Control
[20.07.2022 15:25.20.403] [LOG] Connecting socket for: calendar
[20.07.2022 15:25.20.403] [LOG] Starting node helper for: calendar
[20.07.2022 15:25.20.404] [LOG] Connecting socket for: MMM-CoinMarketCap
[20.07.2022 15:25.20.405] [LOG] MMM-CoinMarketCap: module loaded! Path: /home/pi/MagicMirror/modules/MMM-CoinMarketCap
[20.07.2022 15:25.20.405] [LOG] MMM-CoinMarketCap: Path “/logos” configured successfully.
[20.07.2022 15:25.20.407] [LOG] Connecting socket for: MMM-GoogleAssistant
[20.07.2022 15:25.20.407] [LOG] [GA] Read config.js and check ConfigDeepMerge…
[20.07.2022 15:25.20.408] [LOG] [GA] Perfect ConfigDeepMerge activated!
[20.07.2022 15:25.20.409] [LOG] Connecting socket for: EXT-Background
[20.07.2022 15:25.20.410] [LOG] Starting module helper: EXT-Background
[20.07.2022 15:25.20.410] [LOG] Connecting socket for: Gateway
[20.07.2022 15:25.20.411] [LOG] Connecting socket for: MMM-NowPlayingOnSpotify
[20.07.2022 15:25.20.412] [LOG] Sockets connected & modules started …
[20.07.2022 15:25.20.757] [LOG] Launching application.
MESA-LOADER: failed to retrieve device information
MESA-LOADER: failed to retrieve device information
MESA-LOADER: failed to retrieve device information
MESA-LOADER: failed to open kms_swrast (search paths /usr/lib/arm-linux-gnueabihf/dri:$${ORIGIN}/dri:/usr/lib/dri)
failed to load driver: kms_swrast
MESA-LOADER: failed to open swrast (search paths /usr/lib/arm-linux-gnueabihf/dri:$${ORIGIN}/dri:/usr/lib/dri)
failed to load swrast driver
[20.07.2022 15:25.24.642] [LOG] [GA] MMM-GoogleAssistant Version: 4.0.5 rev: 220702
[20.07.2022 15:25.24.645] [LOG] [GA] Platform: ‘raspberry-pi’; attempting to use ‘arecord’ to access microphone …
[20.07.2022 15:25.24.647] [LOG] [GA] RECIPE_LOADED: Reboot-Restart-Shutdown.js
[20.07.2022 15:25.24.649] [LOG] [GA] Google Assistant is initialized.
[20.07.2022 15:25.24.653] [LOG] [BACKGROUND] EXT-Background Version: 1.0.2 rev: 220410
[20.07.2022 15:25.24.655] [LOG] [GATEWAY] Gateway Version: 2.1.6 rev: 220711
[20.07.2022 15:25.24.678] [ERROR] (node:2187) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
(Useelectron --trace-deprecation ...
to show where the warning was created)
[20.07.2022 15:25.25.320] [LOG] [GATEWAY] Start app…
[20.07.2022 15:25.25.322] [WARN] [GATEWAY] WARN: You are using default username or default password
[20.07.2022 15:25.25.323] [WARN] [GATEWAY] WARN: Don’t forget to change it!
[20.07.2022 15:25.26.238] [LOG] [HyperWatch] Logger is enabled
[20.07.2022 15:25.26.241] [LOG] [GATEWAY] Start listening on http://10.0.0.216:8081
[20.07.2022 15:25.26.343] [ERROR] (node:2187) [DEP0066] DeprecationWarning: OutgoingMessage.prototype._headers is deprecated
[20.07.2022 15:25.26.462] [LOG] Refreshed access token because it has expired. Expired at: 15:25:24 now is: 15:25:26
[20.07.2022 15:25.26.558] [LOG] Refreshed access token because it has expired. Expired at: 16:25:26 now is: 15:25:26
[20.07.2022 15:25.26.605] [LOG] Refreshed access token because it has expired. Expired at: 16:25:26 now is: 15:25:26
[20.07.2022 15:25.27.837] [INFO] Calendar-Fetcher: Broadcasting 10 events. -
why this:
[20.07.2022 15:25.19.766] [LOG] No helper found for module: MMM-Detector.
-
i removed it from the config, here is the new log
[20.07.2022 22:30.54.377] [LOG] [DETECTOR] EXT-Detector Version: 1.0.1 rev: 220315 [20.07.2022 22:30.54.378] [LOG] Connecting socket for: MMM-NowPlayingOnSpotify [20.07.2022 22:30.54.378] [LOG] Sockets connected & modules started ... [20.07.2022 22:30.54.725] [LOG] Launching application. MESA-LOADER: failed to retrieve device information MESA-LOADER: failed to retrieve device information MESA-LOADER: failed to retrieve device information MESA-LOADER: failed to open kms_swrast (search paths /usr/lib/arm-linux-gnueabihf/dri:\$${ORIGIN}/dri:/usr/lib/dri) failed to load driver: kms_swrast MESA-LOADER: failed to open swrast (search paths /usr/lib/arm-linux-gnueabihf/dri:\$${ORIGIN}/dri:/usr/lib/dri) failed to load swrast driver [20.07.2022 22:30.58.354] [LOG] Create new calendarfetcher for url: https://calendar.google.com/calendar/ical/pokemonarhum%40gmail.com/private-506ce9eaf8a4e7f045bbb101c4779689/basic.ics - Interval: 300000 [20.07.2022 22:30.58.488] [ERROR] (node:5968) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead. (Use `electron --trace-deprecation ...` to show where the warning was created) [20.07.2022 22:30.59.042] [LOG] [DETECTOR] All needed @bugsounet library loaded ! [20.07.2022 22:30.59.044] [LOG] [DETECTOR] Platform: 'raspberry-pi'; attempting to use 'arecord' to access microphone ... [20.07.2022 22:30.59.059] [LOG] [DETECTOR] Porcupine is initialized with 2 Models: ok google,hey google [20.07.2022 22:30.59.063] [LOG] [DETECTOR] Snowboy is initialized with 1 Models: jarvis [20.07.2022 22:30.59.115] [LOG] [GA] MMM-GoogleAssistant Version: 4.0.5 rev: 220702 [20.07.2022 22:30.59.118] [LOG] [GA] Platform: 'raspberry-pi'; attempting to use 'arecord' to access microphone ... [20.07.2022 22:30.59.122] [LOG] [GA] RECIPE_LOADED: Reboot-Restart-Shutdown.js [20.07.2022 22:30.59.123] [LOG] [GA] Google Assistant is initialized. [20.07.2022 22:30.59.195] [ERROR] (node:5968) [DEP0066] DeprecationWarning: OutgoingMessage.prototype._headers is deprecated [20.07.2022 22:30.59.353] [LOG] Refreshed access token because it has expired. Expired at: 22:30:58 now is: 22:30:59 [20.07.2022 22:30.59.402] [LOG] Refreshed access token because it has expired. Expired at: 23:30:59 now is: 22:30:59 [20.07.2022 22:31.00.787] [INFO] Calendar-Fetcher: Broadcasting 10 events.
-
Can i have logs from start again ? thx
-
@bugsounet ```
magicmirror@2.20.0 start /home/pi/MagicMirror
DISPLAY=“${DISPLAY:=:0}” ./node_modules/.bin/electron js/electron.js[21.07.2022 11:05.42.684] [LOG] Starting MagicMirror: v2.20.0
[21.07.2022 11:05.42.693] [LOG] Loading config …
[21.07.2022 11:05.42.700] [LOG] Loading module helpers …
[21.07.2022 11:05.42.703] [LOG] No helper found for module: clock.
[21.07.2022 11:05.42.705] [LOG] No helper found for module: weather.
[21.07.2022 11:05.43.047] [LOG] Initializing new module helper …
[21.07.2022 11:05.43.048] [LOG] Module helper loaded: MMM-Screencast
[21.07.2022 11:05.43.270] [LOG] Initializing new module helper …
[21.07.2022 11:05.43.271] [LOG] Module helper loaded: MMM-Remote-Control
[21.07.2022 11:05.43.474] [LOG] Initializing new module helper …
[21.07.2022 11:05.43.475] [LOG] Module helper loaded: calendar
[21.07.2022 11:05.43.806] [LOG] Initializing new module helper …
[21.07.2022 11:05.43.808] [LOG] Check MagicMirror² version for node helper ‘MMM-CoinMarketCap’ - Minimum version: 2.2.1 - Current version: 2.20.0
[21.07.2022 11:05.43.809] [LOG] Version is ok!
[21.07.2022 11:05.43.810] [LOG] Module helper loaded: MMM-CoinMarketCap
[21.07.2022 11:05.44.232] [LOG] Initializing new module helper …
[21.07.2022 11:05.44.233] [LOG] Module helper loaded: MMM-GoogleAssistant
[21.07.2022 11:05.44.236] [LOG] Initializing new module helper …
[21.07.2022 11:05.44.237] [LOG] Module helper loaded: EXT-Detector
[21.07.2022 11:05.44.610] [LOG] Initializing new module helper …
[21.07.2022 11:05.44.610] [LOG] Module helper loaded: MMM-NowPlayingOnSpotify
[21.07.2022 11:05.44.611] [LOG] All module helpers loaded.
[21.07.2022 11:05.44.716] [LOG] Starting server on port 8080 …
[21.07.2022 11:05.44.727] [LOG] Server started …
[21.07.2022 11:05.44.728] [LOG] Connecting socket for: MMM-Screencast
[21.07.2022 11:05.44.730] [LOG] Connecting socket for: MMM-Remote-Control
[21.07.2022 11:05.44.731] [LOG] Starting node helper for: MMM-Remote-Control
[21.07.2022 11:05.44.739] [LOG] Connecting socket for: calendar
[21.07.2022 11:05.44.740] [LOG] Starting node helper for: calendar
[21.07.2022 11:05.44.740] [LOG] Connecting socket for: MMM-CoinMarketCap
[21.07.2022 11:05.44.741] [LOG] MMM-CoinMarketCap: module loaded! Path: /home/pi/MagicMirror/modules/MMM-CoinMarketCap
[21.07.2022 11:05.44.742] [LOG] MMM-CoinMarketCap: Path “/logos” configured successfully.
[21.07.2022 11:05.44.742] [LOG] Connecting socket for: MMM-GoogleAssistant
[21.07.2022 11:05.44.744] [LOG] [GA] Read config.js and check ConfigDeepMerge…
[21.07.2022 11:05.44.744] [LOG] [GA] Perfect ConfigDeepMerge activated!
[21.07.2022 11:05.44.746] [LOG] Connecting socket for: EXT-Detector
[21.07.2022 11:05.44.747] [LOG] [DETECTOR] EXT-Detector Version: 1.0.1 rev: 220315
[21.07.2022 11:05.44.748] [LOG] Connecting socket for: MMM-NowPlayingOnSpotify
[21.07.2022 11:05.44.749] [LOG] Sockets connected & modules started …
[21.07.2022 11:05.45.147] [LOG] Launching application.
MESA-LOADER: failed to retrieve device information
MESA-LOADER: failed to retrieve device information
MESA-LOADER: failed to retrieve device information
MESA-LOADER: failed to open kms_swrast (search paths /usr/lib/arm-linux-gnueabihf/dri:$${ORIGIN}/dri:/usr/lib/dri)
failed to load driver: kms_swrast
MESA-LOADER: failed to open swrast (search paths /usr/lib/arm-linux-gnueabihf/dri:$${ORIGIN}/dri:/usr/lib/dri)
failed to load swrast driver
[21.07.2022 11:05.48.739] [LOG] [GA] MMM-GoogleAssistant Version: 4.0.5 rev: 220702
[21.07.2022 11:05.48.741] [LOG] [GA] Platform: ‘raspberry-pi’; attempting to use ‘arecord’ to access microphone …
[21.07.2022 11:05.48.745] [LOG] [GA] RECIPE_LOADED: Reboot-Restart-Shutdown.js
[21.07.2022 11:05.48.746] [LOG] [GA] Google Assistant is initialized.
[21.07.2022 11:05.48.748] [ERROR] (node:1547) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
(Useelectron --trace-deprecation ...
to show where the warning was created)
[21.07.2022 11:05.49.290] [LOG] [DETECTOR] All needed @bugsounet library loaded !
[21.07.2022 11:05.49.292] [LOG] [DETECTOR] Platform: ‘raspberry-pi’; attempting to use ‘arecord’ to access microphone …
[21.07.2022 11:05.49.306] [LOG] [DETECTOR] Porcupine is initialized with 2 Models: ok google,hey google
[21.07.2022 11:05.49.310] [LOG] [DETECTOR] Snowboy is initialized with 1 Models: jarvis
[21.07.2022 11:05.49.538] [LOG] Refreshed access token because it has expired. Expired at: 11:05:48 now is: 11:05:49
[21.07.2022 11:05.49.612] [LOG] Refreshed access token because it has expired. Expired at: 12:05:49 now is: 11:05:49
[21.07.2022 11:05.50.763] [INFO] Calendar-Fetcher: Broadcasting 10 events.
[21.07.2022 11:06.13.824] [ERROR] (node:1547) [DEP0066] DeprecationWarning: OutgoingMessage.prototype._headers is deprecated -
humm … where is
Gateway
? -
@bugsounet Gateway is in my modules folder, do EXT-Detector need to be in the gateway folder of just that modules folder?
module: "MMM-GoogleAssistant", position: "top_right", configDeepMerge: true, config: { debug:true, assistantConfig: { lang: "en-CA", latitude: 43.656243, longitude: -79.801591, }, responseConfig: { useFullscreen: true, useResponseOutput: true, responseOutputCSS: "response_output.css", screenOutputTimer: 5000, activateDelay: 250, useAudioOutput: true, useChime: true, confirmationChime: true, useInformations: true }, micConfig: {}, Extented: { Welcome: { useWelcome: true, Welcome: "Hello, sir", }, useEXT: true, volume: { useVolume: true, }, }, recipes: ["Reboot-Restart-Shutdown.js"], NPMCheck: {} }, }, { module: "EXT-Detector", position: "top_left", configDeepMerge: true, config: { debug: false, useIcon: true, touchOnly: false, detectors: [ { detector: "Snowboy", Model: "jarvis", Sensitivity: null }, { detector: "Porcupine", Model: "ok google", Sensitivity: null }, { detector: "Porcupine", Model: "hey google", Sensitivity: null } ] } },
here is my config
-
Humm, if you don’t any effort … It will be very complex…
I says:
@bugsounet said in MMM-GoogleAssistant not responding to "jarvis":Hi, better way is actually reading wiki because it don’t really know what do you search to do with your config
Actually, You have a Mix with GA v3 and GA v4 and it can’t works
I says to you to Read wiki
It’s on wiki page
You have respond to me “it’s ok… I have updated”
@bugsounet Hi, ive updated and fix my errors…
That I see, You have done nothing…
{ module: "MMM-GoogleAssistant", configDeepMerge: true, config: { assistantConfig: { lang: "en-CA", latitude: 43.656243, longitude: -79.801591, }, recipes: ["Reboot-Restart-Shutdown.js"], }, },
No other things is required for GA
Now read wiki and install / configure
Gateway
I can’t do all for you
Gateway is a commander for all Plugins used and without it EXT-Detector will not works -
@bugsounet Hi bugsounet, i think i have it all up and running, added the new GA config, and added the gateway config but now my console is saying that the microphone is busy. Have you see this issue before?
[23.07.2022 02:07.59.042] [LOG] [LPCM16] WARN: arecord: main:828: audio open error: Device or resource busy [23.07.2022 02:07.59.359] [LOG] Refreshed access token because it has expired. Expired at: 02:07:56 now is: 02:07:59 [23.07.2022 02:07.59.370] [LOG] Refreshed access token because it has expired. Expired at: 03:07:59 now is: 02:07:59 [23.07.2022 02:07.59.380] [LOG] Refreshed access token because it has expired. Expired at: 03:07:59 now is: 02:07:59 [23.07.2022 02:07.59.398] [LOG] Refreshed access token because it has expired. Expired at: 03:07:59 now is: 02:07:59 [23.07.2022 02:08.00.452] [INFO] Calendar-Fetcher: Broadcasting 10 events. [23.07.2022 02:08.01.635] [LOG] [LPCM16] WARN: arecord: main:828: audio open error: Device or resource busy [23.07.2022 02:08.03.833] [LOG] [LPCM16] WARN: arecord: main:828: audio open error: Device or resource busy [23.07.2022 02:08.05.945] [LOG] [LPCM16] WARN: arecord: main:828: audio open error: Device or resource busy [2264:0723/020806.106632:ERROR:gl_surface_presentation_helper.cc(260)] GetVSyncParametersIfAvailable() failed for 1 times! [23.07.2022 02:08.08.030] [LOG] [LPCM16] WARN: arecord: main:828: audio open error: Device or resource busy [23.07.2022 02:08.10.162] [LOG] [LPCM16] WARN: arecord: main:828: [23.07.2022 02:08.10.163] [LOG] [LPCM16] WARN: audio open error: Device or resource busy