Assistant not returning photos or links

[kaj]

I can use the assistant to tell me the weather, and the bottom of the screen gives a result from weather.com, but no other command gives a visual return. In my G photos account I have facial recognition, so in V2 I could simply ask my mirror to show images of “name” (one of my sons or other family member) and it would just work without any other album specification in config.js.

BTW thank you for your huge effort

{
  module: "MMM-GoogleAssistant",
  position: "top_left",
  configDeepMerge: true,
  config: {
    debug: false,
    assistantConfig: {
  lang: "en-US",
  latitude: 69.xxxxxx,
  longitude: 18.xxxxxx
},
    micConfig: {
	recorder: "arecord",
  	device: "default"
},
    Extented: {
      useEXT: true,
      youtube: {
	useYoutube: true
},
      links: {
useLinks: true,
  displayDelay: 60 * 1000,
  scrollActivate: true,
  scrollStep: 25,
  scrollInterval: 1000,
  scrollStart: 5000
},
      photos: {
usePhotos: true,
  useGooglePhotosAPI: false,
  displayType: "Module",
  displayDelay: 10 * 1000,
  sort: "new",
  hiResolution: true,
  timeFormat: "DD/MM/YYYY HH:mm",
  moduleHeight: 300,
  moduleWidth: 300,
},
      volume: {
useVolume: true,
},
          cast: {
 useCast: true,
},
      spotify: {
        useSpotify: true,
        visual: {
updateInterval: 1000,
  idleInterval: 10000,
  useBottomBar: false,
  CLIENT_ID: "xxxxxx",
  CLIENT_SECRET: "xxxxxx",
},
        player: {
type: "Raspotify",
  email: "xxxxxx",
  password: "xxxxxx",
  minVolume: 10,
  maxVolume: 90,
  usePause: true
}
      },
    },
    recipes: ["ExtSpotify.js", "ExtGPhotos.js"],
    NPMCheck: {
useChecker: true,
  delay: 10 * 60 * 1000,
  useAlert: true
}
  }
},

{
    module: 'MMM-PostDelivery-Norway',
    position: 'top_left',
    config: {
        zipCode: xxxx
    }
 },
{
  module: "MMM-Detector",
  position: "top_left",
  configDeepMerge: true,
  config: {
    debug: false,
    autoStart: true,
    useLogos: true,
    micConfig: {
      recorder: "auto",
      device: "default",
      // only for snowboy:
      audioGain: 2.0,
      applyFrontend: false // When you use only `snowboy` and `smart_mirror`, `false` is better. But with other models, `true` is better.
    },
    newLogos: {
      default: "default.png"
    },
    detectors: [
      {
        detector: "Snowboy",
        Model: "jarvis",
        Sensitivity: null,
        Logo: "google",
        autoRestart: false,
        onDetected: {
          notification: "GA_ACTIVATE"
        }
      },
          ],
    NPMCheck: {
      useChecker: true,
      delay: 10 * 60 * 1000,
      useAlert: true
    }
  }
}
]
};

Edit: plz use tag code icon </>

[bugsounet]

Hi, configuration is good, but maybe you have missed this part

v3 engin is based from V2 (i don’t really touch it)

After, if google Server don’t send any link i can’t use it

[kaj]

This part?

• For more information how you can configurate this file
   * See https://github.com/MichMich/MagicMirror#configuration
   *
   */

var config = {
  address: "localhost",
  electronOptions: {
    webPreferences: {
      webviewTag: true
    }
  },
  port: 8080,
    ipWhitelist: ["127.0.0.1", "::ffff:127.0.0.1", "::1"], // Set [] to allow all IP addresses
                                                           // or add a specific IPv4 of 192.168.1.5 :
                                                           // ["127.0.0.1", "::ffff:127.0.0.1", "::1", "::ffff:192.168.1.5"],
                                                           // or IPv4 range of 192.168.3.0 --> 192.168.3.15 use CIDR format :
                                                           // ["127.0.0.1", "::ffff:127.0.0.1", "::1", "::ffff:192.168.3.0/28"],

    language: "nb",
    timeFormat: 24,
    units: "metric",

    modules: [

[kaj]

Forgot to mention that youtube casting doesn’t work. Won’t show up as a recieving device from my (android) app. Thinking all this is related. I have accuired all the tokens; tokenGA.json, tokenGP.json, tokenSpotify.json and tokenYT.json.

[bugsounet]

don’t know really

can you give me any log (with debug mode) plz ?

[CalcU]

maybe is not working because you didn’t tell him any album to download ?

			photos: {
				usePhotos: true,
				useGooglePhotosAPI: true,
				displayType: "Background",
				displayDelay: 600 * 1000,     // minimum 10 seconds. 1800000 = 30 minutos
				albums: ["Fotos para Google home"],   <-------------- this one
				sort: "random", // "old", "random"
				hiResolution: true,
				timeFormat: "DD/MM/YYYY HH:mm",
				moduleHeight: 1920,
				moduleWidth: 1080,
			},

or the api part

[kaj]

This post is deleted!

[kaj]

(reposted to remove personal information)
1: youtube cast doesn’t work. It’s just not an option when I search for devices in the app.
2: Ok, Photos. I just got this part to work. Enable the API in my google console. I didn’t realise that this is just a slideshow. I don’t want to open just pre-defined albums. As I said, in v2 I could just ask for google to show me pictures of family members. Google understood to open photos (in fullscreeen) based on Googles facial recognition software. It seems I want ‘’‘js usePhotos: false ‘’’ So what I want still doesn’t work.
3: Links. Same. I ask for something to be shown on screen. It doesn’t (my apologies for some of the text being in norwegian)

pi@raspberrypi:~/MagicMirror $ npm start

magicmirror@2.15.0 start /home/pi/MagicMirror
electron js/electron.js

[27.06.2021 22:14.36.905] [LOG] Starting MagicMirror: v2.15.0
[27.06.2021 22:14.36.910] [LOG] Loading config …
[27.06.2021 22:14.36.918] [LOG] Loading module helpers …
[27.06.2021 22:14.36.921] [LOG] No helper found for module: alert.
[27.06.2021 22:14.37.493] [LOG] Initializing new module helper …
[27.06.2021 22:14.37.494] [LOG] Module helper loaded: MMM-UpdateNotification
[27.06.2021 22:14.37.495] [LOG] No helper found for module: clock.
[27.06.2021 22:14.38.023] [LOG] Initializing new module helper …
[27.06.2021 22:14.38.024] [LOG] Module helper loaded: calendar
[27.06.2021 22:14.38.028] [LOG] Initializing new module helper …
[27.06.2021 22:14.38.029] [LOG] Module helper loaded: MMM-Entur-tavle
[27.06.2021 22:14.38.089] [LOG] Initializing new module helper …
[27.06.2021 22:14.38.092] [LOG] Module helper loaded: MMM-YrThen
[27.06.2021 22:14.38.151] [LOG] Initializing new module helper …
[27.06.2021 22:14.38.152] [LOG] Module helper loaded: newsfeed
[27.06.2021 22:14.40.232] [LOG] Initializing new module helper …
[27.06.2021 22:14.40.233] [LOG] Module helper loaded: MMM-GoogleAssistant
[27.06.2021 22:14.40.236] [LOG] Initializing new module helper …
[27.06.2021 22:14.40.236] [LOG] Module helper loaded: MMM-PostDelivery-Norway
[27.06.2021 22:14.40.240] [LOG] Initializing new module helper …
[27.06.2021 22:14.40.240] [LOG] Module helper loaded: MMM-Detector
[27.06.2021 22:14.40.241] [LOG] All module helpers loaded.
[27.06.2021 22:14.40.332] [LOG] Starting server on port 8080 …
[27.06.2021 22:14.40.343] [LOG] Server started …
[27.06.2021 22:14.40.344] [LOG] Connecting socket for: MMM-UpdateNotification
[27.06.2021 22:14.40.347] [LOG] [UN] MMM-UpdateNotification Version: 1.2.5
[27.06.2021 22:14.40.348] [LOG] [UN] MagicMirror is running on pid: 7463
[27.06.2021 22:14.40.349] [LOG] Connecting socket for: calendar
[27.06.2021 22:14.40.350] [LOG] Starting node helper for: calendar
[27.06.2021 22:14.40.351] [LOG] Connecting socket for: MMM-Entur-tavle
[27.06.2021 22:14.40.353] [LOG] Starting node helper for: MMM-Entur-tavle
[27.06.2021 22:14.40.354] [LOG] Connecting socket for: MMM-YrThen
[27.06.2021 22:14.40.355] [LOG] MMM-YrThen 27.6.2021 22:14:40: Starting helper for MMM-YrThen
[27.06.2021 22:14.40.356] [LOG] Connecting socket for: newsfeed
[27.06.2021 22:14.40.357] [LOG] Starting node helper for: newsfeed
[27.06.2021 22:14.40.359] [LOG] Connecting socket for: MMM-GoogleAssistant
[27.06.2021 22:14.40.360] [LOG] [GA] Read config.js and check ConfigDeepMerge…
[27.06.2021 22:14.40.361] [LOG] [GA] Perfect ConfigDeepMerge activated!
[27.06.2021 22:14.40.361] [LOG] Connecting socket for: MMM-PostDelivery-Norway
[27.06.2021 22:14.40.362] [LOG] Starting module helper: MMM-PostDelivery-Norway
[27.06.2021 22:14.40.363] [LOG] Connecting socket for: MMM-Detector
[27.06.2021 22:14.40.365] [LOG] [DETECTOR] MMM-Detector Version: 1.0.0 rev: 210615-1
[27.06.2021 22:14.40.365] [LOG] Sockets connected & modules started …
[27.06.2021 22:14.40.666] [LOG] Launching application.
[27.06.2021 22:14.40.873] [ERROR] (node:7463) electron: The default of contextIsolation is deprecated and will be changing from false to true in a future release of Electron. See https://github.com/electron/electron/issues/23506 for more information
[27.06.2021 22:14.43.522] [LOG] Create new calendar fetcher for url: https://calendar.google.com/calendar/ical/kent.xxxxxxx - Interval: 300000
[27.06.2021 22:14.43.590] [LOG] Create new news fetcher for url: https://www.nrk.no/norge/toppsaker.rss - Interval: 300000
[27.06.2021 22:14.43.610] [LOG] [GA] MMM-GoogleAssistant Version: 3.0.2 rev: 210617-1
[27.06.2021 22:14.43.616] [LOG] [GA] YouTube Search Function initilized.
[27.06.2021 22:14.43.618] [LOG] [GA] Activate delay is set to 250 ms
[27.06.2021 22:14.43.801] [LOG] [GA] Loaded @bugsounet/npmcheck
[27.06.2021 22:14.44.441] [LOG] [GA] Loaded @bugsounet/cast
[27.06.2021 22:14.45.159] [LOG] [GA] Loaded @bugsounet/spotify
[27.06.2021 22:14.45.165] [LOG] [GA] Loaded @bugsounet/systemd
[27.06.2021 22:14.45.781] [LOG] [GA] All needed @bugsounet library loaded !
[27.06.2021 22:14.45.783] [LOG] [GA:EXT] Extented Display Server Started
[27.06.2021 22:14.45.785] [LOG] [GA:EXT] Starting Cast module…
[27.06.2021 22:14.45.787] [LOG] [CAST] Cast v1.1.1 Initialized…
[27.06.2021 22:14.45.799] [LOG] [GA:EXT] Starting Spotify module…
[27.06.2021 22:14.45.806] [LOG] [SPOTIFY] Spotify v1.0.2 Initialized…
[27.06.2021 22:14.45.808] [LOG] [SPOTIFY] Started…
[27.06.2021 22:14.45.820] [LOG] [SPOTIFY] Launch Raspotify…
[27.06.2021 22:14.45.889] [LOG] [DETECTOR] All needed @bugsounet library loaded !
[27.06.2021 22:14.45.893] [LOG] [NPM] Initialized v0.9.95
[27.06.2021 22:14.46.130] [LOG] [DETECTOR] Platform: ‘raspberry-pi’; attempting to use ‘arecord’ to access microphone …
[27.06.2021 22:14.46.133] [LOG] [GA:EXT] Extented Display is initialized.
[27.06.2021 22:14.46.140] [LOG] [GA] RECIPE_LOADED: ExtSpotify.js
[27.06.2021 22:14.46.155] [LOG] [GA] RECIPE_LOADED: ExtGPhotos.js
[27.06.2021 22:14.46.164] [LOG] [NPM] Initialized v0.9.95
[27.06.2021 22:14.46.249] [LOG] [NPM] Found: 13/21 @bugsounet library [MMM-GoogleAssistant]
[27.06.2021 22:14.46.620] [LOG] [GA] Google Assistant is initialized.
[27.06.2021 22:14.46.624] [LOG] [DETECTOR] Snowboy is initialized with 1 Models: jarvis
[27.06.2021 22:14.46.721] [LOG] [DETECTOR] Starts listening. 1 Models
[27.06.2021 22:14.46.749] [LOG] [CAST] MagicMirror is listening on port 8569
[27.06.2021 22:14.46.899] [LOG] [RASPOTIFY] Raspotify already running
[27.06.2021 22:14.47.523] [INFO] Newsfeed-Fetcher: Broadcasting 20 items.
[27.06.2021 22:14.48.754] [LOG] [NPM] Details for MMM-GoogleAssistant [
{
name: ‘@bugsounet/npmcheck’,
installed: ‘0.9.95’,
latest: ‘0.9.95’
},
{ name: ‘@bugsounet/cast’, installed: ‘1.1.1’, latest: ‘1.1.1’ },
{ name: ‘@bugsounet/governor’, installed: ‘1.0.3’, latest: ‘1.0.3’ },
{ name: ‘@bugsounet/internet’, installed: ‘1.1.1’, latest: ‘1.1.1’ },
{ name: ‘@bugsounet/pir’, installed: ‘1.0.5’, latest: ‘1.0.5’ },
{ name: ‘@bugsounet/screen’, installed: ‘1.1.7’, latest: ‘1.1.7’ },
{ name: ‘@bugsounet/spotify’, installed: ‘1.0.2’, latest: ‘1.0.2’ },
{
name: ‘@bugsounet/google-assistant’,
installed: ‘1.2.6’,
latest: ‘1.2.6’
},
{
name: ‘@bugsounet/node-buffertomp3’,
installed: ‘1.0.5’,
latest: ‘1.0.5’
},
{
name: ‘@bugsounet/node-lpcm16’,
installed: ‘2.0.1’,
latest: ‘2.0.1’
},
{ name: ‘@bugsounet/cvlc’, installed: ‘1.0.4’, latest: ‘1.0.4’ },
{
name: ‘@bugsounet/google-photos’,
installed: ‘1.0.0’,
latest: ‘1.0.0’
},
{ name: ‘@bugsounet/systemd’, installed: ‘1.0.0’, latest: ‘1.0.0’ }
]
[27.06.2021 22:14.48.767] [LOG] [NPM] Check… MMM-GoogleAssistant
[27.06.2021 22:14.48.769] [LOG] [NPM] No update needed for MMM-GoogleAssistant
[27.06.2021 22:14.50.101] [INFO] Calendar-Fetcher: Broadcasting 10 events.
[27.06.2021 22:15.09.478] [LOG] [DETECTOR] Stops listening.
[27.06.2021 22:15.09.774] [LOG] [GA] ASSISTANT_QUERY: {
type: ‘MIC’,
key: null,
lang: ‘en-US’,
useResponseOutput: true,
useAudioOutput: true,
status: ‘standby’,
chime: true
}
[27.06.2021 22:15.09.888] [LOG] [MP3] ~v1.0.5~ MP3 FILE CREATING: /home/pi/MagicMirror/modules/MMM-GoogleAssistant/tmp/lastResponse.mp3
[27.06.2021 22:15.09.956] [LOG] [GA:AS] MIC:RECORDING START.
[27.06.2021 22:15.10.030] [LOG] [LPCM16] ~v2.0.1~ Start listening 1 channels, use arecord with sample rate 16000
[27.06.2021 22:15.11.362] [LOG] [GA:AS] CONVERSATION:RESPONSE
[27.06.2021 22:15.13.538] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘Odd’, done: false }
[27.06.2021 22:15.13.545] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne’, done: false }
[27.06.2021 22:15.13.549] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘open’, done: false }
[27.06.2021 22:15.13.695] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne’, done: false }
[27.06.2021 22:15.13.873] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne vi’, done: false }
[27.06.2021 22:15.13.954] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne with’, done: false }
[27.06.2021 22:15.13.985] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne Wish’, done: false }
[27.06.2021 22:15.14.194] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne Wikipedia’, done: false }
[27.06.2021 22:15.14.326] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne Wikipedia’, done: false }
[27.06.2021 22:15.14.558] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne Wikipedia Ard’, done: false }
[27.06.2021 22:15.14.726] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne Wikipedia at jeg’, done: false }
[27.06.2021 22:15.14.774] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne Wikipedia at jeg’, done: false }
[27.06.2021 22:15.14.836] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne Wikipedia artikkel’, done: false }
[27.06.2021 22:15.15.298] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne Wikipedia artikkel’, done: false }
[27.06.2021 22:15.15.583] [LOG] [GA:AS] CONVERSATION:END_OF_UTTERANCE
[27.06.2021 22:15.15.585] [LOG] [GA:AS] MIC:RECORDING_END
[27.06.2021 22:15.15.589] [LOG] [GA:AS] CONVERSATION:TRANSCRIPTION { transcription: ‘åpne wikipedia-artikkel’, done: true }
[27.06.2021 22:15.15.598] [LOG] [LPCM16] Stop listening
[27.06.2021 22:15.16.488] [LOG] [GA:AS] CONVERSATION:SCREEN object
[27.06.2021 22:15.16.493] [LOG] [GA:AS] CONVERSATION:ACTION { requestId: ‘60d77631-0000-2a3d-8392-f403043884e4’ }
[27.06.2021 22:15.16.495] [LOG] [GA:AS] CONVERSATION:RESPONSE
[27.06.2021 22:15.16.500] [LOG] [GA:AS] CONVERSATION:AUDIO 1600
[27.06.2021 22:15.16.504] [LOG] [GA:AS] CONVERSATION:AUDIO 1600
[27.06.2021 22:15.16.508] [LOG] [GA:AS] CONVERSATION:AUDIO 1600
[27.06.2021 22:15.16.510] [LOG] [GA:AS] CONVERSATION:AUDIO 1600
[27.06.2021 22:15.16.514] [LOG] [GA:AS] CONVERSATION:AUDIO 1600
[27.06.2021 22:15.16.518] [LOG] [GA:AS] CONVERSATION:AUDIO 1600
[27.06.2021 22:15.16.525] [LOG] [GA:AS] CONVERSATION:AUDIO 1600
[27.06.2021 22:15.16.526] [LOG] [GA:AS] CONVERSATION:AUDIO 1088
[27.06.2021 22:15.16.539] [LOG] [GA:AS] CONVERSATION_ALL_RESPONSES_RECEIVED
[27.06.2021 22:15.16.543] [LOG] [GA:AS] CONVERSATION_END:COMPLETED
[27.06.2021 22:15.16.546] [LOG] [GA:AS] CONVERSATION_PP:RESPONSE_AUDIO_PROCESSED
[27.06.2021 22:15.16.549] [LOG] [MP3] MP3 FILE CREATED 12288 bytes
[27.06.2021 22:15.16.602] [LOG] [GA:SP] CONVERSATION:SCREENOUTPUT_CREATED
[27.06.2021 22:15.16.605] [LOG] [GA] ASSISTANT_RESULT {
error: { error: null, message: null, audio: false },
action: { requestId: ‘60d77631-0000-2a3d-8392-f403043884e4’ },
text: ‘Her er et samsvarende resultat fra Wikipedia’,
screen: {
text: ‘.show_text_container{width:100%;padding:41px 0px 41px 112px;box-sizing:border-box}.show_text_content{font-size:1em;line-height:1.4em;width:24.7em;white-space:pre-wrap;color:#ffffff}#scroll-up{background-image:url(“https://www.gstatic.com/actions/devices_platform/expand-less.png”);background-size:48px 48px;color:#FFFFFF;height:48px;width:48px;margin-bottom:24px;display:none}#scroll-up:focus{background-color:#8e4e76}#scroll-down{background-image:url(“https://www.gstatic.com/actions/devices_platform/expand-more.png”);background-size:48px 48px;color:#FFFFFF;height:48px;width:48px;display:none}#scroll-down:focus{background-color:#8e4e76}.scroll-bar{left:32px;position:absolute;display:flex;flex-direction:column;margin-top:48px}.scroll_active{background-color:#424242}.scroll_inactive{opacity:0.3}\n’ +
‘Her er et samsvarende resultat fra Wikipedia’,
links: [],
photos: [],
path: ‘/home/pi/MagicMirror/modules/MMM-GoogleAssistant/tmp/responseOutput.html’,
uri: ‘tmp/responseOutput.html’
},
audio: {
path: ‘/home/pi/MagicMirror/modules/MMM-GoogleAssistant/tmp/lastResponse.mp3’,
uri: ‘tmp/lastResponse.mp3’
},
transcription: { transcription: ‘åpne wikipedia-artikkel’, done: true },
continue: false,
volume: null,
lastQuery: {
type: ‘MIC’,
key: null,
lang: ‘en-US’,
useResponseOutput: true,
useAudioOutput: true,
status: ‘standby’,
chime: true
}
}
[27.06.2021 22:15.20.116] [LOG] [DETECTOR] Starts listening. 1 Models
[27.06.2021 22:15.22.859] [LOG] Shutting down server…
[27.06.2021 22:15.22.863] [LOG] Stopping module helper: MMM-UpdateNotification
[27.06.2021 22:15.22.864] [LOG] Stopping module helper: calendar
[27.06.2021 22:15.22.865] [LOG] Stopping module helper: MMM-Entur-tavle
[27.06.2021 22:15.22.866] [LOG] Stopping module helper: MMM-YrThen
[27.06.2021 22:15.22.867] [LOG] Stopping module helper: newsfeed
[27.06.2021 22:15.22.868] [LOG] Stopping module helper: MMM-GoogleAssistant
[27.06.2021 22:15.22.869] [LOG] Stopping module helper: MMM-PostDelivery-Norway
[27.06.2021 22:15.22.870] [LOG] Stopping module helper: MMM-Detector

If you read (or scrolled this far): thank you.

[kaj]

Youtube cast works. First I had to enable the API, then I realized I wasn’t on the same network as my pi…stupid. I have used a reserved 2.4GHz wifi to set up several smart units around the house the last days. Didn’t notice I was still on it. Sorry.
But still I don’t see why google server don’t want to return my images. It worked fine with GA and A2D in previous version. And still does on my smartphone. Same with links.