Skip to content

LearnTutorials

Set up an AI voice assistant with Sesame

Set up a Sesame AI voice assistant on your phone, connect Gmail and Google Calendar, and get a morning briefing each weekday, in 15 minutes.

By Recaply EditorsBeginner15 min6 stepsUpdated

A hand holds an old telephone handset as sound lines curl toward a steaming cup of coffee

What you need

You must be 18 or older. Sesame is offered in 98 countries, listed on its Getting started page, and officially supports English only.

  1. Step 1: Install Sesame and sign in

    2 min

    Signing in lets each assistant remember your past talks, in both voice and text.

    1. In the App Store, search for Sesame: Personal Agents and install it. On Android, find Sesame in the Google Play Store.
    2. Open the app and sign in with Apple, Google or your email address.

    You should see the app open and signed in, ready for you to call or text an assistant.

    Sesame doesn't show up in your app store?

    The app is only offered in some countries. Check the country list on Sesame's Getting started page.

  2. Step 2: Pick an assistant and start a call

    4 min

    Each assistant has its own voice, personality and memory, so the one you pick shapes the talk.

    1. Pick one: Maya is a witty collaborator, Miles is laid-back and direct, Simone likes deep dives, and Charlie is a casual sounding board.
    2. Start a call and say what's on your mind, the way you'd talk to a friend.
    3. If you can't talk out loud, send a text instead. Memory carries over between calls and texts.
    Say or type this
    I'm deciding between [OPTION A] and [OPTION B] for [YOUR GOAL]. Ask me questions one at a time, then tell me which you'd pick and why.

    You should see a quick spoken reply, then questions about your choice, one at a time.

    The assistant states a fact that seems wrong?

    Sesame says its assistants can make things up. Ask where the fact came from, and check anything important before you act on it.

  3. Step 3: Connect Gmail and Calendar

    3 min

    With your email and calendar, an assistant can find messages, draft replies and plan your day.

    1. In the Agent Hub, open the Apps page.
    2. Pick Gmail or Google Calendar and sign in with Google to allow access. You can also ask your assistant to install the app for you.
    3. Add Google Drive the same way if you want it.

    You should see Gmail and Google Calendar listed as connected on the Apps page.

    A second assistant can't see your email?

    App access is set per assistant, so connecting Gmail for Maya doesn't share it with Charlie. Connect it again for each assistant that needs it.

    Sesame drafts and sends email only with your approval. You can remove an app's access at any time with one tap.

  4. Step 4: Build a morning briefing skill

    3 min

    A skill is a plain-language routine your assistant runs when you ask, or on a schedule.

    1. In a call or a text, tell the assistant what the skill should do and when it should run.
    2. Use the example below, then answer any questions it asks.
    3. To get the briefing outside its schedule, just ask for it.
    Say or type this
    Make a skill called Morning briefing. Every weekday at [7:30 am], summarize my unread emails from the last day and my meetings for today. Keep it under 2 minutes, and flag anything that needs a reply.

    You should see the assistant confirm the skill, what it covers and when it runs.

    The briefing isn't quite what you wanted?

    Tell the assistant what to change in plain words, such as "skip newsletters" or "move it to 8 am". It updates the skill for you.

  5. Step 5: Add a one-press shortcut

    2 min

    A shortcut starts a call without opening the app first.

    1. iPhone with an Action button: open Settings, tap Action Button, swipe to Controls and tap Choose a Control.
    2. Search for Sesame and pick Call Your Assistant. Now press and hold the Action button to call.
    3. Android: swipe down twice to open Quick Settings, tap Edit, and add the Sesame tile.

    You should see a call to your assistant start when you press the button or tap the tile.

    Your iPhone has no Action button?

    Only some iPhone models have one. Start your calls from the Sesame app instead.

    The steps can vary a little by phone model and software version.

  6. Step 6: Keep private talks out of memory

    1 min

    Assistants remember past talks to help you next time, but some topics shouldn't stick.

    1. Before a private conversation, turn on Incognito mode.
    2. To clear what one assistant knows, reset that character. Deleting your account removes your data.

    You should see a conversation that isn't saved to memory or to Sesame's servers.

    In Incognito mode, the assistant can still use what it already knows. It just doesn't save anything new.

You get

A voice assistant on your phone that knows your inbox and calendar, gives you a morning briefing and answers with one press

Did this guide work for you?

Sources