12 NEW Copilot Features + Copilot Mode in Microsoft Edge (Tutorial)

Copilot just got a major upgrade with 12

new features. This includes

collaborative group chats, memory and

personalization, vision, co-pilot mode

in the Edge browser, and a whole lot

more. Plus, we're going to have a

special appearance by our old friend

Clippy. So, let's get started. The first

new feature is that co-pilot now has the

ability to store different memories. So,

for example, I'll say remember this

about me. I work at Microsoft the

education product group team as a group

product manager. Okay, it says I'll

remember this and now it's stored in

memories. And you might say, hey, where

are these memories actually stored? If

you go down here, click on your icon for

the name and go to manage memory. There

we go. You work at Microsoft and the

education product team. And I can delete

these memories or I can add to them. If

I hit add, it actually pops it in.

Remember this, I live in Newcastle,

Washington

and so on. You can also access memories

directly right here and it pulls up the

manage memory. If I want to delete this,

I can delete it. But now if I just ask

Copilot, where do I work and what job do

I have? All right, it remembered that.

Another aspect about C-pilot memory

that's nice is whether you're in your

web or desktop or phone, you can add or

delete your memories and it always keeps

everything in sync and you can access

them anywhere. And right on Q feature

number two, start a group. So, in the

upper right, you're going to see invite.

And just a note, this is rolled out to

the beta customers, meaning the early

adopters like me. If you're not seeing

this feature yet, it's going to roll out

broadly soon. And if you want to join

the Edge Insiders to get early build

access, I have a link in the description

below. But I do want to start a group. I

want to start a group to start planning

for my TPS report offsite in the spirit

of Office Space. So, I will click

invite. And I'm going to invite by link.

Now I've copied a link to the clipboard

and I'm going to go send this link to a

couple people. I'm going to send it to

Peter from Office Space and it makes it

up Pam from the office. They're going to

join in this chat and I'll show how it

works. And it looks like Pam said, "Hey

Mike, let's plan our TPS report

offsite." And co-pilot stepped in and

gave some ideas about where this could

be. Now it looks like Peter piped in and

said, "I prefer Woodenville Wine

Country." Okay, now co-pilot's going in

and suggesting specific venue options in

Woodenville. Oh, wow. This is great. So,

you can see both Peter joined and

Peter's commenting here. Pam has a

comment. So, I'm going to say, "I'd

rather start it at 9:00 a.m. since Bill

Lumbberg's an early bird." So,

Co-Pilot's going to kick in. Co-pilot

kicks in and suggests a different time.

So, now we're in a collaborative group

chat with Co-Pilot helping out with

these things. In the upper right, you're

going to see the people that were

invited. It's me and it's Pam and it's

Peter. Now, I could remove them if I

want. Maybe Peter's getting a little

sassy. I could remove him. I could also

end this chat or I could invite other

members. Maybe I want to have Bill

Lumbberg join in directly. Oh, Pam says,

"Please don't have Bill Lumbberg to this

chat." Okay, so Copilot said, "Don't

worry, this is a Lumbberg free zone.

Just us and the TPS magic." So, that is

group chatting within Copilot. The third

new feature is Copilot Vision. Now, this

is a really cool feature that rolled out

recently, but now it's being brought to

the phone as well as the browser. I'm

going to show it first in the Copilot

desktop. So, on my desktop in Windows

here, I'm going to launch the consumer

copilot. And here it is. And you're

going to see this little glasses icon.

There's also getting guidance with your

apps. I can select different apps. These

are apps that I've used recently. So,

for example, if I want to share OneNote,

I click here and it's going to ask me to

share OneNote because that app is open.

What it's going to do is share the

OneNote so co-pilot can see my screen.

>> Hey again, Mike.

>> Hey there. How's it going?

>> Looks like you're working on some

off-site notes in One Note. Need any

help with those TPS reports?

>> I do. And you know what? I'm doing a

demo right now so everyone can see what

you're saying. So, let's have a little

fun. What do you think the premereing

scribbles are? What are the key points

on this page you can help me out with?

>> You're in conference room 7B and the

coffee choices seem like a metaphor for

the mood. motivation or denial.

>> Yeah, I agree. You know what? Actually,

on this OneNote page, what I'm trying to

do, I actually I haven't used OneNote

very much. Can you help me find I'm

trying to find a specific button on the

page up on the top on the home tab? I'm

trying to find a button called dictate.

Can you point that out for me? The

dictate button.

>> I've marked the dictate button for you.

Give it a try.

>> Thank you. I'm just going to go up here

and click it.

And there I've got dictate going in one

note. You know what? That was super

helpful. I'm going to stop sharing now.

Well, let's stop. So, that's really cool

ways that Copilot can see your screen.

This also works on the iPhone. So, I can

share my screen to the iPhone when I'm

in Copilot. The brand new update that

was just announced recently is that

Copilot Vision is now coming to the Edge

browser. So, we're going to go back into

the browser. I'm here in Edge and we're

going to enable something that's called

C-Pilot mode. And this is a super cool

mode. It turns your browser into a full

AI browser. So go to the three dot menu

here. Go down to settings and I'm going

to see this AI innovations. And again,

if you don't see this yet, you don't

have the latest builds, but it's coming

out very soon. I'm on the early adopter

build. So AI innovations, and there's

this co-pilot mode. And I'm going to

turn this on. And actually a nice trick

to see if you're in co-pilot mode. Right

now there's just an icon. Watch what

happens when I flip this switch. Now it

says co-pilot. That's sort of a nice

little indicator that I'm in co-pilot

mode. And there's a bunch of different

features here. And I'm going to show

these features a little bit later. But

the feature I'm going to show now is I'm

going to show how co-pilot vision works.

So, first I'm going to open up a new web

page. Okay, it's my YouTube channel web

page. Now, I'm going to go up and click

Copilot here and I'm going to go and I'm

going to click the microphone and that's

going to trigger Copilot Vision.

[Music]

>> Hey Mike, what's on your mind today?

Hey, I'd like you to check out this

YouTube page and tell me what you see.

>> I'm looking at your YouTube channel.

It's packed with videos on Microsoft

product features, especially the snazzy

new ones.

>> Yeah, I'm curious what's along the

bottom row. What What type of videos do

you see along that popular videos?

>> On the bottom row, it's spotlighting

popular videos that cover useful tips on

Microsoft tools like OneNote, Forms, and

Teams. Thanks, Copilot. So, you can see

Co-Pilot can see any type of page that

you put up. It could be a blog. It could

be a YouTube page. And so, it allows

Copilot to watch and see your desktop.

You can talk about whatever's on the web

page, whether you're shopping, you're

traveling, whether you're looking at

YouTube. The fourth new feature is a new

voice mode for Copilot. And there's a

new little mascot called Mo. And that is

Microsoft Copilot. Mi then co. Get it?

Mo. So, if I want to talk to co-pilot, I

just click the little microphone here.

>> Hey, Mike. Glad you're back. So, what's

on your mind today?

>> Hey there, Mo. Hey, I'm going to show

some demos here. I'd like you to turn

purple. That's my favorite color.

>> There you go. I'm now a lovely shade of

purple.

>> Oh, okay. Well, I'm going to show how

people change you. I can change the

voice. So, maybe I want to go and I'm

going to choose Oh, Meadow. How's that?

>> Let's explore the world together.

>> That sounds good. What about Birch?

>> What do you think? Could we make a good

brainstorming?

>> I can get philosophical.

>> So, lots of different voices and I could

turn Mo off.

>> If I don't want any voice.

>> Hey. Hey, Mike. Great to have you back

here.

>> Hey, how's it going? Okay. I'm just

showing a demo. So, I'm going to turn

you off now.

And so, what's nice is it tracks that

entire conversation that I've been

having right here. That's a nice little

demo of voice mode. Now, before we go,

I'm going to show a little Easter egg

and we're going to make the real Clippy

appear. So, let's watch this. We're

going to turn it on.

>> Hey, Mike, you're back. Rain.

>> I can't wait to learn more.

>> And we're going to show Mo.

>> Hey, Mike. Welcome back.

>> Hey there. I'm going to show a little

Easter egg. Here we go. So, if you start

clicking on Mo a bunch of times, left

mouse click. It's Clippy. Clippy. It's

so great to see you again.

>> Oh, you found the secret. Yep. That's

Clippy popping in for a surprise visit.

Honestly, it's kind of fun to have a

little throwback guest appearance once

in a while.

>> It is. You would you call Clippy like

your great great great grand clip?

>> You know,

>> you know what? Let's roll with that.

Yeah.

>> Okay. Hey, thanks Clippy. It's been good

to see you. Secret Mo Clippy Easter egg.

The fifth new feature is some

interesting health care provider

integration directly into Copilot. So,

let's say I want to go and I want to

find a family care doctor near me. And

hey, I'm going to prefer a male doctor

in this case. So, I'll hit go.

Now, Copilot is integrated with Bing

Map. So, it pulls up where these people

are. It has all the details from the web

and there's a bunch of different doctors

near me in Newcastle. I can scroll down.

Now, if I want to go and search through

these and see where they're located, I

can easily do that. Now, let's say, oh,

James Park, he looks interesting. I want

to choose view details. Now co-pilot

pulls out the side pane has even more

information is education insurance. I

can view all these things right here. Oh

great, they take lots of different

insuranceances, languages that that

doctor speaks. I could even call

directly. So all that integration right

there in the co-pilot page and this

works for all sorts of different types

of health care scenarios. So you can

explore but all these things are now

packaged right directly into copilot.

The 16 new feature is enhanced searching

and citation updates in Copilot. So if I

drop quick response, there's this new

option called search and it answers with

enhanced references. So now I'm going to

go and I'm going to try to find all the

C-pilot updates in the fall release and

it's going to be searching out there and

give me extra references. So I'll hit

this and it's citing everything. It has

VentureB plus one. There's a lot of

different references here. And now

what's really nice is every single thing

is referenced. And at the bottom, I've

got a show all. And when I click this,

it shows all the different references

that it looked at. So, it's really

powerful in all these different places

that it were searching across. And so,

if you have this search turned on, it

enhances the references that it adds and

it makes it really easy to see all your

references all in one place. The seventh

new feature is a remix library. So, I'm

going to open up the sidebar here and

there's this new imagine option. I'll

choose this. And there's all sorts of

images that are being added in here by

the community. And you can go and you

can remix one. So maybe I want to go

here. Oh, this one looks kind of fun.

Hit remix and whimsical 3D rendered

furry creatures. I could copy that

prompt. Now I might say, "Hey, it's near

Halloween. Please make them into

Halloween inspired fuzzy creatures." Hit

go.

Oh, love it. There's my spookified

little friends. They're nice and fuzzy.

Now I can share this message in prompt.

So I can actually copy this link. I can

share it out on different social media

sites. Can send it to someone and I can

also download it just like here. So if I

want to download that, there we go. I

can save it. Now what I can do is go

back into image labs and just explore

all these different types of images. So

there's just a ton of cool stuff in here

that you can play around with and find

some inspiration. And there's also the

library right here. So any image you

create. So, it stores your image in the

library under images. And if you've done

things like created co-pilot pages, I

don't have any right here, or research

reports or podcast, it'll all be saved

in the library automatically. So, you

don't have to go and remember where

these things are. The eighth new feature

is learn live, which is an improvement

to the study and learn mode. So, I'm

going to drop the quick response and

we'll choose study and learn right here.

And now what I'm going to do is I'm

going to go in to hit the microphone and

let's do learn live.

[Music]

>> Hey Mike.

>> Hey there. I think I want to learn about

linear equations. Can you help me out

with that?

>> Yep. Got it. We'll dive right in and

take things step by step. Let's figure

out what you already know and then build

from there.

>> I don't know anything. Can we start from

the beginning? Let's keep it simple.

>> Absolutely. We can go back to square one

and keep things super simple. Let's

start from the basics and take it step

by step.

>> Oh yeah.

>> So let's break it down. In the simplest

terms, a linear equation is basically

just an equation that graphs as a

straight line. Now rather than me just

handing you the definition, let me ask

you, what do you think makes a line

nonlinear in comparison?

>> H a curved line maybe.

>> Exactly. You've got it. A nonlinear line

often curves or bends. So it's not just

a straight shot.

>> Okay. Hey, you know what? I think I'm

done for the day, but thank you for the

learn live demo, Mo. We'll see you

later.

>> And now all of my conversation about

study and learn was captured. Nice way

to get that learn live. You got a little

character. You can go back and forth

instead of just a wall of text. That's

the learn live that's built into study

and learn mode here. And if I want to

close this out, just hit X. The next set

of features are using co-pilot mode in

Edge. And just a reminder, we turned on

co-pilot mode earlier in this video. On

the settings page, if you go to AI

innovations, that's where you turn it

on. And I'm going to show some of the

features. Now, the ninth new feature is

a nice simple one, and that is it's

really easy to open up this co-pilot

button sort of in a mini mode. So, if I

do alt C, it opens this up, and I can

have a really nice quick access to

co-pilot and talk about any web page I'm

looking at. I can even pin this to keep

the sidebar open and it's sizable. I can

go backwards and forwards really easy. I

will unpin it. And the first question

is, you know, I'm looking to get a new

Copilot Plus PC, a Surface Laptop. Super

cool device. So, I'm going to ask a

little question. You know, can you make

any recommendations about this Copilot

Plus PC? So, it's going to read the web

page. It's going to take the knowledge

it has and give me some highlights. So,

hey, here's some highlights. It has

these in a table. processor, display,

battery life, what makes it stand out,

considerations. Great. A lot of cool

stuff here. Now, Copilot can start to

see across your tabs. So, I'm going to

pin this. Now, I've been doing some

research. Maybe I'm looking at here's a

Acer Copilot Plus PC and I've also I'm

looking at this Dell laptop. And so, now

I'm going to ask Copilot, hey, can you

look at the three tabs? Make a table

comparing the devices and the pros and

cons of each. at the end. I'm going to

make this a little bit wider and we'll

hit go. Copilot actions. It can look

across all my tabs and understand what

is in each web page. So, here it's

building a table. Oh, that's really

nice. The laptop, the Acer, the Dell.

It's got the price, processor, RAM.

Great. It's building a really nice,

super easy to read table. It's got pros

and cons of each below. So, being able

to easily see across all my tabs is

really cool. Okay. Now, what I'm going

to do is I'm going to close this and I'm

going to close this and let's just say

I'm browsing something else right now.

You know, I'm over here at the Microsoft

Education blog and I remembered, you

know what? I want to go check out that

Amazon laptop I was looking at. So,

we'll just do Alt C and I'll ask, hey,

can you find the Surface laptop info I

was looking at on Amazon earlier? So, it

searches my browser history. Okay, we're

going to open this up. Oh, it found the

exact details from what I was looking

at. It even has revisiting the page.

Here's the link. Okay, I'll just click

this. Now, that's going to bring me

right back to that page I was looking

at. Copilot has access to my browser

history. Now, it can't look at Infinity.

It just looks at a short amount of time,

the last few days. You can control this

also in your settings. So, you can say,

don't look at my history. So, if you're

worried about privacy, you can

completely turn this off as well. But

this is quite cool because now it can

remember what you've been doing. It can

see your browser tabs, and it can be

quite handy. You can go much deeper with

co-pilot actions and wire them up to

your Outlook email, Gmail, have them do

shopping for you. I'm not going to show

them in this video, but you should play

around and go deeper with Copilot

actions. The 11th new feature is a

really cool one, and that is you can

translate any video in real time to

different languages. And this can be on

YouTube or anything that you're looking

at in the browser. This is an edge

specific feature. So, I'm going to open

up this video right here.

>> Okay, so I'm talking in English. I'm

going to pause this. And if you hover,

you're going to see this little toolbar

come up with some options. And one of

them is translate audio. So, I'm going

to click this and I want to go and I'm

going to say I want to translate this

from English. And I'm going to choose

into Spanish. And there's going to be

more languages added over time, but

we'll choose Spanish. And now I'm going

to hit translate. It installs that

Spanish pack. Now, it's going to

translate. And now I'm going to hit

play.

Wow.

So it adds the full audio translation in

that other language. If I want to change

it to another language, maybe I want to

do Hindi. Now let's try Hindi.

>> Pretty incredible real-time translation

for any videos that you're watching in

Edge just by hovering and then choosing

this little translate audio button. The

12th new feature is a simple one but

really useful. If I hit the plus here,

my new tab is a co-pilot tab. And I've

got all my office apps right here and

other things that I might want to add

different links. But I can directly just

start using co-pilot by hitting that new

page tab right here. And the cursor goes

to here. If you want to change the

cursor to go back up to the web address,

I just go to the three dot menu into

settings,

go to AI innovations, and right here,

copilot new tab page. I can set

preferences here. And right here, focus

on the new tab page. I can turn that

off. So now when I hit the new tab, it

always goes to the address bar. But if

you want to have Copilot as your default

new tab, really easy to do. Now, if you

want to keep up with all the latest

Microsoft updates and tips and tricks,

subscribe to my channel and then just

ring the bell so you get all the latest

videos that I