The AI Usefulness Gap

We're being promised flying cars. What we want is 140 characters.

I had high hopes for the return of John Stewart at the Daily Show; like many Xennials, he was my primary source of news in my twenties. Alas, after a strong start, he fell off with a recent piece about AI that was ill-informed, fear-mongering, and quite frankly silly. He mugged over shots of CEOs saying all the things CEOs say about their tech changing the world, without stopping to realize that the reason they say most of those things is to attract investor dollars and juice stock prices. His conclusion was that the sky is falling, AI will take all our jobs, and a handful of billionaires will live it up while everyone else starves.

This is clearly overblown for laughs, but the fact remains that many people are terrified of AI without actually understanding the nature and limits of the technology. In certain circumstances, AI has proven extremely useful -- for instance, the subject of my last newsletter, AI powered virtual humans that people can use for training and conversation practice. These avatars aren't meant to actually replace people; if you're a doctor, you still have to talk to a real patient. They're meant to help and supplement and guide.

But the bottom starts falling out shortly thereafter. AI generated music is nice for background noise, but people love artists and see their concerts because of who they are what they represent, along with their music. AI-generated film scripts are gibberish. Images made by Midjourney and other platforms are fun until you notice shark teeth or ten fingers or a weird sheen; essays generated by ChatGPT are generally just a bunch of other ideas squished together. It's whole lot of flash for VCs to get excited about.

In the real world, meanwhile, I was trying to book a train ticket on a university's travel site to go do a lecture, and it wouldn't let me delete part of a trip. I wound up on the phone with a very nice and patient human who sorted it out, but this is truly the type of thing any functional AI should have been able to do in five seconds. But nope...hey, want to see a picture of cats skiing? THAT we can do.

The hope for the near future is that the hype cycle around AI will cool off a bit and then we'll start getting towards functionality. We've all been predicting that AI will steal all of the jobs, but we've been predicting that since the rise of the cotton gin and the industrial revolution, and unemployment is at historic lows. Some people will be displaced and need to retrain, but as someone on her third career, it's really not the end of the world.

The best thing all the AI honchos can do right now is chill with the rhetoric and actually start making useful things. I don't care about creativity -- I care about never having to wait on hold for customer service, never having to file an expense report, and never having to argue with an airline. And I bet that's what most people want, too.

The Next Generation of AI Powered Avatars Are Here

Back in the mid-aughts, those swoopy banged and white belted days of yore, I spent hours upon hours updating my MySpace page. What started as sloppy code turned out to be the best thing that could have happened to the site, as people were able to customize and turn their sites into personalized seizure-inducing landing pages. But as the internet evolved, we moved away from customization and on to standardized, super clean pages that delivered information, if not joy. But now, with the rise of web3 and AI-powered virtual humans, we are finally getting some of that back.

On a call a few days ago, a colleague kept using the term "talk to the manager" and the first thing that sprung to my mind was the episode of Arrested Development where George Michael wants to be called "Mister Manager." Once the call wrapped, I went onto Virti (full disclosure, I work with them, and if you click the link you can try it for free) and in about twenty minutes, I was chatting about frozen bananas and the whereabouts of George Senior with my Mister Manager avatar. Later that day, I made a Sopranos-obsessed friend a virtual Tony to try to convince he was ready to move up in the family.

One on level, this is all just fun time wasting. But this is also a possible future of fandoms and fan fiction, not to mention education and training. I'd have much rather been interviewing Abraham Lincoln in school than reading a chapter about him in a book. It is also much better for students to be able to practice negotiations or employers to practice difficult conversations with an avatar then just watching a video. But it would also be fun to whip up a virtual version of a fictional character and find out more about their story and motives and iterate from there.

One of the reasons fan fiction has become so huge is because young people without a ton of life experience can use celebrities or fictional characters are jumping off points for their own stories. Imagine letting them run wild and create and tweak conversations that lead to more independent thinking and problem solving.

There are obvious downsides to this, in the form of intellectual property and consent; but then again, how are the locked down journals where I imagined long conversations with various nineties rock stars any different? As long as there are ways to distinguish between a fan-created avatar and the actual person and guardrails to make sure the avatar doesn't dip into territory the real person would find problematic, this is a great way to let creativity flower.

Over the last twenty years the internet has become part of our daily lives, and on balance much less fun and weird. The AI powered virtual humans are a way, at least for now, to bring a little bit of play back.

SXSW: Stuck in the Middle With You

To be clear: SXSW is still fun, and very much worth attending. I did two panels with absolutely brilliant people; went to events to launch fantastic new initiatives; had worthwhile meetings; and saw incredible work. There was live music, there were tacos, there was Shiner Bock. But overall, the festival feels just a bit less essential then it did five years ago.

Part of this is the nature of live events post-Covid, but there's something bigger that SXSW can't really control. We seem to be stuck in an in-between place, where the second wave of the web is cresting and coming back down, and the third wave has yet to build up. All the great tech that drove the buzz at SXSW in past years (Twitter! Uber! Foursquare!) has either disappeared, been en-shittified, or is just something we take for granted. Meanwhile, AI is getting booed and despite a strong market, crypto is has lost its buzz. XR continues to grow slowly but steadily, but we're not all hitting the streets in headsets quite yet.

We're hanging in a trough of disillusionment for several reasons. While the AI products we've seen have a whizzy quality, they haven't managed to solve that many real, day-to-day problems. We're going to hit a massive infrastructure hole that not even all of Jensen Huang's leather jackets sewn together can fix -- digital money is the future until the internet in the store blinks out and the terminals don't work. How exactly do we think all this will work when major countries can still just shut off the internet?

So here we are, stuck in the middle of two eras. For those of us building, it's a good time, albeit a strange one -- we just have to keep our eyes on the horizon and plug away. For everyone else, just hold on -- things are going to come back around soon.

13 Days with the Vision Pro -- how it feels to see the future

I just happened to be visiting my parents the day the Vision Pro was released, and like a good daughter I made them give up several hours of their day to hang about a suburban Portland shopping center so I could get a demo. When I finally dropped the cash and got one, according to my mom, she hadn't seen me as excited since I got a Barbie Dream House for the holidays when I was seven.

But almost two weeks in, is the headset still dreamy? Yes, but with some caveats. First off, it's not anywhere ready for prime time in terms of being a mass consumer device. Price aside, it's got some bugs and a very small app ecosystem, and while I'm leaning in and using it daily, the average person needs a lot more to be developed for it to be ready for mainstream use. That said, it's going to get there. Here's a few use cases I've tried out and found amazing, and a few that honestly aren't quite there yet.

Spatial video: this just might be the killer app. I've been shooting tons of spatial video, from strolling around my block to capturing my hands doing all sorts of tasks to chatting with friends. The video quality is fantastic and the depth is incredible. The downsides are that it's not easy to view that content many places, but that'll change with the ubiquity of the device. It's also such a good mainstream use case -- everyone loves taking photos and videos and if parents and grandparents can take hands free, super realistic videos of sporting events and birthday parties, that right there is enough to explode a market.

Entertainment: My first try using it on a plane was a bust, because I didn't know about putting the device in travel mode. Also, maybe it's just my account, but for some reason I'm not able to see movies I saved in Apple TV, only TV shows. Still, I'm more than willing to try it again on my next flight, and have been using it to watch TV at home. The lack of a Netflix app isn't great but watching content in the browser is more or less OK.

Fitness: Purpose built apps will solve some of this, but for right now, the Vision Pro is a bust for some types of fitness. I tried doing a yoga video but the battery pack kept getting in the way and the static placement of the browser made it tough to follow the instructor. I tried it walking on a treadmill and found it fine; I didn't try running out of fear of damaging the device.

Work: I've done a few Zoom calls but had some glitches and TBH I hate how my persona looks, but that's likely because I took it on a bad hair day and need to retake the photo. On those calls I was definitely less likely to multitask and get distracted, which is good. I've done other work (writing emails etc) in the headset with a wireless keyboard and found it about the same as writing on my laptop -- not an improvement, really, but not worse.

Overall, I'm still thrilled I got one and it's going to progress really quickly. The future isn't here yet, but it's coming a lot faster.

For spatial computing to power the future of work, we need to keep it simple

Last week I attended the IMSH Society for Simulation in Healthcare conference, and let me tell you, it was quite an experience. Many of the items on display there were not for the faint of heart, and one poor actress in a booth had to pretend to give birth to a fake baby at regular intervals throughout the day. Hope she was paid well.

There was also plenty of spatial computing and extended reality content on offer, much more so than in previous years according to regular attendees. And while that is certainly gratifying to see, a quick stroll of the floor for demos revealed that there are some areas we need to improve in before this technology can scale.

Many of the booths were manned by experienced docents, which is a best practice for trade shows -- unfortunately, this also revealed a huge limitation. I've been working in this space for almost nine years and if you need to stand next to someone like me and tell them where to click and what to do, how is that going to work when a medical student who has never seen a headset before puts one on for the first time. Sure, you can send docents and instructors out to sites, but that's a big cost and barrier to scaling.

I've long advocated that you should design for the least technical person who would reasonably be expected to go through a simulation. If your core audience is young men with gaming backgrounds, by all means, go nuts. But if your audience is broader than this and includes novices, you need to really scale back; otherwise, the frustration and friction is too great. People blame themselves when technology doesn't work, and give up with a negative impression.

What does all this mean? It means using voice or gaze to drive simulations, or limiting the amount of controller actions someone might need to use. It means lots of in-headset on-boarding, in a way that feels natural and allows people to fail early and without consequence. I once worked on a piece for a data warehouse company, and we started people off by having them use the controllers to make a snack in the break room. It allowed them to learn and make mistakes in a low stress environment, rather than having to remember which button to push when you were in the middle of a high stakes situation.

We're still figuring out best practices for all this, and at the end of the day, it's really exciting to see so many people playing in this space. But keeping it simple will be the path forward.

How We Evenly Distribute the Future of Work

OK, look, right now it's still in the nightmare fuel stage of innovation. You stumble into a convenience store on the way home from the bar to grab a late night snack, and you're confronted with the terrifying-looking robot creature you see above, casually refreshing the Red Bulls. The poor remaining human employees have to do a lot of cleanup on aisle five.

But a few years down the road, running into the inventory robot will be a common as seeing a human stocking cans. And there will be a human involved as well -- they'll just be in the comfort of their homes, anywhere in the world, wearing a headset and powering the robot. And as strange as it may seem right now, this could be a big part of the future of work -- and help level the playing field for disadvantaged workers.

Take food delivery, for example. It is extraordinarily difficult and dangerous work, but the demand exists so people rush to fill it. Autonomous delivery robots have thus far been underwhelming, but spatially aware human powered delivery robots could be the answer. And the people powering the robots could be anywhere in the world, thus eliminating some of the economic displacement of communities.

This could be an especially big benefit for women, who are often shut out of industrial work. If the robot is doing all the heavy lifting, the size and strength of the person powering it in headset is totally irrelevant. And if a robot is broken or destroyed, it can simply be fixed or replaced, whereas a human being injured or killed is a tragedy.

There will obviously be bumps along the way and we will need to make sure that people have other outlets for in-person connection if they are no longer in the streets or on factory floors. But the era of spatial computing and robotics could do a lot of good for workers around the world.

The Future of Work is Finally Here

Unless something absolutely catastrophic happens, one year from now, a percentage of the population will be regularly using Apple Vision Pro headsets for work. The size of that population depends on the availability and cost of the initial release of the headset, but rest assured, once Apple enters a market, it is go time. Apple's entry will also push other tech companies to innovate and iterate of face a crisis -- I was recently reminded of this when someone posted a piece about former head of Nokia crying that their company's disruption wasn't his fault (side note: if you haven't read The Innovator's Dilemma, you can just watch this video).

Of course, some companies are already adopting spatial computing and XR for work -- I've worked with Walmart and Amazon and Lowe's, among others, as well as NGOs, governments, and major consultancies. But the vast majority of businesses are still lagging, despite reams of research that using XR for training leads to better outcomes.

Now is the time for companies and industries to start investing in expertise in this space. This isn't fringe technology just for kids and video games anymore -- and even if it was, those kids will be in the workforce in the next few years. Much like designing for the web is very different than designing for print, designing for XR and spatial computing is a different skill set. It is teachable and learning, for sure, but organizations need to make sure they have experts who can do the initial teaching.

Over the course of the next several newsletters, I'll drill deep into the best practices and what folks need to know about how to create for this medium. If you want to get started early, you can check out my courses for Caltech and New Mexico State and reach out about consulting and speaking. Happy New Year!

How We'll Experience Higher Education Next

Two weeks ago I had the great opportunity to attend and speak at the EdX Global Summit and learn about the future of higher education. The industry is at a crossroads -- disrupted by Covid and an ever-increasing number of young people who are deciding college simply isn't worth it. Under political and financial pressure, some schools are cutting departments or simply closing altogether.

On the flipside, growth in online learning has provided a huge opportunity for some schools -- someone the event described MIT's online AI course as a "money printing machine." A sizable population of "Harvard" grads on LinkedIn have never set foot in Cambridge; simply pay for an online class, take a quiz or two, and you've entered the education elite, at least on this platform.

But internet learning only gets you so far. I say this as someone who has taught online classes for several platforms and is about to launch another -- the engagement just isn't great. I don't think I'm the only person who spends Zoom sessions half listening and half catching up on the news, emails, or messaging a friend about dinner plans.

There is a solution for this, and if you've ever read literally anything I've written in the last several years, you can guess what it's going to be -- that's right, VR. Early research out of universities using VR for education point to greater engagement, retention, and grades -- not to mention the leveling effect the technology can have. That lab at MIT or Caltech that has all the most cutting edge equipment -- now people everywhere can have access. You can virtually sit in on a lecture from a leading expert and then break off into virtual dissection sessions with people from all over the world.

VR is going to play a big role in education's transformation over the next several years. We need to let go of the idea of higher education being something you do for four years in your late teens and early twenties, and something that people do throughout the course of their entire life. People need to get comfortable pivoting, reskilling, and moving around -- and immersive education will enable that. If you're interested in learning more, drop me a line.

So, How Exactly Do You Tell a Story That Surrounds Someone?

Over the past several weeks of thinking and iterating, I keep coming back to one phrase when I think about the next phase of extended reality: stories that surround us. I truly wish I could remember when I first encountered this term, but it encapsulates the concept of how we're going to share content in the near future. Rather than being constrained by flat screens and limited activity, we'll be able to be fully immersed in story worlds and have more control over our interactions and participation. As exciting as this is, it also means entering uncharted territory for most people.

Fortunately (puts salesperson hat on) there is a brand new resource for folks who want to learn about this. In partnership with New Mexico State University, I'm proud to announce the launch of an online XR Storytelling class. Over the course of five units, I cover everything from the basics of extended reality to pulling together concepts, storyboards, and scripts, along with tips for filming, building, and distributing content. I also cover some of the research about why this content is so powerful. Students create storyboards and scripts and get feedback, and at the end, even receive a cool badge. The former Girl Scout in me was VERY excited to design that.

As more people and organizations start using XR, being able to design a good story will become an essential skill. I'm really proud of all the work I've done and the projects that will be released next year, and excited to help upskill a new generation of storytellers and creators. Students will also hear from a number of award-winning creators and experts who share their invaluable perspectives on how to make XR that moves the needle.

As an added bonus for my newsletter readers, you can get 25% off if you use the code "25OFFXRSTORY" when you sign up. And for my university affiliated readers, keep your eyes peeled as I am developing a series of educator specific workshops that will launch in 2024.

How We'll Remember 2023: The Contraction Before the Expansion

The older I get, the more I start to see how everything moves in cycles. At the risk of sounding a little too woo-woo, there are phases of contraction and expansion, and we're definitely in an era of contraction right now. It's not just the layoffs, although that's huge part of it -- it's the overall feeling the one era has come to an end but the next hasn't quite started yet.

The internet of the last fifteen or so years is sputtering to a close. Twitter, or whatever they're calling it these days, is losing users and clout. The big D2C brands that defined an era and an aesthetic are losing steam -- sure, you can still buy a Casper mattress, but it's a mattress, not a lifestyle with ubiquitous subway ads. WeWork is bankrupt. Now that money isn't free, services like Uber and DoorDash have raised prices and stopped caring about customer service, and use has slowed.

But while all those things are fading, the next wave hasn't quite crested yet. Web3 and the metaverse is growing, especially among young users who are bailing on Web2 socials for platforms like Roblox, but that technology is nowhere near mass adoption. So we're left in an odd in-between place.

In many ways, it feels like the early 2000s -- not just because of the current global political situation, but because one bubble has burst and another has yet to fully inflate. The dot com crash, for some commentators, spelled the death of the internet, but all those businesses have come stronger than ever. Pets.com and Webvan were just too early, and had to stumble so that Chewy and Instacart could run.

As odd as it sounds, this might be the best time to build. Lots of smart people have been freed from their FAANG golden handcuffs and want to try something new. Interest rates will come back down at some point, and money will start flowing, and hopefully flowing in a more strategic and equitable way.

When we look back at this era, it'll be defined by it laid the groundwork for the next iteration of human connection and communication. Head-mounted devices and avatar driven platforms will be so common we'll wonder how we ever lived without them. The smartest thing folks can do is recognize this start making things happen now, lest they wind up behind the curve.