Hatch Design Talks 2023

–E

–E

14

14

The Impact of A.I. in UX

The Impact of A.I. in UX

Jascha Goltermann

Jascha Goltermann

Design Manager, Booking.com

Design Manager, Booking.com

About the Episode

In our last episode of the season, we speak to Jascha Goltermann, design manager at Booking.com. He’s joining Hatch to talk about the learnings building Booking’s new A.I. powered trip planner, and sharing his views on how what the big leap in the technology might change the way design and tech teams work.

Listen

Transcript

 

Jascha: Hi, Jascha. Thank you so much for joining me today on this podcast that we do to tell the people that are coming to Hatch conference or attending online a little bit about the speakers. How are you doing today?

Damian: I'm doing very well. Thank you for having me. Obviously, I'm very excited about the conference itself, but also talking to you today.

Jascha: Nice. Yeah. You're doing a lot of stuff at Hatch. You're both having a facilitating session and giving a keynote. But before we start, why don't you tell me a little bit about your career? How did you end up in booking. com?

Damian: Okay. My career spans a little over 10 years now. So obviously it's gone through. A lot of changes and different kinds of roles and different kinds of responsibilities. I'm now a design manager at booking. com, which means that I manage a team of designers. they work on strategic efforts.

I lead a vision and high priority projects. My focus is on the way how people search and find accommodation in booking. com. So really the heart of the product,

And the role itself is Very much focused on three things, really people, product and organization. So I support designers, I support their growth and careers.

I also work with tech marketing product and machine learning leaders to drive projects. And I work on improving the. design craft itself and the design management craft themselves. Before I joined Booking, I was in many different roles. Obviously, a lot of things have changed in the field itself.

Jascha: yeah.

Damian: Right before I joined booking, I was actually in an individual contributor role so I did not really necessarily have a linear career path, I would say and I spent about half of the last 10 years in different design leadership roles some of them involving Managing others, just leading other designers and obviously a lot of classical individual contributor roles in companies of different sizes.

Jascha: And how was actually to make that transition between like individual contributor into a manager what do you think were your, the challenges that you had doing that? 

Damian: . So I think the challenge is really pretty much the same for most people who go from individual contributor to manager. It's the shift in focus. So obviously you shift your focus a little bit from the tactical to the strategic and from, details to Bigger picture to planning , but I think there is a much more core part, which tends to receive less focus, even though it's actually the key change, which is shifting your focus from product to people.

No matter if you're a designer or a developer, or even no matter if you're an IC or a manager, the craft itself is not the difficult part, it's the human to human interaction. So how do you, for example, have difficult conversations, right? How do you guide people or how do you inspire them to go beyond their comfort zone?

So these kinds of things are more difficult to prepare for than going from tactical to strategic, right? This is something that you can. Learn a lot more from soaking up knowledge online or something. So the main transitional challenge, I would say, is becoming somebody who works On people instead of working on classical hands on design deliverable.

Jascha: And how did you handle that personally? Did you have any specific, did you take courses? Did you just learn by doing, did you have good mentors inside the company? 

Damian: Yes, you do need to have mentors or maybe not so much mentors, but you need to have people that you feel that you can learn something from that are in a role like that. And it doesn't necessarily have to be a design leader. It can also be it can also be a people manager in a completely different craft that you want to draw experience from.

So it's important to basically look into how are the people managing situations and trying to learn from that. You can try to learn by reading resources or taking courses. I'm not saying I wouldn't recommend it. It's also something that obviously I looked into, especially once I was in those role.

I wanted to make sure that I. Don't miss what are the essentials of the role, but it's not as valuable, I think, as the lessons you learn from the situations that you're placed in when you're in those roles. And obviously that means that you can only really grow into the role once you're in the role, but what you can do beforehand is prepare by exposing yourself to certain thinking and to certain situations. So yeah, I think you have to have an understanding of yourself and how you would deal with people in situations. You have to understand the difference between managing and leading, you have to have sort of leadership principles and obviously those will change and those will sharpen over the course of your career then as a manager, but you have to basically know what it means for you to lead people and it's good to build that understanding before you're placed into a role like that.

Jascha: That's a good segway to your actual masterclass at Hatch. It's called Design Manager Starter Kit. Is there something like, the things that I wish somebody had told you once you transitioned into management, how did the idea for the masterclass come to 

Damian: yes, essentially, it's that. Things I wish for a transition into management. It's not really like you cannot put a generalized roadmap for someone, right? There's not really like a blueprint follow these things. And then you will be set as a manager. Also, because this role itself can mean different things. The role itself means different things in different places. That's one challenge. And there's no generalized way. This is, what the role is and this is how you prepare for it. But there's a ton of learning still. Both from my personal journey, but also from being on the sort of hiring side, being on the side of growing seniors, being on the side of growing leads being on the side of hiring managers.

So there's a ton of learnings in what are the kinds of skills, what is the kind of expertise, what are the kind of approaches that typically companies will ask this person to. Be experienced and how do you yeah, how do you spot sort of your opportunities to grow into those skills and gain this kind of experience?

Jascha: That's pretty cool. Maybe you can turn into an article as well, sometimes for everyone who cannot attend it. And of course, very exciting. You're giving it the first AI related talk of the day at Hatch based on your learnings and having two concepts and implementation plans. And implement some AI power features and at this new trip planner, booking.

com has launched very recently. I'm interested in how you tackle having to work with such a challenge, which is, it's the first time that you had to do. Something like this because you've, you've managed teams doing products, but suddenly there's this whole new paradigm of what we're actually building and we don't have any much reference to the back of our own team, but also like in general in the world.

So how did you get it going?

Damian: Luckily it wasn't the first, let's say, project working with ML technology per se, right? That's not something that was necessarily new because Booking.com is quite a mature organization set up around machine learning. So there's a machine learning hub in Tel Aviv and there's, machine learning scientists and principal engineers and all these kinds of things.

So working with parts of the expertise at least was not new, but then of course LLMs and generative AI is a new technology. That yeah it's helpful to have experts that are knowledgeable in the field of machine learning so they can quickly help understand this new technology, but that new technology itself changes quite a bit, and I think it's taken everybody a bit by surprise, like there was this time from when chat GPT was released and the next couple of months.

Yeah. Weeks on a daily basis, you would see new improvements in the space and new things that people were building with it and new ways that people were getting value from it and new technologies being released. So it was this time where if you just log on to Twitter, you would see almost every day, somebody posting, Hey, this new record basically has been broken.

Jascha: Yeah.

Damian: It was new to everyone, including me, including Booking and probably including all those machine learning scientists that were working with different types of technology in the years prior to that. So how do we do it? It's a very much cross functional effort. It's I can't stress that enough.

Obviously, design is always working with, tech and product and other crafts. But in this thing particularly, you really have to, you have to learn about this technology together, and you really have to figure out ways to collaborate and communicate about it together. So designers have to learn vocabulary that machine learning scientists have already been using.

Same with product managers. They were also in this position, suddenly, where they had to learn new vocabulary. 

So it is something where it is essential, it is crucial for UX roles and not just designers, also researchers and also writers to be involved and have a say in how those prompts are engineered. So it's a bit of this new space where. Let's say new responsibilities, new skill sets are required, and it's not clearly defined who does what and how it works.

So from the engineering is one thing, but basically designers need to work alongside machine learning engineers, or maybe in other companies generally with, which is tech with developers to basically craft those problems and then find ways to understand how they would impact the experience. And another thing that is new is there is a lot less that is actually under your control when you work with this kind of technology. So typically as a designer, you design something and you know that what the interaction is going to be like, what the experience is going to be like,

Jascha: Yep.

Damian: because you designed it. But with Gen AI, you don't quite exactly know how it turns out.

And even if you go to chat GPT and you put in the same prompt twice. You will get a different answer the second time than you got the first time. Even the companies building this type of technology don't know 100 percent all the details of how it generates the answer and how it works.

So you have to be able to deal a little bit with that ambiguity, but you can design how you deal with it. So you can design. You can design how to steer it in the direction that you want. You can design how to avoid situations that, would be lead to a less optimal experience. So that's new that you have to look into these things.

And then another thing that is new for designers is you really have to design conversations more than you have to design interfaces or more than you have to design even so you use tools that you would use or techniques and approaches that you would use to design user journeys, user flows but you apply it to designing conversations. So for example, you want to say, Hey, we want this in this case for booking. com. Obviously it is an AI trip planner. So it's essentially a virtual travel agent. You want this AI to behave like a travel agent and to respond like a travel agent. How do you design how it responds to certain conversations.

And it's not as simple as just connecting this question will lead to this answer because it's completely open like users could in any type of question. So yeah, those are exciting new things to consider when designing with this type of technology. And the key to it is working very closely with the engineers that are then actually, implementing the code that will yeah, build this tool that you're working on with this technology.

Jascha: I think what's also really interesting to me is the expectation on the other side has suddenly changed for two things. So one thing when you're already saying for a product, Hey, this is like AI powered or something like that. People already have a different expectation and at the same time, don't know what the output is.

But you're working with a whole backlog of things that one expects when one is in booking. com. So you know that it's part of the essence of what you're providing as a result that can really drift too much. But at the same time, as you said, the unpredictability of it and the kind of the new type of interaction that one has really changes things.

So I think there's a really interesting thing. And even to see, will these processes that we've been using for all the other interaction design, will they still apply, will they have to be updated to actually be more permissive for certain processes? And my next question comes exactly around this.

Do you think that all this new technical possibilities that we have with all these models and with all these possibilities start making a requirement for designers to learn new skills on how to work in these types of projects. Because what I believe is if I learned how to implement the user journey, doesn't necessarily mean that. I can translate that from like a Miro template into this new thing. So what's your opinion on that?

Damian: Yeah, no, absolutely so there are a bunch of skills that will help you adapt to the new skills that are required when working with this kind of technology. That's more what I was saying. Not so much that we already have those skills that we already have the expertise, but more that we have a lot of very relevant skills and expertise as designers and actually in different UX roles that will help us position ourselves as key strategic roles in this new era, really, where Different AI technology is becoming more core to creating experiences, and it will become more core to creating experiences because it also becomes a lot more accessible and a lot more affordable and, startups off.

Pretty much any size can afford to to incorporate external ML capabilities into their products. Now, it's something that previously was something that, the big tech companies could afford to build an organization around themselves. But right now you can use like software as a service for Gen AI capabilities.

And just build your product around it at a relatively low cost and relatively low risk. So more and more companies are going to actually use that. And as a designer, you won't really be able to completely ignore the field. So yes, I do believe that it's becoming more and more important for designers to at least learn about the technology and learn about the different ways how it can be used to improve the experience.

And that's really where then also the key value of our role lies. Obviously, companies are looking into using this technology, but they're using this technology or they want to use this technology to ultimately improve the experience because that drives value for the user, which in turn drives value for their business.

So how do you get value for the user out of it? That's where UX is crucial. And that's why I think yeah, design roles need to. Position themselves as the key roles to involve in projects working with AI. And yeah, they need to upskill essentially or expand a little bit their skill set and expertise into this field.

Jascha: And has there been any moments building this new features powered by AI where you were like, okay, this really changes everything. Some kind of breakthrough moments. You mentioned costs. It's already obviously just an important part of it, but from the design side, was there anything specific that you found surprising or interesting?

Damian: One thing that I mentioned already is the unpredictability of it.

That is a big like you cannot really overestimate this change. But also it can do so many things out of the box understand user intent personalized experiences that it, it offers a wealth of ways to improve an experience just by tapping into an existing LLM.

 It's the vast amount of things that you can do with it that is going to revolutionize a lot of products, but then there's also the unpredictability of working with it is going to require us to adapt how we work with it and we won't get to a point where we can fully. Steer it like you won't be just able to say always work respond as a travel agent.

And then everything just works out. You can still trick a travel agent into giving you an inappropriate travel advice and there's no 1 percent fail safe way to, to avoid that. So these things, working with this kind of ambiguity, working with this kind of unpredictability, it's just something that.

We need to get better at and manage around it. 

Jascha: Okay. I won't spoil it much more about the topic for everything else people can watch your talk either in person or online. Are you excited about visiting Berlin again? What are you most looking forward to?

Damian: Yes, obviously super excited to be in Berlin. The thing I'm looking forward to most obviously is to connect with people. So looking forward to all these talks between the actual talks at the conference. And besides that, I won't really have so much time. So I'm mostly planning to seeing family.

Jascha: Okay. Nice. Thank you so much for this. This is probably one of the last podcasts that's airing. For everyone who's listening, we'll see you this week, probably. Thank you so much and yeah, see you in a few days in Berlin.

Damian: Thank you and see you over there.

Jascha: Bye bye.

Get your ticket!

Online tickets for the conference are still available. Save getting 5 passes or more.

Online tickets for the conference are still available. Save getting 5 passes or more.

Watch

Recordings Pass

Get access to the recordings from all stages, and Temi Adeniyi's keynote from the Leadership Ateliers Day

€40

Watch

Recordings Pass

Get access to the recordings from all stages, and Temi Adeniyi's keynote from the Leadership Ateliers Day

€40

We accept these payment methods

We accept these payment methods