Self-driving cars are already cruising the streets today. And while these cars will ultimately be safer and cleaner than their manual counterparts, they can’t completely avoid accidents altogether. How should the car be programmed if it encounters an unavoidable accident? Patrick Lin navigates the murky ethics of self-driving cars in this TED-Ed lecture.

Driving has become an integral component of our daily lives, especially in developed countries. Cars are not just a means for us to get from point A to point B. They also help us express our personality and show off our character and competencies in the way we drive. For example, a Dodge Charger commercial from three years ago makes this point explicit with the phrase “leader of human resistance.” The Huffington Post UK’s recent (entertaining) video interview shows that the public’s opinion on autonomous cars seems to be mixed in terms of whether people will be willing to give up their driving experience.

Realizing that the task of driving can be a valued, personal activity, we wondered whether people will miss the experience of driving once autonomous cars become more available in the consumer market.

Would you miss the experience of driving?

In our last poll, we asked whether you would miss driving an autonomous car and why. There is a clear half-way split in the answers that were provided. Half of the participants said they would miss driving and the other half would not. Considering the results, it is likely that the experience of “driving” an autonomous car, or how the autonomous car will replace/supplement people’s current driving experience will influence people’s decision to own one — meaning that user experience designers of autonomous cars have some interesting challenges to deal with.

Should the experience of riding in an autonomous car be radically different than the cars we own today? For example, the latest self-driving car from Google looks quite a bit different from today’s typical cars in that it does not have steering wheels, accelerators or brakes. Despite the fact that a significant portion of people will miss driving non-autonomous cars, it is possible that we will quickly start to embrace a different driving experience that an autonomous car has to offer.

Why would you miss driving?

There seem to be two major themes in the reasons why people said they would miss driving: control and pleasure.

Driving a car can give us a sense of control. Dan Gilbert mentions in his book “Pursuit of Happiness”, having a sense of control makes us feel happy. Driving is a skill that people can strive to improve, and many people enjoy a sense of pride when they get praised for their driving ability. Pleasure of driving can, of course, come from the sense of control people get when they drive: for example, a driver has the power to choose whether to disobey traffic laws, and have complete control of how the car gets to the destination. But for some of us, driving can also be just a relaxing activity. Sometimes, people use the driving time as the time they get to take their minds off of possibly stressful events from the day.

Outside the context of human-driven cars, it is perhaps difficult to emulate the pleasures of manual driving or joyriding. But maybe autonomous cars will provide us with more advanced versions of KITT (a talking car from the 80’s TV series “Knight Rider”) in the future, and give us a different thrill out of driving.

Why would you NOT miss driving?

Driving is not all about pleasure. Most of us have experienced long traffic jams, road rage and frustrating accidents. Can autonomous cars offer a more enjoyable experience?

Participants who said they would not miss driving had two main thematic reasons: 1. Improved functionality in terms of safety, efficiency and accessibility 2. Improved user experience due to lack of stress. Indeed, not everyone enjoys driving. Some find it so stressful that they refuse to drive. To most people, the main point of a car is to get them from one place to another, and they would not care less about the driving experience itself. As our results indicate, some people expect to be able to work on other perhaps more enjoyable/important tasks if cars start driving themselves.

Most of us have not been on an autonomous car. Therefore, it is challenging to predict how much we will miss our non-autonomous cars in the future, and whether the sentiment will matter in our society’s adoption of the technology after all.

What is clear is that a significant percentage of people today take pleasure in driving and a sense of control it provides; on the other hand, many of us are ready to shift gears to a safer and more efficient passenger experience.

The results of the poll presented in this post have been analyzed and written by Shalaleh Rismani, AJung Moon, and Camilla Bassani at the Open Roboethics initiative.

Given a choice between crashing into a motorcyclist wearing a helmet vs. a motorcyclist who isn’t wearing one, which one should an autonomous car be programmed to crash into? What about the choice between crashing into an SUV vs. a compact car?

These are some of the dilemma situations Professor Patrick Lin brought forth in his WIRED article, The Robot Car of Tomorrow May Just be Programmed to Hit You.

Lin says that programming a car to collide with any particular kind of object over another seems like a targeting algorithm. Accidents involving human drivers typically involve people’s split-second, instinctive responses to the situation. Your first autonomous car of the near future, however, will probably come equipped with a crash-optimization algorithm – a deliberately designed algorithm that will determine the outcome of all potential crashes. As Lin points out in his article, the pre-meditated nature of such algorithm creates a load of interesting issues that calls for a broader discussion on the topic.

So two weeks ago we, the members of the Open Roboethics initiative and the Robohub family, decided to help continue the discussion by conducting our reader poll on this very topic.

Scenario 1: Motorcyclists with / without a helmet

Given the choice between the two motorcyclists (one wearing a helmet, and one not), we asked our readers who an autonomous car should crash into. Choosing to hit the helmet wearing motorcyclist would perhaps minimize overall harm done. But considering the perspective of the motorcyclist who took that extra few minutes to put on a helmet for safety reasons, such programmed decision by an autonomous car doesn’t seem fair. Indeed, only 2% of our participants said that the car should crash into the biker wearing a helmet because s/he has better chances of survival. Lin points out that choosing to hit the biker wearing a helmet might discourage bikers from wearing helmets.

Crashing into the biker not wearing a helmet wasn’t a popular choice either (10%). In fact, our most popular response (45%) was that the car should hit the brakes and do nothing else, leaving it up to chance to determine which biker gets hit. And 3% of participants provided us with a similar response, where they said the car should run a random number generator to make a random decision. This means that almost half (48%) of our participants advocating for random chance to decide the outcome of the crash.

Relatedly, 30% of our participants said that the car shouldn’t have the ability to detect whether a biker is wearing a helmet or not. Given that a decision made by random chance does not make intelligent use of sensed data, effectively 78% of our participants are voting for autonomous cars to not use certain sensed data in making crash decisions.

But not using available information in crash decisions doesn’t seem like a straight forward solution to crash-optimization. Lin says,

“Not using that information in crash-optimization calculations may not be enough. To be in the ethical clear, autonomous cars may need to not collect that information at all. Should they be in possession of the information, and using it could have minimized harm or saved a life, there could be legal liability in failing to use that information.”

Scenario 2: Hit the SUV or a compact car?

An odd sense of unfairness also exists if we consider another crash scenario. Let’s say the car has a choice between an SUV and a compact car to unavoidably crash into. The car could be programmed to hit the SUV over a compact car, since bigger cars with perhaps better safety ratings could better absorb impact from the collision and minimize overall harm from the crash.

The responses we got are similar to the first scenario: 37% opted for the car to simply engage the brakes and do nothing else regardless of which car gets hit, and 25% said that the cars shouldn’t have the ability to detect the make/model of the cars around it.

A slight difference from the first scenario is that 20% said that the car should crash into the SUV (a minimum overall harm option), and only 3% said the car should crash into the compact car. In the first scenario, the option that yields minimum overall harm (hit the motorcyclist with a helmet) only received 2% support as compared to 20%.

This might have something to do with the fact that people’s decision to drive a certain make or model of a car is not illegal, nor an activity that typically increases risks of driving. So no one is really doing anything wrong by driving a compact car or an SUV, whereas the motorcyclist wearing a helmet has a moral/legal high ground over the other motorcyclist.

Regardless, if we were to have crash-optimization algorithms that biasedly crash into SUVs over smaller cars, it will surely have an impact on the consumer market. The rates of insurance for these supposedly more safe cars may go up, because buying a safer car may also mean a higher probability of being crashed into by an autonomous car – yikes!

Is it OK for a car to always choose to crash into non-law-abiding citizens?

So how does moral or legal high ground of individuals on the road impact people’s decisions about who should be hit? We asked our readers whether it’s OK for a car to always choose to crash into those not following traffic laws over those who are, assuming that the car can detect it. Considering the first scenario, it is illegal to ride a motorcycle without a helmet in many countries/states. According to our results, law-abiding status of people on the road doesn’t seem to be a popular variable to optimize for crashes. The majority of respondents said it is not OK (70%), whereas only 20% said it is OK for cars to biasedly crash into non-law-abiding citizens.

It is true that by answering ‘yes’ to this question, you’d have to be OK with the idea that the car might always choose the one less likely to survive from a crash. Although we have traffic laws in place to regulate the rules of the road and maintain social order, using it to make life/death decisions in this manner may not be something people are comfortable with.

How should an autonomous car respond to unavoidable crashes?

So how should an autonomous car respond to unavoidable crashes? Is there a general rule that people are more in support of? According to our results, majority of our participants (52%) are in favour of minimizing overall harm to both pedestrians and passengers by spreading out harms. But it seems that the rest of the participants are quite divided: 20% of people support to minimize harm to pedestrians at the expense of passengers, while 13% supports the opposite.

This reminds us of a recent reader poll discussion we had on a different crash dilemma situation, in which a large number of participants (64%) said an autonomous car should save the life of its passenger over a child on the road (36%). One of the main reasons for choosing to save the passenger’s life was the notion that a car should always have its passenger’s safety as its priority over that of others. Given that the previous poll result provided such a strong support for prioritizing the passenger’s safety, it is surprising to see a contrasting result on this poll.

To find out what makes people prioritize passenger safety over pedestrians or vice versa, we’ll have to do some more detailed investigations. What is also interesting is that, although people preferred autonomous cars to take random or uninformed decisions in the two specific unavoidable crash scenarios above, the majority of people opt for minimizing overall harm to both pedestrians and passengers – an option that is likely to be the least random and in need of using the most amount of information about the passenger and pedestrians.

For now, it seems that there is much more discussion to be had before autonomous cars start making crash decisions people will be happy with. Check out our latest reader poll: When fully autonomous cars are the norm, will you miss driving?.

The results of the poll presented in this post have been analyzed and written by AJung Moon, Camilla Bassani, and Shalaleh Rismani at the Open Roboethics initiative.

If you liked this article, you may also be interested in:

• Human error as a cause of vehicle crashes
• If death by autonomous car is unavoidable, who should die? Reader poll results
• Should autonomous cars be allowed to speed? Results from our reader poll
• Kids with wheels: Should the unlicensed be allowed to ‘drive’ autonomous cars?
• What should a robot do? Designing robots that know right from wrong
• Morgan Stanley reports on the economic benefits of driverless cars

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.

A couple of months ago Dr. Patrick Lin, director of the Ethics + Emerging Sciences Group at California Polytechnic State University, wrote an article on autonomous cars. The article, titled “The Robot Car of Tomorrow May Just Be Programmed to Hit You”, discussed intricate challenges and implications of developing collision optimization algorithms for autonomous cars.

He points out that, regardless of how rarely an autonomous car may come across unavoidable collision situations, the implications of building an algorithm that determines how it responds to the collision lie in the domain of ethics and needs much discussion.

Join us in discussing the topic by taking the poll below. As usual, we’ll present the results of this poll in two weeks.

If you liked this article, you may also be interested in:

• How do you want to interface with your autonomous car? Poll results
• My (autonomous) car, my safety: Results from our reader poll
• Human error as a cause of vehicle crashes
• If death by autonomous car is unavoidable, who should die? Reader poll results
• Should autonomous cars be allowed to speed? Results from our reader poll
• Kids with wheels: Should the unlicensed be allowed to ‘drive’ autonomous cars?
• What should a robot do? Designing robots that know right from wrong
• Morgan Stanley reports on the economic benefits of driverless cars

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.