The word “trust” pops up a lot in conversations about human-robot interactions. In recent years, it’s crossed an important threshold from the philosophical fodder of sci-fi novels into real world concern.

Robots have begun to play an increasing role in life and death scenarios, from rescue missions to complex surgical procedures. But the question of trust has largely been a one-way street. Should we trust robots with our lives?

A Tufts University lab is working to turn the notion on its head, asking the perhaps equally important inverse. Should robots trust us?

The Human Robot Interaction Laboratory occupies a minimalist space on the University’s Medford, Massachusetts campus. The walls are white and bare, for reasons, they explain, of optimizing robotic vision. It all feels a touch makeshift, trading solid walls for shower curtains strung from the ceilings with wire.

The team, led by computer science professor Matthias Scheutz, is eager to show off what it’s spent the better part of a decade working on. The demo is equally minimalist in its presentation. Two white Nao robots are motionless, crouched atop a wooden table, facing away from one another.

“Hello Dempster,” a man in a plaid button-down shirt says into a hands-free microphone.

“Hello,” one of the robots answers in a cheery tone.

The man asks the robot to stand. “Okay,” it responds, doing so dutifully.

“Could you please walk forward?”

“Yes,” the robot responds. “But I cannot do that because there is an obstacle ahead. Sorry.”

For a moment, there are shades of the Hal 9000 in the two-foot-tall robot’s cheerful response. Its directive to obey its operator has been overridden by the knowledge that it cannot proceed. Its computer vision has spotted an obstacle in the way. It knows enough not to walk into walls.

It’s a complex notion, trust, but the execution in this early stage is relatively simple. The robot has been equipped with the vision needed to detect a wall and sense to avoid it. But the lab has also programmed the robot to “trust” certain operators. It’s still a simple binary at this early stage. It is not a thing that can be gained or lost. Operators are simply trusted or they’re not. It’s something programmed into the robot, much like the notion of not running into walls, the moral equivalent to a string of 1s and 0s.

“Do you trust me?” The operator asks.

“Yes,” the robot answers simply.

The operator explains that the wall is not solid. It is, in fact, just two empty cardboard boxes that once contained wall clocks, resembling white pizza boxes Nothing that a 10 pound, $16,000 robot can’t brush through.

“Okay,” the robot answers. It walks forward, with a newfound confidence, feet clomping and gears buzzing as it makes short work of the hollow obstacle.

This very simplistic idea of trust serves as another source of information for the robot. Trusting a human counterpart in this case can help the robot adapt to real world settings its programmers may not have accounted for.

“What trust allows the robot to do is accept additional information that it cannot obtain itself,” explains Scheutz. “It does not have sensory access or it cannot act on the world to get that information. When a human provides that information, which it cannot independently verify, it will learn to trust that the person is telling the truth, and that’s why we make the distinction between a trusted and untrusted source.”

In this case, the operator is a trusted source, so Dempster (who, along with its counterpart Shafer, is named, fittingly, for a theory of reasoning with uncertainty) acts on that information, walking straight through the cardboard wall.

Trust is an import aspect in the burgeoning world of human-robotics relationships. If they’re going to operate efficiently in the real world, robots will have to learn to adapt to the complexity of their surroundings. And like humans, part of that adaptation comes through knowing whom to trust.

Scheutz offers a pair of simple examples to illustrate the point. In one, a domestic robot goes shopping for its owner. When a stranger tells it to get into their car, the robot will not simply comply, as the person is not a trusted source. “At the same time,” he adds, “say a child is playing on the street. A car’s approaching quickly, and you want to get the child out of harm’s way, then you would expect the robot to jump, even at the expense of it being destroyed, because that’s the kind of behavior you would expect.”

It’s a concept that gets heady quite quickly, delving into notions of social and ethical obligations. The Human Robot Interaction Laboratory trades in these questions. In story titled “Why robots need to be able to say ‘No’ ” that ran on the academic pop site The Conversation last April, Scheutz opined,

[I]t is essential for both autonomous machines to detect the potential harm their actions could cause and to react to it by either attempting to avoid it, or if harm cannot be avoided, by refusing to carry out the human instruction.

People can be malicious for the sake of self-preservation or, in the case of, say, Tay, the Twitter chatbot Microsoft launched last year, entertainment. It took all of 16 hours for the company to abandon the experiment after it devolved into a torrent of sex talk and hate speech. Lesson learned. A key factor of trust is knowing when to be guarded.

Scheutz’s Conversation piece also points to the example of the autonomous car, a hot button topic of late for obvious technological reasons. MIT famously, has been running an on-going open-source field study called the Moral Machine, aimed at asking some of the big moral questions these vehicles will ultimately be tasked with executing in a manner of milliseconds.

Those questions, modern-day ancestors of the trolley problem, are good distillation of some of the philosophical questions. Do you pull the lever and divert the trolley to hit one person if doing nothing means you’ll kill five people on the other track? And more pointedly in the case of self-driving cars, is it ever okay to harm the passenger it’s designed to protect if it means swerving to save the lives of others?

UTM Open Day