Wintry mix spreads across Minnesota

MPR News helps you turn down the noise and build shared understanding. Turn up your support for this public resource and keep trusted journalism accessible to all. 

Turn Up Your Support


This week, the Supreme Court agreed to hear 

the case of a man on Facebook who threatened to kill his wife

In 2010, Pennsylvania resident Anthony Elonis got dumped, lost his job and expressed his frustrations via the Internet.

"He took to Facebook as a form of, what he says, a form of therapy," says criminologist Rob D'Ovidio of Drexel University, who is following the case.

As life kept falling apart, Elonis made threats repeatedly on Facebook to his ex, to law enforcement and to an unspecified elementary school. He was convicted and sentenced to 44 months in prison and three years of supervised community release. D'Ovidio says that's a serious felony sentence.

Elonis' wife said she felt scared, but his defense says the graphic language was a joke. Take this post:


Elonis claims he lifted the lines, almost word-for-word, from the show 

"Did you know that it's illegal to say, 'I want to kill the president of the United States of America.' "
The Supreme Court will consider if Elonis' language was a "true threat," which the 

 as speech that is so clearly objectionable, any objective listener could be scared.


Meanwhile, Facebook has already decided that key words are not an effective way to look for threats on the site.

"Things that get reported for the more intense reasons are things that you look at the text and it's like, 'I had no idea from looking at this text that this was going on,' " says Arturo Bejar, a director of engineering at Facebook.

 against porn, it does not forbid specific violent words. While algorithms crawl through the site in search of our deepest consumer demands, there's no algorithm looking for credible threats. That's because "intent and perception really matter," Bejar says.
Bejar's little-known section of the Facebook machine works on 

. He has gone to leading universities and recruited experts in linguistics and compassion research.


Together, they field user complaints about posts at a massive scale. They facilitate "approximately 4 million conversations a week," Bejar says.

By conversation, he really does mean getting people to communicate directly with each other and not just complain anonymously. It's couples therapy-lite for the social media age. And, it turns out, a button that says "report" is a real conversation killer.

"We were talking to teenagers, and it turns out they didn't like clicking on 'report' because they were worried they'd get a friend in trouble," he says.

When his team changed it to softer phrases like "this post is a problem," complaints shot up.

They also revamped the automated form, so that the person complaining names the recipient and the emotion that got triggered. Let's say I hurt a friend's feelings. He could send a form letter: "Hey Aarti, this photo that you shared with me is embarrassing to me."

More people walked through the process of complaining. And according to the data, the word "embarrassing" really works.

"There's an 83 to 85 percent likelihood that the person receiving the message is going to reply back or take down the photo," Bejar says.

Facebook has hundreds of employees around the world who can step in when the automated tools fail, and threat detection is clearly a work in progress.

Consider two cases. In the first, Facebook user Sarah Lebsack complained about a picture that a friend posted of his naked butt.

"It wasn't the most attractive rear end I've ever seen, but also just not what I wanted to see as I browsed Facebook," Lebsack says. She says it took Facebook a couple of hours to take down the picture.

User Francesca Sam-Sin says she complained about a post that put her safety at risk. Recently she had flowers delivered to her mom after a surgery, and her mom posted a picture of the flowers.

"The card had my full name, my address and my cellphone number on it. And it was open to the public; it wasn't just limited to her friends," Sam-Sin says.


Sam-Sin says her mom wouldn't delete the post because she wanted to show off the bouquet, and Facebook wouldn't get involved in family matters.  Copyright 2019 NPR. To see more, visit https://www.npr.org.

Social Issues

Aarti Shahani

Author

This week, the Supreme Court agreed to hear the case of a man on Facebook who threatened to kill his wife.

Is a threat on Facebook real? Supreme Court will weigh in

Go Deeper.

Like this?

News you can use in your inbox