{"id":339700,"date":"2017-05-01T01:26:29","date_gmt":"2017-04-30T17:26:29","guid":{"rendered":"http:\/\/techcrunch.com\/?p=1483020"},"modified":"2017-05-01T01:26:29","modified_gmt":"2017-04-30T17:26:29","slug":"algorithmic-accountability","status":"publish","type":"post","link":"https:\/\/people.utm.my\/asmawisham\/algorithmic-accountability\/","title":{"rendered":"Algorithmic accountability"},"content":{"rendered":"
\n
\n

Algorithms are designed to make our lives easier. The problem is, they’re designed by us.<\/h2>\n<\/p>\n
Apr 30, 2017 |<\/span> Megan Rose Dickey<\/a><\/span><\/span><\/div>\n<\/div>\n

<\/div>\n

\n

W<\/p>\n

hen Netflix recommends you watch \u201cGrace and Frankie\u201d after you\u2019ve finished \u201cLove,\u201d an algorithm decided that would be the next logical thing for you to watch. And when Google shows you one search result ahead of another, an algorithm made a decision that one page was more important than the other. Oh, and when a photo app decides you\u2019d look better with lighter skin, a seriously biased algorithm<\/a> that a real person developed made that call.<\/p>\n

Algorithms are sets of rules that computers follow in order to solve problems and make decisions about a particular course of action. Whether it\u2019s the type of information we receive, the information people see about us, the jobs we get hired to do, the credit cards we get approved for, and, down the road, the driverless cars that either see us or don\u2019t see us, algorithms are increasingly becoming a big part of our lives.<\/p>\n

But there is an inherent problem with algorithms that begins at the most base level and persists throughout its adaption: human bias that is baked into these machine-based decision-makers.<\/p>\n

You may remember that time when Uber\u2019s self-driving car ran a red light in San Francisco<\/a>, or when Google\u2019s photo app labeled images of black people as gorillas<\/a>. The Massachusetts Registry of Motor Vehicles\u2019 facial-recognition algorithm mistakenly<\/a> tagged someone as a criminal and revoked their driver\u2019s license. And Microsoft\u2019s bot Tay went rogue<\/a> and decided to become a white supremacist. Those were algorithms at their worst. They have also recently been thrust into the spotlight with the troubles around fake news stories surfacing in Google search results and on Facebook.<\/p>\n

But algorithms going rogue have much greater implications; they can result in life-altering consequences for unsuspecting people. Think about how scary it could be with algorithmically biased self-driving cars, drones and other sorts of automated vehicles. Consider robots that are algorithmically biased against black people or don\u2019t properly recognize people who are not cisgender white people, and then make a decision on the basis that the person is not human.<\/p>\n

Another important element to consider is the role algorithm\u2019s play in determining what we see in the world, as well as how people see us. Think driverless cars \u201cdriven\u201d by algorithms mowing down black people because they don\u2019t recognize black people as human. Or algorithmic software that predicts future criminals<\/a>, which just so happens to be biased against black people.<\/p>\n

A variety of issues can arise as a result of bad or erroneous data, good but biased data because there\u2019s not enough of it, or an inflexible model that can\u2019t account for different scenarios.<\/p>\n

The dilemma is figuring out what to do about these problematic algorithmic outcomes. Many researchers and academics are actively exploring how to increase algorithmic accountability. What would it mean if tech companies provided their code in order to make these algorithmic decisions more transparent? Furthermore, what would happen if some type of government board would be in charge of reviewing them?<\/p>\n<\/div>\n

\n

W<\/p>\n

hatever approach is taken to ensure bias is removed from the development of algorithms, it can\u2019t dramatically impede progress, DJ Patil, former chief data scientist of the U.S., tells me. Solutions can only be implemented, and therefore effective, if tech companies fully acknowledge their roles in maintaining and perpetuating bias, discrimination and falsehoods, he adds.<\/p>\n

If you think about the issues we faced a few years ago versus the issues we face now, they are compounding, he adds. \u201cSo how do we address that challenge?\u201d In developing new technologies, there needs to be more diversity on the team behind these algorithms. There\u2019s no denying that, Patil says, but the issue is scalability across the whole realm of diversity.<\/p>\n

\u201cThere\u2019s diversity of race, there\u2019s diversity of religion, there\u2019s diversity with respect to disability. The number of times I\u2019ve seen somebody design something where if they made a slight decision choice you could design for a much broader swath of society \u2014 just so easy, just to make a slight design change, but they just didn\u2019t know. And I think one of the challenges is that we don\u2019t have scalable templates to do that.\u201d<\/p>\n

Google, for example, determines what many people see on the internet. As Frank Pasquale writes in his book, \u201cThe Black Box Society: The Secret Algorithms That Control Money and Information<\/a>,\u201d Google, as well as other tech companies, set the standards by which all of us are judged, but there\u2019s no one really judging them (141, Pasquale). \u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/p>\n

When you conduct a Google Image search for \u201cperson,\u201d you don\u2019t see very many people of color, which perpetuates the normalization of whiteness and reinstills biases around race. Instead, you\u2019ll see many pictures of white men, says Sorelle Friedler, affiliate at the Data & Society Research Center<\/a> and ex-Googler who worked on X and search infrastructure.<\/p>\n

\u201cThat is perhaps representative of the way that \u2018person\u2019 is broadly used in our society, unfortunately,\u201d Friedler says. \u201cSo then the question is, is it appropriate for that sort of linguistic representation to make its way to image search? And then Google would need to decide, am I okay with black people only being represented only if you search specifically for black people? And I think that that\u2019s a philosophical decision about what we want our society to look like, and I think it\u2019s one that\u2019s worth reckoning with.\u201d<\/p>\n

Perhaps Google doesn\u2019t see itself as having a big responsibility to intervene in a situation like this. Maybe the argument of \u201cit\u2019s a result of the things our users are inputting\u201d is acceptable in this scenario. But search queries related to the Holocaust or suicide have prompted Google to intervene.<\/p>\n

Algorithms determine Google\u2019s search results and suggestions. Some of Google\u2019s algorithmic fails are more egregious than others, and sometimes Google steps in, but it often doesn\u2019t.<\/p>\n

\u201cIf you search for ways to kill yourself, you\u2019re directed toward a suicide hotline,\u201d Robyn Caplan, a research analyst at Data & Society, tells TechCrunch. \u201cThere are things Google has deemed relevant to the public interest that they\u2019re willing to kind of intervene and guard against, but there really isn\u2019t a great understanding of how they\u2019re assessing that.\u201d<\/p>\n

Earlier this year, if you searched for something like, \u201cis the Holocaust real?,\u201d \u201cdid the holocaust happen<\/a>\u201d or \u201care black people smart?<\/a>\u201d one of the first search results for both queries was pretty problematic. It wasn\u2019t until people expressed outrage that Google decided to do something<\/a>.<\/p>\n<\/div>\n

\n

\u201cWhen non-authoritative information ranks too high in our search results, we develop scalable, automated approaches to fix the problems, rather than manually removing these one-by-one,\u201d a Google spokesperson tells TechCrunch via email. \u201cWe are working on improvements to our algorithm that will help surface more high-quality, credible content on the web, and we\u2019ll continue to improve our algorithms over time in order to tackle these challenges.\u201d<\/p>\n

In addition to its search results and suggestions, Google\u2019s photo algorithms and the ads it serves have also been problematic. At one point, Google\u2019s photo algorithm mistakenly labeled black people as gorillas.<\/p>\n

Google launched Photos in May 2015 to relatively good reception. But after developer Jacky Alcin\u00e9<\/a> pointed out the flaw, Bradley Horowitz, who led Google Photos at the time, said his inbox was on fire.<\/p>\n

\u201cThat day was one of the worst days of my professional life, maybe my life,\u201d Horowitz said in December<\/a>.<\/p>\n

\u201cPeople were typing in gorilla and African-American people were being returned in the search results,\u201d Horowitz said. How that happened, he\u00a0said, was that there was garbage going in and garbage going out \u2014 a saying he said is common in computer science. \u201cTo the degree that the data is sexist or racist, you\u2019re going to have the algorithm imitating those behaviors.\u201d<\/p>\n

Horowitz added\u00a0that Google\u2019s employee base isn\u2019t representative of the users it serves. He admitted that if Google had a more diverse team, the company would have noticed the problems earlier in the development process.<\/p>\n

Another time, Google featured mugshots at the top of search results for people with \u201cblack-sounding\u201d names. Latanya Sweeney, a black professor in government and technology at Harvard University and founder of the Data Privacy Lab, brought this to the public\u2019s attention in 2013 when she published her study of Google AdWords<\/a>. She found that when people search Google for names that traditionally belong to black people, the ads shown are of arrest records and mugshots.<\/p>\n

What\u2019s driving mistakes like this is the idea that the natural world and natural processes are just like the social world and social processes of people, says Pasquale.<\/p>\n

\u201cAnd it\u2019s this assumption that if we can develop an algorithm that picks out all of the rocks as rocks correctly, we can have one that classifies people correctly or in a useful way or something like that,\u201d Pasquale says. \u201cI think that\u2019s the fundamental problem. They are taking a lot of natural science methods and throwing them into social situations and they\u2019re not trying to tailor the intervention to reflect human values.\u201d \u00a0<\/p>\n

When an algorithm produces less-than-ideal results, it could be that the data set was bad to begin with, the algorithm wasn\u2019t flexible enough, the team behind the product didn\u2019t fully think through the use cases, humans interacted with the algorithm enough to manipulate it, or even all of the above. But no longer are the days where tech companies can just say, \u2018Oh, well it\u2019s just an app\u201d or \u201cOh, we didn\u2019t have the data,\u201d Patil says. \u201cWe have a different level of responsibility when you\u2019re designing a product that really impacts people\u2019s lives in the way that it can.\u201d<\/p>\n

While algorithms also have vast potential to change our world, Google\u2019s aforementioned fails are indicative of a larger issue: the algorithm\u2019s role in either sustaining or perpetuating historic models of discrimination and bias or spreading false information.<\/p>\n

\u201cThere is both the harm data can do and the incredible opportunity it has to help,\u201d Patil says. \u201cWe often focus on the harm side and people talk about the way math is \u2014 we should be scared of it and why we should be so afraid of it.<\/p>\n

\u201cWe have to remember these algorithms and these techniques are going to be the way we\u2019re going to solve cancer. This is how we\u2019re going to cure the next form of diseases. This is how we\u2019re going to battle crises like Ebola and Zika. Big data is the solution.\u201d<\/p>\n<\/div>\n

\n

A<\/p>\n

barrier to tackling algorithmic issues that pertain to content on the internet is Section 230 of the Communications Decency Act<\/a>, which states, \u201cNo provider or user of an interactive computer service shall be treated as the publisher or speaker of any information provided by another information content provider.\u201d<\/p>\n

It made it possible for tech companies to scale because it relieved platforms of any responsibilities for dealing with illegal or objectionable conduct of its users. The Electronic Frontier Foundation calls it \u201cone of the most valuable tools for protecting freedom of expression and innovation on the internet.\u201d<\/p>\n

If this law didn\u2019t exist, we could essentially deputize Google and other tech companies to operate as censors for what we consider to be objectionable speech. Something like that is happening in Europe with The Right to be Forgotten<\/a>.<\/p>\n

\u201cAmerican scholars and policy people are somewhat terrified because basically what has happened there is practically speaking, Google has become the arbiter of these claims,\u201d says Solon Barocas, a postdoc researcher at the NYC Lab of Microsoft Research<\/a> and member of the Society, Ethics, and AI group. \u201cIt\u2019s not like a government agency is administering the decisions of what should be taken down. Instead, it said \u2018Google you have a responsibility to do this\u2019 and then Google does it themselves. That has frightened a lot of Americans.\u201d<\/p>\n

But given the existence of Section 230 of the CDA and the fact that it provides many protections for platforms, it may be difficult to use legislative means in the U.S. to affect what content is trending over Facebook or what search results appear on Google.<\/p>\n

Outside the U.S., however, legislation could affect the way these tech companies operate inside America, Caplan says. In Germany, for example, the government has drafted a law<\/a> that would fine social networks up to 50 million euro for failing to remove fake news or hate speech. \u00a0<\/p>\n

Meanwhile, the European Union\u2019s digital chief, Andrus Ansip, warned Facebook<\/a> earlier this year that while he believes in self-regulatory measures, he\u2019s ready to take legislative action if it comes to that.<\/p>\n

\u201cWhat we\u2019ve seen in the past is that these types of policies that take place outside of the U.S. do have a pretty big role in shaping how information is structured here,\u201d Caplan says. \u201cSo if you look at Google\u2019s autocomplete algorithm, you see a similar thing \u2014 that different auto-completions aren\u2019t allowed because of libel cases that happened abroad, even though Google is protected here. Those kinds of policies proposed by countries with a clear understanding of what they\u2019re willing to regulate media-wise may have an interesting impact here.\u201d<\/p>\n

Even if Section 230 stays in place, and it most likely will, there are ways to reevaluate and reprogram algorithms to make better decisions and circumvent potential biases or discriminatory outcomes before they happen.<\/p>\n<\/div>\n

\n

W<\/p>\n

hile there needs to be more diversity on the teams developing software in order to truly take into account the different number of scenarios an algorithm may have to deal with, there\u2019s no straightforward, cut-and-dried solution to every company\u2019s algorithmic issues. But researchers have proposed several potential methods to address algorithmic accountability.<\/p>\n

Two areas developing rapidly are related to the front- and backend process, respectively, Barocas tells me. The front-end method involves ensuring certain values are encoded and implemented in the algorithmic models that tech companies build. For example, tech companies could ensure that concerns of discrimination and fairness are part of the algorithmic process.<\/p>\n

\u201cMaking sure there are certain ideas of fairness that constrain how the model behaves and that can be done upfront \u2014 meaning in the process of developing that procedure, you can make sure those things are satisfied.\u201d<\/p>\n

On the backend, you could imagine that developers build the systems and deploy them without being totally sure how they will behave, and unable to anticipate the potential adverse outcomes they might generate. What you would do, Barocas says, is build the system, feed it a bunch of examples, and see how it behaves.<\/p>\n

Let\u2019s say the system is a self-driving car and you feed it examples of pedestrians (such as a white person versus a black person versus a disabled person). By analyzing how the system operates based on a variety of inputs\/examples, one could see if the process is discriminatory. If the car only stops for white people but decides to hit black and disabled people, there\u2019s clearly a problem with the algorithm.<\/p>\n

\u201cIf you do this enough, you can kind of tease out if there\u2019s any type of systematic bias or systematic disparity in the outcome, and that\u2019s also an area where people are doing a lot of work,\u201d Barocas says. \u201cThat\u2019s known as algorithmic auditing.\u201d<\/p>\n

When people talk about algorithmic accountability, they are generally talking about algorithmic auditing, of which there are three different levels, Pasquale says.<\/p>\n

\u201cIn terms of algorithmic accountability, a first step is transparency with respect to data and algorithms,\u201d Pasquale says. \u201cWith respect to data, we can do far more to ensure transparency, in terms of saying what\u2019s going into the information that\u2019s guiding my Facebook feed or Google search results.\u201d<\/p>\n

So, for example, enabling people to better understand what\u2019s feeding their Facebook news feeds, their Google search results and suggestions, as well as their Twitter feeds.<\/p>\n

\u201cA very first step would be allowing them to understand exactly the full range of data they have about them,\u201d Pasquale says.<\/p>\n

The next step is something Pasquale calls qualified transparency, where people from the outside inspect and see if there\u2019s something untoward going on. The last part, and perhaps most difficult part, is getting tech companies to \u201caccept some kind of ethical and social responsibility for the discriminatory impacts of what they\u2019re doing,\u201d Pasquale says.<\/p>\n

The fundamental barrier to algorithmic accountability, Pasquale says, is that until we \u201cget the companies to invest serious money in assuring some sort of both legal compliance and broader ethical compliance with personnel that have the power to do this, we\u2019re not really going to get anywhere.\u201d<\/p>\n

Pasquale says he is a proponent of government regulation and oversight and envisions something like a federal search commission to oversee search engines and analyze how they rank and rate people and companies.<\/p>\n

Friedler, however, sees a situation in which an outside organization would develop metrics that measure what they consider to be the problem. Then that organization could publicize those metrics and its methodology.<\/p>\n

\u201cAs with many of these sorts of societal benefits, it\u2019s up to the rest of society to determine what we want to be seeing them do and then to hold them accountable,\u201d Friedler tells me. \u201cI also would like to believe that many of these tech companies want to do the right thing. But to be fair, determining what the right thing is is very tricky. And measuring it is even trickier.\u201d<\/p>\n

Algorithms aren\u2019t going to go away, and I think we can all agree that they\u2019re only going to become more prevalent and powerful. But unless academics, technologists and other stakeholders determine a concrete process to hold algorithms and the tech companies behind them accountable, we\u2019re all at risk.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

\"\" When Netflix recommends you watch “Grace and Frankie” after you’ve finished “Love,” an algorithm decided that would be the next logical thing for you to watch. And when Google shows you one search result ahead of another, an algorithm made a decision that one page was more important than the other. Oh, and when a photo app decides you’d look better with… Read More<\/a><\/p>\n

\n<\/img><\/a> <\/img><\/a> <\/img><\/a> <\/img><\/a> <\/img><\/a> <\/img><\/a>\n<\/div>\n

\"\"\/ <\/p>\n","protected":false},"author":5817,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[25],"tags":[59,66,26],"class_list":["post-339700","post","type-post","status-publish","format-standard","hentry","category-technology","tag-media","tag-techcrunch","tag-technology"],"_links":{"self":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/339700","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/users\/5817"}],"replies":[{"embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/comments?post=339700"}],"version-history":[{"count":0,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/posts\/339700\/revisions"}],"wp:attachment":[{"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/media?parent=339700"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/categories?post=339700"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/people.utm.my\/asmawisham\/wp-json\/wp\/v2\/tags?post=339700"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}