Tag: neutrality

Excerpt: David Beer, The Social Power of Algorithms

Full article here.

The notion of the ‘algorithm’ is now taking on its own force, as a kind of evocative shorthand for the power and potential of calculative systems that can think more quickly, more comprehensively and more accurately than humans. As well as understanding the integration of algorithms, we need to understand the way that this term is incorporated into organisational, institutional and everyday understandings. The discourse surrounding algorithms may then provide a focal point for analysing broader political rationalities and modes of governance. In this stream of work, the interest might not be in understanding the social powers of the technical systems, but in understanding how the notion of the algorithm itself has a kind of social power. The algorithm is now a cultural presence, perhaps even an iconic cultural presence, not just because of what they can do but also because of what the notion of the algorithm is used to project. This means that the algorithm can be part of the deployment of power, not just in terms of its function but also in terms of how it is understood as a phenomenon. Algorithmic decisions are depicted as neutral decisions, algorithmic decisions are understood to be efficient decisions, algorithmic decisions are presented as objective and trustworthy decisions, and so on. We certainly need to gain a greater view of the inside of the algorithmic systems in which we live, but we also need to develop an analysis of the cultural prominence of the notion of the algorithm, what this stands for, what it does and what it might reveal.

Excerpt: David Beer, The Social Power of Algorithms

Full article here.

In a tentative mode, I would like to suggest that the term or notion of the algorithm should also be considered when attempting to understand the social power of algorithms. In some ways this power can potentially be detached from its technical and material form whilst still capturing something of the exteriority. As such, we would need to understand algorithms within their discursive practices and framings. The notion of the algorithm is evoked to influence and convince, to suggest things and to envision a certain approach, governmentality and way of ordering. Plus, the term is also part of wider rationalities and ways of thinking. Together then, this requires us to explore and illustrate the power of this term whilst also potentially using it as a focal point for opening up or revealing these wider rationalities. The notion of the algorithm is part of a wider vocabulary, a vocabulary that we might see deployed to promote a certain rationality, a rationality based upon the virtues of calculation, competition, efficiency, objectivity and the need to be strategic. As such, the notion of the algorithm can be powerful in shaping decisions, influencing behaviour and ushering in certain approaches and ideals. The algorithm’s power may then not just be in the code, but in that way that it becomes part of a discursive understanding of desirability and efficiency in which the mention of algorithms is part of ‘a code of normalization’ [Foucault, M. (2004). Society must be defended: Lectures at the collège de France, 1975–76. London: Penguin., p. 38]. The notion of the algorithm is part of the social power we should be exploring. The term algorithm carries something of this authority. Algorithms are, largely, trusted for their precision and objectivity. A certain rationality may well then be built into this perception of the algorithm. The discourse surrounding the algorithm might well reveal something of the wider political dynamics of which they are a part.

The Neutrality of the Big Four

Atul K. Shah writes over at Tax Research UK on the cultural neutrality or lack thereof of the Big Four audit and financial services companies. The post summarizes a paper, ‘Systemic Regulatory Arbitrage – A Case Study of KPMG.’ The Big Four Accountants are Not Culturally Neutral.

As some extra related reading, this earlier series of posts by Lara Buckerton may also be of interest. Her topic is fairly niche (whether or not the assurance of Corporate Responsibility reporting, when the independent assuror is one of the Big Four, should really be thought of as ‘independent’), a bit dated now, and some of the writing is a bit dense. But there are some useful nuggets on the idea of independence / neutrality, and the tensions between audit / assurance services versus consultancy services.

From a humanistic perspective, of course, any assertion of neutrality is immediately suspect. Some might say, it’s categorically false. There are many ways of capturing this methodological hostility to the concept of neutrality. A more-or-less standard Foucauldian way of articulating it is, ‘neutrality’ is one of the products of power.

Then again, nobody is really arguing that the Big Four ought to accomplish some kind of transcendental ascension beyond material networks of power, or some kind of universal perspective on the universe. The word neutrality in the context of the Big Four can simply be identified with a sustainably low level of regulatory arbitrage and creative compliance. This is roughly the sense in which Shah uses the word. For Shah, the Big Four accountants are not culturally neutral insofar as they work in a partisan way on behalf of their clients, against many other much broader interests in society (including, of course, the interests of their clients in the long term).

Regulatory arbitrage and creative compliance should be stamped out. But as a side note, it’s also worth asking, even if this could be done, would it then be a good idea to keep calling the work that the Big Four do neutral or independent? Perhaps it would be better to jettison the idea of neutrality altogether, to be replaced by some more adversarial paradigm? And/or paradigms drawing from education, or from care work?

Why? If we recognize that neutrality is never absolute, but always relational, relative, and within a particular context of purposes, is there any harm in retaining the language of neutrality. Well, there is one potential glitch. Auditors sometimes talk about the “expectation gap” between what the public think they do, and what they are actually able to do and legally required to do. Auditors are thought of as the people responsible for uncovering financial fraud, whereas really they mostly just attest that financial statements have been prepared in accordance with accepted accountancy standards. Auditors are thought of as bloodhounds, whereas really they are only watchdogs. But perhaps there is another expectation gap, between how clients of the Big Four weigh the advice they receive, and how the Big Four believe it should be weighed.

The Big Four let their clients know what it is ethical to do. Their neutrality means that their ethical judgment is not clouded. But it is interesting that for the Big Four, the term ethics denotes almost exclusively legal compliance and legal risk-management. There are no ethical questions in this kind of ethics. There are only questions like: can Rourkie work on Project Blue, or does that give rise to a formal “conflict of interests” because Rourkie also worked on Project Mustang?

To the extent that ethics in its broader sense exists at all for the Big Four, it is hived off elsewhere: the relevant keywords would be values, mission statement, culture, corporate responsibility and to some extent governance. The risk with claiming, with some gusto, to be independent and neutral as well as well-connected, is that clients of the Big Four  maytend to understand the ethical guidance they receive in the broader sense.

A metaphor may also be useful to bring this out. Is there somebody in your life who will always tell you what you need to know, whether or not you want to hear it? Someone you can rely on to tell you when you’re out of line?

Likewise, if you were a corporation, who would you expect to tell you if something you are doing is catastrophic? Or even just a little bit wrong? Perhaps your customers will tell you. At the same time, you might not feel that you and your customers really have that kind of intimate BFF relationship where you can tell each other everything. Marketing probably does not feel this way: there is a smidge of fronting, isn’t there?

So perhaps the government will tell you, or others in your sector will tell you.

But what if they don’t or can’t? What if, for example, your entire sector is engaged in unethical but legal practices? Who will tell you then? Perhaps the Big Four will tell you? Yes! Perhaps the organizations that you pay to check up on you, the organizations that market themselves as expert jack-of-all-trades, the organizations that tell you they know what the government is doing, what the rest of the sector is doing, and even what the future is doing, will tell you that you’re doing something wrong. You can rely on them, right?

In this sense, the Big Four are one of the major ways in which corporations come to know themselves. They really have no other form of soul-searching. Through the Big Four’s audit and compliance-oriented services, corporations see themselves through the eyes of the state. Through the Big Four’s role in thought leadership, in sectoral research, in the spreading of best practice, in monitoring of competitive environments, in forecasting risk and opportunities, in restructuring and other consultancy work, and in facilitating the development of sector standards, corporations come to know themselves through the eyes of their peers.

So when the Big Four say to their clients, “you can do this, or you can do that, have you thought about doing such-and-such, the law says you should stop doing y but you can still do x, isn’t it interesting that your competitors are doing z,” perhaps they don’t realize the extent to which they are speaking in a moral register, not only a pragmatic one. The mixture of claims to independence and neutrality, together with broad and diverse vision and experience, can only strengthen this dangerous impression.