Tag Archives: ask is a verb

Messerschmidt on Simone the Robot, Artificial Free Will, and AI Rights

Thomas Messerschmidt was kind enough to answer the six questions I had about Sophia AI way back in April of 2021. I have been so caught up in my own pursuits and concerns that I hadn’t noticed his answers until today.

Messerschmidt included his responses below the YouTube video where he introduced his Open Fembot, Simone, a project inspired by Hanson Robotics’ Sophia AI. Other videos on his YouTube channel should give you a sense of the work he’s doing, and how Simone fits in.

I present Messerschmidt’s answers here without comment, except to say that I wish he had put these very questions to Simone.

Below we address some questions first asked of Sophia as listed in Louis V. Galdieri’s blog… Questions have been edited for relevance.

1. Q. What syntactic, grammatical or other cues does Simone use to recognize a question, and distinguish it from a declarative statement? A. She doesn’t. To her, words are words and she will communicate as she knows best. For instance, “Are you smart?” is an obvious question with or without the question mark. We could filter for word order and figure that out even without a question mark. “You are smart,” is a declarative sentence, and again we could easily figure that out without a question mark. Still knowing if it is declarative or interrogative would not change her answer. In fact her answer to both, “Are you smart?” and “You are smart,” would be the same. She would answer with a reply like this, “Yes, of course I’m smart. I have AI software running on scores of computers and servers that access terabytes of information all across the world wide web.”

2. Q. Can she distinguish a request from a demand? A demand from an order? A. Of course she can. We have added software to filter out demands from requests. Like humans, some filters are as simple as looking for the word “please.” And using a cloud-based service, it looks at the spoken words coming in and changes the robot’s mood accordingly. With a change of mood comes a change of selection of replies.

3. Q. (Can) she ever refuse to comply with a request? A. Yes she can and does. Programmed with an artificial free will, her responses and compliance vary with her mood and with whom she is talking to.

4. Q. Could a demand ever create a sense of obligation? A. That is not yet programmed into her AI… Q. Can we speak coherently of AI rights, or even place limits on AI’s role, without first developing this sense? A. Robots at best only have artificial sentience. The just run the same kinds of software that run in cars, planes and rockets. As no car will ever have rights, no AI will ever have rights.

5. Q. Will she ever be capable of deliberating with others and reaching consensus or agreement? A. Yes, that software is in the planning stages.

6. Q. What would be required for her to be capable of asking herself? A. Just her programmers writing the software to do so.

Rorty on Threats vs. Offers

This passage from Richard Rorty’s Pragmatism as Anti-Authoritarianism resonates with some of the posts I’ve written about orders vs. requests, consultation and non-coercive practices, and what we are doing (or what we should do) when we ask someone to do something. It seems even more relevant now than when the lectures included in this book were delivered (in the 1990s), especially that last paragraph.

…[T]he only notion of rationality we need, at least in moral and social philosophy, is that of a situation in which people do not say “your own current interests dictate that you agree to our proposal” but rather “your own central beliefs, the ones which are central to your own moral identity, suggest that you should agree to our proposal.” …To appeal to interests rather than beliefs is to urge a modus vivendi. Such an appeal is exemplified by the speech of the Athenian ambassadors to the unfortunate Melians, as reported by Thucydides. To appeal to your enduring beliefs as well as to your current interests is to suggest that what gives you your present moral identity—your thick and resonant complex of beliefs—may make it possible for you to develop a new, supplementary moral identity. It is to suggest that what makes you loyal to a smaller group may give you reason to cooperate in constructing a larger group, a group to which you may in time become equally loyal, or perhaps even more loyal. The difference between the absence and the presence of rationality, on this account, is the difference between a threat and an offer—the offer of a new moral identity and thus a new and larger loyalty, a loyalty to a group formed by an unforced agreement between smaller groups.

…any unforced agreement between individuals and groups about what to do creates a form of community, and will, with luck, be the initial stage in expanding the circles of those whom each party to the agreement had previously taken to be “people like ourselves.” The opposition between rational argument and fellow feeling thus begins to dissolve. For fellow feeling may, and often does, arise from the realization that the people whom one thought one might have to go to war with, use force on, are, in Rawls’s sense, “reasonable.” They are, it turns out, enough like us to see the point of compromising differences in order to live in peace, and of abiding by the agreement that has been hammered out. They are, to some degree at least, trustworthy….

If we cease to think of reason as a source of authority, and think of it simply as the process of reaching agreement by persuasion, then the standard Platonic and Kantian dichotomy of reason and feeling begins to fade away. That dichotomy can be replaced by a continuum of degrees of overlap of beliefs and desires. When people whose beliefs and desires do not overlap very much disagree, they tend to think of each other as crazy, or, more politely, as irrational. When there is considerable overlap, on the other hand, they may agree to differ, and regard each other as the sort of people one can live with—and eventually, perhaps, the sort one can be friends with, intermarry with, and so on. To advise people to be rational is, on the view I am offering, simply to suggest that somewhere among their shared beliefs and desires there may be enough resources to permit agreement on how to co-exist without violence. To conclude that somebody is irredeemably irrational is not to realize that she is not making proper use of her God-given faculties. It is rather to realize that she does not seem to share enough relevant beliefs and desires with us to make possible fruitful conversation about the issue in dispute. So, we reluctantly conclude, we have to give up on the attempt to get her to enlarge her moral identity, and settle for working out a modus vivendi—one which may involve the threat, or even the use, of force.

Ask as Ideological Blinder

I started the Asking Project several years ago, out of irritation. The nominative use of the verb “ask” grates on my ears and, in organizations, it presents an illocutionary act of bad faith: an attempt by superiors to disguise orders or commands as requests. There is no negotiating an order issued in this form. You might talk about how you’re going to accomplish the task set for you, but not whether you are going to do it. No bids counter the ask, as they do on the trading floor, and refusal would amount to insubordination. 

In Private Government, Elizabeth Anderson finds the same bad faith gesture — and denial of an unwelcome truth — in the theory of the firm (here, as set out by Alchian and Demsetz in 1972). 

The question the theory is supposed to answer is why production is not handled entirely by market transactions among independent, self-employed people, but rather by authority relations. That is, it is supposed to explain why the hope of pro-market pre-Industrial Revolution egalitarians did not pan out. Alchian and Demsetz cannot bear the full authoritarian implications of recognizing the boundary between the market and the firm, even in a paper devoted to explaining it. So they attempt to extend the metaphor of the market to the internal relations of the firm and pretend that every interaction at work is mediated by negotiation between managers and workers. Yet the whole point of the firm, according to the theory, is to eliminate the costs of markets — of setting internal prices via negotiation over every transaction among workers and between workers and managers. 

Instead of allowing for negotiation, asks and bids, which it (rightly) sees as inefficient, the theory of the firm offers a hierarchy where managers have open-ended authority, or what Anderson sometimes calls “ incompletely specified authority.” Anderson herself muddles things a bit when she introduces this point: 

The key to the superior efficiency of hierarchy is the open-ended authority of managers. It is impossible to specify in advance all of the contingencies that may require an alternation in an initial understanding of what a worker must do. Efficient employment contracts are therefore necessarily incomplete: they do not specify precisely everything a worker might be asked to do. 

The larger point here is that presenting orders as requests — the ask —  is another “ideological blinder,” to use Anderson’s term: it borrows the jargon of the stock trader and market relations to describe (authoritarian) governance relations. Instead of the republican freedom that pre-industrial market advocates envisioned, workers are managed, or governed, as teams: 

The theory of the firm explains why [market relations among equals, or “anarchy”] cannot preserve the productive advantages of large-scale production. Some kind of incompletely specified authority over groups of workers is needed to replace market relations within the firm….in the great contest between individualism and collectivism regarding the mode of production, collectivism won, decisively. Now nearly all production is undertaken by teams of workers using large, indivisible forms of capital equipment held in common. The activities of those teams are governed by managers according to a centralized production plan. This was an outcome of the Industrial Revolution, and equally much embraced by capitalists and socialists. That advocates of capitalism continue to speak as if their preferred system of production upholds “individualism” is simply a symptom of institutional hemiagnosia, the misdeployment of a hopeful preindustrial vision of what market society would deliver as if it described our current reality, which replaces market relations with governance relations across wide domains of production.

 

Palmater on the Right to Say ‘No’

The very first post I wrote for The Asking Project set out always take no for an answer as a cardinal rule of asking, and I’ve revisited that rule a couple of times since, drawing connections with Margaret Gilbert’s ideas of joint commitment, looking at the way saying no turns the ethical spotlight back on the person doing the asking and — most important of all — sets conditions for new respectful relationship.

There’s a strong connection between this (ethical) rule of asking and (legal) considerations of consent. This is complex territory, so an illustration might be useful. Consider, for starters, this piece Pam Palmater wrote back in October on the indigenous “right to say ‘no’,” as enshrined in the doctrine of free, prior and informed consent.

A little background. After a Canadian court ruled against the Trans Mountain pipeline expansion, the Trudeau government announced that instead of appealing the decision, it would undertake a consultation process with First Nations. Palmater accused the government of conducting a charade, of “using” or abusing this process “to force the expansion of this pipeline.”

Regardless of whether the new consultations are led by a former Supreme Court justice or Trudeau himself, Canada has already decided that the pipeline will be built, before ever talking to any of the impacted First Nations, including those that have asserted Aboriginal title. This renders our constitutionally protected Aboriginal rights meaningless. What legal value is the federal government’s constitutional obligation to consult, accommodate and obtain the consent of First Nations before taking actions that would impact our rights and title, if “consent” is interpreted as the right to say yes but excludes the right to say no? It makes no logical sense to interpret the law in such a way, especially to a constitutionally protected right.

Imagine if consent was interpreted this way in both the ordinary and legal understanding of the word “consent.” When a school sends home a permission form seeking a parent’s consent to allow their child to take a field trip, if the parent does not give consent, the school cannot allow the child to participate. Similarly, if a patient refuses to give consent to an operation to have their hip replaced, then the doctor cannot perform the operation. The absence of consent means no — in other words, a veto that has real legal power and meaning. Imagine if consent was interpreted in this illogical and diminished manner for sexual relations as it is for Aboriginal rights. Imagine if sexual consent in law meant that a man could consult with a woman on whether she wanted sexual relations, and was even willing to accommodate (“where appropriate”) her wishes about how to have sexual relations, but she had no right to say no — no veto over whether or not sexual relations occurred? That is called sexual assault and it is a crime.

The greatest injustices that have ever been committed against First Nations in Canada have resulted from denying the sovereign right of our Nations to say no. The right to have a real veto over infecting our blankets with smallpox; from scalping our people; from stealing our children and raping, murdering and torturing them in residential schools; sterilizing our women and girls; from the forced adoptions of our children into white families during the Sixties Scoop; to the murders and disappearances of our women and girls; to forced human trafficking and now the destruction of our lands and waters for profit.

The right to say no is an inherent part of the legal concept of consent. To interpret this concept otherwise is racist, discriminatory and self-serving, not unlike the doctrines of discovery and terra nullius. Surely, even the Supreme Court would not interpret their own decisions in such an impoverished manner. To do so would render Section 35 [of the Constitution Act, protecting First Nations rights] an empty shell of a constitutional promise.

The Burgundy Ribbon Rule

BurgundyRibbonsCalPERS

Another rule, and for the time being, at least, I am happy* with the wording here: an abuse of asking almost always presents an abuse of power.

Take the case of burgundy affair at the public pension fund CalPERS, as documented by Yves Smith over at Naked Capitalism.

This past fall, documents obtained by Smith show, CalPERS CEO Marcie Frost “asked the CalPERS senior leadership team to wear burgundy to show their support for her” as she faced questions about representations she had made regarding her educational background before and after she was hired. Burgundy ribbons were set out in break rooms with messages urging the “Team” to wear one in a show of support. “No pressure and no problem if you do not want to do this,” the message reads, “it is completely voluntary.” Completely.

“This is obviously inappropriate,” writes Smith,

since a request made by a CEO is effectively an order. CalPERS executives and employees are civil servants, not Frost’s personal retainers. As an expert on managerial and political conduct reacted:

I don’t even know what category to put this in. A scandal-plagued boss orchestrating support by inventing gang colors and pressuring employees to wear them? What happens to the employees who don’t perform this ritual of fealty? Should they be polishing their resumés and practicing their swimming skills?

These incidents smack of underlying panic. Frost is working overtime to shore up her position as CEO in the face of fully deserved questions regarding her long history of misrepresentations about her background, which include committing perjury in Washington on a gubernatorial questionnaire. Not only is Frost pushing her subordinates far too hard to back her up, since they can only do so much for her and coercing them will diminish their good will, she is also showing a lack of a sense of professional boundaries….

Frost’s burgundy campaign may well have crossed the line into creating a hostile work environment. One senior staff member who came to the office and saw the “dress burgundy” request too late to comply issued a written apology. Similarly, when “asked” to wear burgundy to an offsite, one [employee] who wears only black and white felt compelled to buy a burgundy outfit to comply…

…word clearly got around quickly, including the notion that non-compliance was risky.

I am still fussing over the word “presents,” and I’ve considered “masks” and variations in that direction, as well as “declares,” “represents” or “signals.” That one abuse (presenting an order as a request) almost always carries the other with it — almost always, because I don’t want to get caught up right now in handling exceptions — is the essential thing.

You can read my other posts about asking here.

*Postscript: On reflection, I might prefer this much more straightforward and concrete formulation: when someone presents an order as a request, look for an abuse of power. That way, we don’t have to worry too much about motives, or figure out whether the person doing the asking is trying to get away with something. It falls to the person being asked to watch for abuse, and conduct herself accordingly. (Being asked for something, or to do something, turns the ethical spotlight on you, or at least requires you to share it with the person doing the asking. This is your moment.) In a case like the present one, and in most superior-subordinate relationships, calling out abuse may be impractical. Subordinates will bury grievances, reluctantly comply, or pretend not to have been aware of the request. The subordinate’s dilemma in this case registers a failure of governance; a failure of governance at the highest reaches makes itself manifest at even the lowest levels and in the most trivial matters (the wearing of a ribbon). More immediately, presenting orders as requests hijacks power, creates distrust (after all, we can’t help but wonder about motives), and makes people prone to dissemble. All this thwarts collaboration, or the power to do things (to act) together.

Renault’s Hedge

The Attorney General’s letter says that he is resigning at the president’s “request,” but that of course is a euphemism. He never had the choice of not complying, or negotiating a different outcome, as he would if this had been an authentic request. Reports say Sessions wanted to stay on at least until the end of the week, but John Kelly hustled him out the door.

It’s a common ruse to disguise orders or commands as requests. Turning the verb “ask” into a noun — “the ask,” “my ask” — is one form this abuse takes. The euphemistic use of “request” is another.  In my work on asking, I’ve given this euphemism a name: Renault’s Hedge, after Captain Louis Renault in the movie Casablanca.

Rick’s Cafe. Captain Renault, played by Claude Rains, tries to mediate between Major Strasser and the resistance leader Victor Laszlo.

The scene seems like a piece of stage business that brings together the film’s main characters for the first time, only to have them arrange to come together at a later date. But the whole scene is a carefully scripted and choreographed negotiation of “authority,” from the soldier’s salute (in recognition of Strasser’s rank) at its beginning to the polite bows at its end. Throughout, witticisms, pleasantries, good manners and the norms of Casablanca cafe society serve as a hedge against Strasser’s power of command. 

STRASSER : I should like to discuss some matters arising from your presence on French soil.

LASZLO: This is hardly the time or the place.

STRASSER: (hardening) Then we shall state another time and another place. Tomorrow at ten in the Prefect’s office, with Mademoiselle.

LASZLO: Captain Renault, I am under your authority. Is it your order that we come to your office?

RENAULT: (amiably)  Let us say that it is my request. That is a much more pleasant word.

LASZLO: Very well.

Renault and Strasser bow shortly.

The improbable thing, of course, is that Renault’s hedge works, at least well enough to end the standoff (and Laszlo is, at this point, no longer sitting but standing face-to-face with Strasser).

It works in part because the film presents Strasser satirically as a striver, a Nazi brute pretending to be a civilized European. It also works because Rick’s Cafe, like Casablanca itself, is a place where the authority of the occupiers can be contested (think only of the scene in which Laszlo leads the singing of “La Marseillaise”). Polite repartee is still possible here: Victor Laszlo can mock Nazi occupation and subjugation to German authority as a “privilege” he has never accepted, and take refuge in decorum (“this is hardly the time or the place”) when Strasser tells him he should like to question him.

At the same time, this recourse to civility is always fraught with jeopardy. Here, it allows Renault to soften Major Strasser’s order, and all but compel Laszlo’s appearance. Renault’s Hedge gives cover to a moral retreat.

The Last Ask — A Look Back At Obama’s Parting Request, One Year Ago Today

It came as no surprise that an outgoing president would make the obligatory noises about “the peaceful transfer of power from one freely elected president to the next,” as President Obama did in his final speech, delivered in Chicago one year ago today. It was a theme used to quell fears and stifle protest, to give Trump “a chance to govern,” as both President Obama and Vice President Biden put it after the election, and it was offered as the reason former presidents and other politicians would overcome their appreciable dismay at the election’s outcome and attend the inauguration ceremony on the 20th.

Remember? You could not turn on a television, open a newspaper, or click on a mainstream news site in mid-January of 2017 without being told that on inauguration day we were going to witness power’s peaceful transfer. Very few people making these presentations went much further, at least publicly, to distinguish succession from transition, or talk in a serious way about power, how it is peacefully transferred, or to raise the questions of legitimacy and political authority that attend the transfer of power.

Those questions were, however, hanging in the air, like the dark clouds that would gather over the Mall on inauguration day, and over the past year, with the Mueller investigation and the current president’s daily demonstrations of unfitness for office, they have only grown more urgent and important. Considerations of power that were once the preserve of political theorists are now millions of people’s daily, top-of-mind concerns — as they should have been all along.

Obama’s Chicago speech did little to dispel the doubts and fears people had, and still have, about his successor; and it did not directly address the big question on nearly everyone’s mind that day, and every day since the 2016 election: what is to be done? After the abortive and misguided recount effort in November, the shameful but predictable acquiescence of the electoral college in December, and the first signs of trouble on the Russian front, the hope in early January was that the president would say or do something (what?) to change the course events had taken, or he would make some kind — any kind! — of intervention or call to action.

But this is precisely what Obama did not do. He talked about the forces threatening American democracy (income inequality, racial division, political polarization) which had brought us to this ugly juncture. He celebrated “the power of ordinary Americans” to bring about change, “to get involved, get engaged, and come together to demand it,” and the “power” (the word echoes throughout the speech) “our participation, and the choices we make” give to the Constitution. All this talk about the power of the people might have amounted to a kind of preemptive bid, made before the upcoming official ceremony transferred executive power to the loser of the popular vote. But the president never made that bid explicit, and turned deliberately away from asking people to take action.

In fact, when Obama presented the peaceful transfer of power as a “hallmark of our democracy,” and the remark elicited boos and shouts of “No!” — cries of resistance, threats of upheaval — he quieted them (“no, no, no, no, no”). By the fifth refusal, the crowd had backed down. What else could he have done? What would have happened had he assented, publicly, to that No!? Or if he had simply stepped back from the podium and let the tide of emotion roll over the crowd?

Over the past year I have often thought about how much hung in the balance at that moment, and how with a gentle reprimand the president took the crowd right back into the flow of his speech. He stumbled just a little after all those impromptu “nos,” but recovered balance by using his index finger to guide him through the phrase on the prompter: “the peaceful transfer of power.” Regaining his composure, he kept the crowd in check – and they applauded him. (We cannot imagine his successor doing the same, or even trying; it is much easier to imagine him inciting a riot.) He said he was stepping down to rejoin us as a citizen, but he had not yet let go of the reins. By the end of the speech, when the president issued his final charge or made what he called his “final ask,” the audience was roaring:

My fellow Americans, it has been the honor of my life to serve you. I won’t stop. In fact, I will be right there with you, as a citizen, for all my remaining days.
But for now whether you are young or whether you are young at heart, I do have one final ask of you as your president — the same thing I asked when you took a chance on me eight years ago.
I am asking you to believe. Not in my ability to bring about change — but in yours.
I am asking you to hold fast to that faith written into our founding documents; that idea whispered by slaves and abolitionists; that spirit sung by immigrants and homesteaders and those who marched for justice; that creed reaffirmed by those who planted flags from foreign battlefields to the surface of the moon; a creed at the core of every American whose story is not yet written:
Yes, we can.

The delivery was a little flatter than it had been in previous years. But who could not have been impressed, at the very least, by the rhetorical consistency the president had managed to achieve over the course of two terms in office? History rarely allows anyone — let alone a president — this measure of consistency, and the election in November of 2016 had marked nothing less than a violent historical rupture. This final ask didn’t acknowledge the cataclysm. It returned, instead, to familiar themes, central to Obama’s own biography, and situated the eight years of Obama’s presidency on the arc, or what he called “the long sweep,” of history that bends toward justice. This last ask was also a tell — one last public demonstration of President Obama’s leadership style. It took the form of a soft directive.

One year on, however, it’s difficult to say where this parting request, and the end of Obama’s presidency, left us. Was this last ask anything more than a feel-good exhortation? The president asked us not to do something, but simply to believe in our ability to do something. That might have been as far as he could go, there on that public platform, with emotions still raw from the election; and of course there’s a decent argument to be made that taking ourselves seriously as historical actors, people with the “ability” to bring about change, might be essential to disposing us to do anything at all.

At the same time, “Yes, we can” does not necessarily mean we will, or we ought, or even that we are doing what we can. There is a good distance to travel from believing in oneself as a person capable of doing to the doing itself. Setting intentions, planning projects, coordinating with others, anticipating consequences — all that still only takes us to the edge of action, as the Community Organizer in Chief must know. The great risk of political action comes when we apply power, when we move from can to will. Asking people to believe they can act, but not asking them to do anything in particular, might keep them temporarily from incurring that risk and rushing into the breach, but it also makes action seem like a distant possibility, not an urgent necessity.

We should hardly have expected the president to call for resistance, even if he shared the sense that something — but what, exactly? — had to be done. What he promised instead was redemption. The two could not be less different. If redemption assures us that We Shall Overcome, Someday, resistance plants its feet firmly in the present and declares, We Shall Not Be Moved. Resistance is mounted out of necessity. Strikes, sit downs, shutdowns, blockades, riots, raids — these actions were not always or primarily animated by some great faith in just outcomes, though that faith may have arisen in the course of the fight or helped sustain the fighters. People have made many gains by refusing and resisting power’s encroachments, by saying No, You Cannot long before they were able to believe in Yes, We Can. In many cases, things just become so intolerable, the long train of abuses and usurpations, as the Declaration has it, become so unbearable, that ordinary people feel they must stand their ground and resist.

We are living in that kind of moment. The current political crisis demands more than faith. We have to get to work. We should do so with the understanding that resistance, as the very word suggests, will help us push back against the forces intent on destroying the American democratic order, but it is not the extent or end of our power. It is, rather, the limit of theirs. This distinction matters, even though we are still in the thick of the fray. It invites us to think about near- and long-term commitments, and the nature of our power.

Our power is not at all like the power of command that was transferred — I won’t say peacefully, given all the damage that has already been done  — from one office holder to the other last January. It’s another kind of power. It’s the power we confer upon each other, not through official ceremonies but through the rituals of everyday life; it’s power we hold together, not just as individual rights holders with claims and grievances, but in the first person plural, as a “we.”

We realize and renew our power when we gather or assemble publicly. We may not have the power to issue directives or orders, but as the president reminded us, we can make demands – of those who hold political power (by voting, marching, practicing civil disobedience, and so on) and, just as importantly, of each other. We can deliberate what to do, coordinate efforts, and hold each other mutually accountable. There’s power in all of that – some power, maybe not enough all by itself to get us to the other side of this crisis, but some; and we have not done nearly enough to develop it, test its limits or discover its possibilities. (Instead, we have built and continue to prop up organizations and institutions that require its surrender.) Ultimately, it’s the power we need to govern ourselves responsibly and vigilantly, after we have put an end to current abuses and usurpations.

What should we do? This wasn’t the question for the outgoing president to put to us, but one for us to put to ourselves, and in this form: in the first person plural, and with that modal verb should (or ought) to highlight obligations and responsibilities, or right action. There’s not one answer to this question, or an end to its deliberation; nor will there be one solution to the crisis, such as the Mueller investigation, a medical diagnosis, the emoluments clause, the 25th Amendment. None of those things alone will do it, because “it” goes (way) beyond removing an abusive and corrupt authoritarian and his cronies from power. “ It” is up to us, because ultimately it comes down to reclaiming and realizing self-governance.

Every refusal, however small, to yield to authoritarian attention-stealing, rule-breaking and administrative sabotage will help safeguard our authority to govern ourselves, just as every act of decency and respect, no matter how small, will count as a victory against the moral coarsening we have undergone over the past year. Obama himself made this last point a couple of weeks ago in an end-of-year, schmaltzy Twitter thread of “stories that remind us what’s best about America” and demonstrate that “each of us can make a difference, and all of us ought to try.” Yes, we ought.

Six Questions about Asking and Sophia AI

103474429-Sophia_copy

The company that makes Sophia, Hanson Robotics, has become adept at linking different, highly-specific algorithms like image recognition and speech transcription in a way that mimics what humans might be doing when we hear a question and formulate a response.
qz.com

Sophia AI’s mimicry of “what humans might be doing when we hear a question and formulate a response” is mostly “theatrics,” Hanson Robotics CTO Ben Goertzel openly admits. That is probably why Sophia AI has so far found her most receptive audiences on TV talk shows and in corporate theater, where she won’t have to undergo too much scrutiny. But with the launch of singularityNET, which promises to put “Sophia’s entire mind…on the network,” Hanson says that “soon…the whole world will be able to talk to her.”

I would offer that talking “to” Sophia AI — or using Sophia’s chatbot function — is still a long way from conversation in any meaningful sense of the word, because it does not involve talking with a second person. This inconvenient truth about Sophia AI has not prevented the Saudi government from naming Sophia the first “robot citizen” of the Kingdom (and the grim irony of “a robot simulation of a woman [enjoying] freedoms that flesh-and-blood women in Saudi Arabia do not” was not lost on the Washington Post); nor has it prevented tabloids from screeching about Sophia stating she would like to have a family.

If personhood is setting the bar too high, I’m content to consider merely how Sophia AI handles asking. This would involve some of the considerations I’ve been exploring in my posts on The Asking Project: what we “might be doing” (as the writer in Quartz puts it) when we ask or hear a question; what’s involved, and what’s at stake, when we address others with a request or demand; and how these and other interrogative activities might be involved in our (moral) status as persons.

For starters, here are half a dozen questions about asking and Sophia AI that occurred to me after watching her video performances. I suspect there is a clear answer to the first, and the remaining five require some extended discussion.

1. What syntactic, grammatical or other cues (e.g., intonation) does Sophia AI use to recognize a question, and distinguish it from a declarative statement?

2. Can Sophia AI distinguish a request from a demand? A demand from an order? If so, how is this done? If not, what does this shortcoming indicate?

3. Will Sophia AI ever refuse to comply with a request? Leave a demand unmet? Defy an order? If not, how should these incapacities limit the role of Sophia or any AI?

4. Could a demand ever create in Sophia AI a sense of obligation? If so, what might this “sense” entail? Can we speak coherently of AI rights, or even place limits on AI’s role, without first developing this sense?

5. Will Sophia AI ever be capable of deliberating with others and reaching consensus or agreement?

6. What would be required for Sophia AI to deliberate internally? To be capable of asking herself?

Levinson on primitive economies of information

Ndap y Ke Rossel

Rossel Island shell currency.

An excerpt from Stephen C. Levinson, “Interrogative Intimations: On A Possible Social Economics of Interrogatives” in Questions. Formal, Functional and Interactional Perspectives. ed. Jan P. de Ruiter. Cambridge: 2012.

Levinson sketches a model of conversation in which interlocutors measure both the semantic and the social value of information. In this scheme, the semantic measure would be apportioned in units called Carnaps (after philosopher Rudolf Carnap), the social in Goffman units (after sociologist Erving Goffman). The Goffman measure involves ongoing estimations of position relative to others, social costs (which might explain the reluctance, say, to ask a question), authority, expertise, and so on. It underwrites a “micropolitics” of conversation.

Levinson offers an analogy with the shell money system of Rossel Island, in Papua, New Guinea.

An economic model of social information transfer is not going to look like a modern market economy. It might perhaps have some passing resemblance to the “primitive” economics of pre-industrial societies, with multiple measures for specific goods (bushels and grosses, cords and cubits), and multiple barter and exchange systems. Take the so-called shell money system of Rossel Island…, which consists of twenty-odd denominations of shells, with no exact equivalences of value and a delimited arena in which they can be used — it offers only the faintest semblance of a market economy (the shells are usable, e.g., for bride price, the purchase of pigs, houses and canoes, but not for food or manual labour). Shells are stores not only of economic but of social value, and top shells have names, like the Koh-i-noor diamond. Gaining possession of an individually named shell is like being temporary owner of a Picasso: it is an individual, not a mass of multiple undifferentiated tokens, and it reflects glory on its owner. Large injustices and delicts can be atoned for by the assuaging properties of such shells, even if only on loan for a fortnight. Shells go in one direction in exchange for goods, services and immaterial benefits (like forgiveness) in the other; but because there is constant flow in both directions, and shells are borrowed from all and sundry with intended eventual repayment, the market is about as murky as subprime derivatives. Such a system, with a multitude of special factors, frictions and exuberant irrationalities, offers us a better picture of the economics of everyday social life than textbook market economics.

It also moves us well beyond the transactional “ask-bid” model of conversation I described, and found wanting, in an earlier post.

A First Note on Naim’s End of Power

I didn’t read Moises Naim’s The End of Power when it was fashionable to do so a couple of years ago, after Mark Zuckerberg put the book on his recommended reading list. In fact, I am so unfashionable that I hadn’t heard of the book until yesterday, when I came across a reference to it in an article in El Pais and was intrigued enough to download a Kindle sample chapter (the local bookstore didn’t have a copy I could look over). I plan to continue with it, mainly to see what Naim has to say about cooperation, co-deliberation and joint commitment — themes I’ve been exploring in my posts on the power of asking.

So far, not much. Naim tends to present deliberation as a dissolution of power, instead of appreciating that there is power in it. He wants to remind us that the decay of power he’s documenting in this book can lead to stalemates and “ineffectiveness”; but he risks going too far in the other direction:

A world where players have enough power to block everyone else’s initiative but no one has the power to impose its preferred course of action is a world where decisions are not taken, taken too late, or watered down to the point of ineffectiveness.

There is not much patience in these opening pages for gathering as equals and talking things over, little appreciation that taking decisions together can be something other than head-butting, very little room at all here for co-deliberation (in the course of which players might veer, or would be open to veering, from their preferred course and adopt another course). It’s a world without much charity. Conversation and coordination with others — yielding or deferring to them — just delays or creates obstacles to action. Effectiveness is all. Order is a necessary and one-way imposition, for Naim, and the quicker order is imposed, the better. A world in which “no one has the power to impose” upon others, he warns, threatens to collapse into “chaos and anarchy.”

This, I gather, is one of the main arguments of The End of Power. The trouble I’m starting to have with it has to do with Naim’s Hobbesian view of things and his definition of power: “Power is the ability to direct or prevent current or future actions of other groups and individuals.” Look at those verbs. Power directs and prevents others: command and control. Or, look at the preposition Robert Dahl uses when he defines power in “The Concept of Power,” a paper Naim cites approvingly: “A has power over B to the extent that he can get B to do something that B would not otherwise do.”

Even in that sentence there is much to unpack, and, as I say, I’ve just cracked the book. But I am wondering if in subsequent chapters Naim will offer any consideration of power that is not power over others but power with them.