Ian Bogost, discovery, and why Dave Winer was right

Inspired by the most recent twitter hack, Ian Bogost wrote this week in The Atlantic about the failings of decentralization. I was struck by one passage:

“Twitter isn’t just a place for memes or news, or even presidential press releases meted out in little chunks. It’s where the weather service and the bank and your kid’s school go to share moment-to-moment updates. Though seemingly inessential, it has braided itself into contemporary life in a way that also makes it vital.”

The thing is, you don’t need a central site to collect these moment-to-moment updates. RSS has been around for longer than Twitter. There used to be little RSS buttons on lots of web sites. What would our online world look like if Google hadn’t killed Google Reader and RSS had hung on.

It occurs to me that inadequate discovery tools were the hole in the decentralized internet. Google got its foot in the door of the web by solving the search problem. Once that was centralized, Google ( and then Facebook, and then Twitter) , bit by bit, centralized everything else. Was there a way to make finding things less centralized. Is there one today as we look at web alternatives like Dat or IPFS?

Who imagined epistemology would be cyclical?

I am eager to read Mark Pesce’s new essay , “The Last Days of Reality“.  Unfortunately it’s subscriber only at the moment. You can listen to his talk at one of the launch events. At first glance the notion of reality ending used to seem to be a stretch. Now we have “fake news” and Vox writing about epistemic crisis.

Technology has now gotten so advanced , it can obscure standards of truth, whether that’s changing the weather in a picture or the text of an audio.  What happens to truth when images and audio are no longer authoritative?  We actually have an idea of the answer to that question, thanks to the past.

James Burke described the opposite transformation in episode four of The Day the Universe Changed, “A Matter of Fact.” The episode begins with a description of epistemology prior to the printing press.  Burke argues that truth, in a mostly illiterate society, was grounded in relationships. Something was true because someone you trusted said it was.  Burke points out that this epistemology is preserved in things like oral personal testimony in court. He then goes on to explain how printing changed that.

Is it possible that “everything old is new again?” We see this in the way social media has changed news consumption.  More and more of the news we see comes from the things our friends bring to our attention.  Our news world comes from the people we trust.  Sound familiar?

There’s of course a huge difference in this model now and how it worked hundreds of years ago.  In the middle ages, most people communicated face to face.  You knew that your source was who they said they were because you looked them in the eye, with a few notable exceptions like Martin Guerre. Today, things aren’t that simple. Given the relative lack of encryption in person to person communications, there are few assurances that the email, tweet or facebook comment comes from the person who is its alleged author.  It’s possible that improvements in usable encryption will make it easier to verify identity online. If we are going to rely on relationships for our personal reality, this sort of verification is very important. Even if verification improves, what if , as Vox alleges is already happening, there are no shared authorities?



Meeting the General Education Computer Requirement with a Course on Technology and Society

For a number of years, college and university general education requirements have , at many institutions, included some sort of mandatory course on computers and technology.  Several decades ago when I met the requirement, I did so by completing a course that was mostly about how to use AppleWorks.  These days, students are more likely to use Microsoft Office and various web applications.  If we are educating our students for citizenry, that’s not good enough anymore.

For the last couple of years, I’ve been thinking about what I want my children to know about computers, technology, and the net, and I’ve decided that it’s not MS Office.  It’s not even how to code. Instead what I want them and everyone to learn about is how technology is changing our society.

As a thought exercise, I’m going to set down in writing a sketch of what such a course might look like.  I haven’t done much comparison research, and I’m sure some other institutions have already created such a course.  Nevertheless, here it goes with  a topic list and some suggested readings:

A Brief history of networked, decentralized , and recentralized computing.

A Declaration of the Independence of Cyberspace – John Perry Barlow
The Web We Lost
– Anil Dash (Video)
“Reclaiming the Internet” with Distributed Architectures: An Introduction – Francesca Musiani and Cécile Méadel
The Mission to Decentralize the Internet – Janus Kopfstein


Big Data: It’s Worse than You Thought – Frank Pasquale
Weapons of Math Destruction – Cathy O’ Neil
We’re Building a Dystopia Just to Make People Click on Ads – Zeynep Tufekci (video)


The Trust Machine – The Economist

Data Collection and Surveillance

Snowden and the Future – Eben Moglen


Don’t Panic: Making Progress on the “Going Dark” Debate – Berkman Center for Internet and Society, Harvard University
The Case Against a Golden Key – Patrick Ball

The Control of Technology and the Technology of Control

Lockdown: The Coming War on General-Purpose Computing – Cory Doctorow
Twitter and Tear Gas – Zeynep Tufekci

I recognize that many of my sources here have a leftward lean. Does anyone have suggestions for:

  1. Writers who are more politically conservative but have a good understanding of the capabilities and limitations of technologies?
  2. Topics and/ or resources I should have included but didnt?

Aggregating the Decentralized Social Web

In the wake of recent FCC plans to repeal net neutrality regulations, people are starting to talk about decentralization, both of infrastructure and of the platforms we use to communicate on the Internet.  The latter has moved more quickly than the former, since it’s arguably easier to write code than to lay fiber optic cable.  In the last few months, I’ve experimented with :

  • Mastodon
  • Beaker Browser
  • GNU Ring
  • Matrix
  • ZeroNet
  • RetroShare
  • Twister
  • Patchwork (SSB)
  • Friendica

Note that those indicated in italics are more web replacement than social network platform.

That’s quite a few apps to open regularly.  Wouldn’t it be nice to aggregate this content so you could follow everything from one app. There have been some attempts at this (seesmic/tweetdeck/etc.) aimed at the major commercial social networks, but , since feeding into an aggregator undermines the revenue model of the social network (remember how Twitter used to support RSS?) they were either acquired or left to wither. Since decent platforms don’t have a revenue model to protect, why can’t they be more aggregation friendly? Mike Caulfield suggested that smartphone OS’s were functioning as aggregators via notifications.

There are actually three problems to solve, reading, which is relatively easy,  posting, which is harder, and social graph management, which is quite complex

Reading various streams in an aggregator would be most easily accomplished if various decentralized platforms would support stream output as password protected RSS.  Twitter was on the right track before revenue growth got in the way.  Subscribing to my personal timeline(s) with my favorite RSS reader would bring everything together, especially if I had a reader that listed items chronologically independent of source.  The potentially difficult part is dealing with and indicating private v public messages.

Posting is more challenging.  Not only does the client need to implement correctly the API’s of various platforms and keep track of what options and constraints to present to a user depending on which platforms they were posting to.  It looks as if Withknown has made some progress in this area with syndication plugins.

Managing your social graph is sort of the next level.  One of the disadvantages of centralized social networks is that Twitter/Facebook/etc. maintain your social graph and can therefore mine it for data and monetize it.  Several years ago, VR celebrity Mark Pesce (famous for his invention of VRML) did some development on Plexus, software that he described as “plumbing for the social web.”  The premise here was that your social graph would live on your device.  This would be possible because you would create multiple accounts on each social network, one for each friend/follower relationship.  Highly compartmentalizing your social presence is good for privacy but makes discovery more challenging, as software on your end has to parse your streams and sort out connections on your social graph.

How do we decentralize the web without so decentralizing our own social presence that it becomes unmanageable?

Weapons of Math Destruction Part 4

These chapters (actually they were last week’s) cover employment . Here’s Bryan’s prompt.

On the hiring side, I’m not sure whether algorithmic arbitrariness or human arbitrariness is worse.  I have a sense that, distinct from the expected biases (ethnicity, gender, geography/wealth)  algorithms might bias for similarity.  That is, they bias against candidates who have the larger skills to do the job, but whose previous job titles or majors aren’t a close word for word match for a job description.  Of course humans might be just as likely to have that bias, but a human, if they wanted to think “outside the box”  could at least be metacognitively aware of it.

I found the next chapter “Sweating Bullets”  more alarming. The core of the problem is that outside of widget production for a factory worker or sales volume, the link between what an individual worker does and an institutional KPI is often tenuous.  My instinct is that bad algorithms full of second or third order proxies make this much worse that a human based system with safeguards (such as something like 360 evaluation)

Did anyone else find the sociometric badge used in the call center (132)  seriously creepy?

As to one of Bryan’s questions, about whether boycotts can provide a meaningful check on this sort of thing, it seems to me it might work in the public sector where transparency can be enforced via FOIA, but I have little hope for the private sphere.  Boycotts sound good, but are rarely well enough organized or maintained to provoke real change.

Notes and Quotes

“…we’ve seen time and again that mathematical models can sift through data to locate people who are likely to face great challenges, whether from crime, poverty, or education. It’s up to society whether to use that intelligence to reject and punish them — or to reach out to them with the resources they need.” (118)

“The root of the trouble, as with so many other WMD’s, is the modeler’s choice of objectives. The model is optimized for efficiency and profitability, not for justice or the good of the ‘team.’  This is, of course, the nature of capitalism.” (129-130)

I was struck the other day by how similar Cory Doctorow’s whuffie system (from Down and Out in the Magic Kingdom), the rating system in the Black Mirror episode “Nosedive” and the Chinese social credit system I described in last week’s post are.

Weapons of Math Destruction Part 3

Here’s last week’s prompt for the Weapons of Math Destruction Book Club, I have chosen to ignore the provided questions, however. (Sorry, Bryan)

My big takeaway from these chapters is the importance of the decisions that are made about how to use data.  Both predatory recruiting and nuisance policing seem to start with explicitly harmful (the former) or flawed (the latter) justifications.  This makes the issue one of big data making it easier for people to do bad things.

The description of how the Chicago predictive policing initiative included social network analysis reminded me of the Social Credit system China is developing. (See this article from the Independent or this one from the Financial Times [warning:paywall]) Incidentally, the Independent article has a video and I was shown a pre-roll Lexus ad that was in Mandarin.

Unlike the Chicago system, where one’s core is known presumably only to police, the Chinese system, which includes in the “social credit score” algorithm your activity on social media and the scores of your friends, makes those scores public, encouraging you either  to lean on your friends with low scores in an effort to improve their behavior or to shun them. Both approaches will improve the social component of your score. I wonder to what extent social credit scores are used in the Western world and we just don’t know about it yet.




(96) Justice cannot just be something that one part of society inflicts upon the other.
(102) Part of the analysis that led police to McDaniel involved his social network.



*Yes, I’m aware that it should probably be Notes ans Quotations, but I will sacrifice grammatical accuracy for rhyme scheme

Weapons of Math Destruction Part 2

I’m moving on to Chapters 2 and 3 of Weapons of Math Destruction .  In this week’s prompt, Bryan asks:

  • If creating or running a WMD is so profitable, how can we push back against them?

By making them less profitable.  The only way I see to do this is to require some human intervention in the decision processes these algorithms facilitate.  Making a person responsible for verifying the algorithmic outputs would at least improve accountability.  In the event of egregious harms, the person who signed off on the algorithmic output could be held to account for his or her decision.

  • Do you find other university ranking schemes to be preferable to the US News one, either personally or within this book’s argument?

I don’t know enough about them to say.

  • At one point the author suggests that gaming the US News ranking might not be bad for a university, as “most of the proxies… reflect a school’s overall quality to some degree” (58).  Do you agree?

This doesn’t matter.  Even if the proxies are good proxies, the fact that it’s a ranking system creates the arms race condition which forces colleges to game the system aggressively by doing things like rejecting qualified applicants who are unlikely to enroll.  O’Neil discusses this decline of the safety school.  The root of the problem is the role of reputation in the whole system.

Not surprisingly the discussion of college rankings in Chapter 3 resonated strongly with me for two reasons:

I applied to colleges just at the end of Ivy League collusion on financial aid offers.  I wonder how much the early effects of the US News rankings might have affected me as an Ivy League applicant.

As the parent of teenagers, I had only a vague sense of how the admissions process has changed since I was a college applicant. I worry for my children.



“However, when you create a model from proxies, it is far simpler for people to game it.” (55)