But most of these models are still blinkered, in the same way that the viewer of the dashboard can be. The ones that work best are either extremely broad (high level, generalized categories as above – ‘a bicycle parked on field’, rather than ‘a blue Swedish Pilen bicycle, with black mudguards, standing on a daisy strewn grass lawn, near a marina in front of a cement works) or super narrow (focused on a very specific attribute, such as license plate reading). When the subject of the image is beyond their frame of reference they often struggle. At best, those blinkers can result in some humorous mistakes when things that aren't part of the model's realm of understanding come into view.
At worse it results in false positives which can lead to bias, prejudice and discrimination, and when that's reflected back from the model at scale, it can be very ugly, as Google found out a few years back.
The thing is, we often need a lot more than a simple score, closed set, or single perspective when trying to understand the information at hand. We need a variety of views or layers, each enabling us to frame the previous, to give it context and shed light on any misreading or misunderstanding. Mattern gives the example of Patrick Geddes' The Outlook Tower in Edinburgh from the early 1900s. The tower enabled people to understand the place (Edinburgh), by examining the 'live' view, both in macro and micro detail (through a camera obscura). Then it enabled them to position that information in an ever larger context (city, country, language, continent and world) by walking down floor by floor through the tower’s exhibition. This idea of framing and then reframing the observed or reported data is a fundamental part of research and analysis. It's why for many years people have created Qlik apps using the idea of a stepped analysis, from dashboard (indication), to detail (analysis and association), to report (sharing insight and evidence). That 'detail' step is essential as it adds context to the data, but it's not always enough. Sometimes you need to get down in the mud and the filth to truly understand what your data is and isn't saying, or what you can and can't see. Not only that, but you may need to bring new perspectives to the mix, so that you can reframe and re-contextualize what it's telling you, in the same way that Geddes reframed the data from the view of the city using country or language. Those additional perspectives may even come in the form of qualitative data, and all its personal, physical, and human messiness.
Dashboards and models help us process and synthesize the overwhelming mass of data we have at our fingertips. But remember, you are always getting a reduced view of the world and sometimes you'll need to jump down into the mud and get dirty, as that’s where the real story is often hiding.
For those who like an even longer read, here’s a link to Shannon Mattern’s Mission Control: A History of the Urban Dashboard
Image by National Library of Scotland [No restrictions], via Wikimedia Commons