The generation game: evolving with the digital record

Contemporary laptop facing an old vintage typewriterWe’ve had quite a lot of practice at being an archive: we’ve been looking after the public record for over 150 years. Most of the fundamentals of archival practice were laid out by Sir Hilary Jenkinson – our former Deputy Keeper – in ‘A Manual of Archive Administration’ in 1922.

Jenkinson wrote his manual before computers were invented. Records were always physical. The government record – the official account of decisions made by government – largely consisted of letters, memos and minutes.  Other kinds of important information (such as records of births, marriages and deaths) could be compiled into ledgers. Thanks to their catalogues, archivists knew where to find the important information, and were confident they could describe and preserve what they found.

The widespread use of computers inside government has changed things radically. We have been creating a vastly greater volume of information in a raft of different formats.  Sometimes there’s an analogue equivalent – for example, civil servants still produce minutes, although nowadays we usually use Microsoft Word. Email has largely taken the place of letters, although we email lots of information that would once have been expressed very differently.

Archives have had to evolve to be able to cope with new kinds of records. When we first started tackling the new and unfamiliar digital landscape, we needed a way of identifying important pieces of information and figuring out what to do with them. We realised that much of the information we cared about was encoded in some fairly standard formats: the obvious approach was to worry only about those. So we compiled a list of around 20 different file formats that we would accession and preserve – Word documents, Excel spreadsheets, PDFs, and so on.

We became a ‘first generation’ digital archive: one that adopts a traditional, paper-based approach to selecting, preserving and providing access to records and replicates it as closely as possible using digital technology.

This is an approach replicating a system rooted in the world of physical records: I have a programme that allows me to create a thing that I will call ‘a document’, and I’ll put it in a ‘folder’ that exists in a ‘filing system’.

Today we’re faced with the continual rise of new technologies. There is no analogue equivalent to an instant message conversation, or a project management system like Trello, but these are environments where key decisions could be recorded.

A second-generation digital archive needs to preserve a much broader set of things. We have to be prepared to keep the bits – the ones and zeroes – wherever there’s a record of government decision-making in action, and then manage our capability to produce the record.

In future, some decisions may even be encoded in the differences between versions of a piece of computer software.  With policy-makers and digital teams working together in more agile ways, decisions might be made in the course of a stand-up conversation and translated straight into code. The actual record of each decision may be the developer writing the code that gives it effect.

If all The National Archives could keep were letters, minutes and memos then there would be no ‘public record’ any more… but of course, as archivists we couldn’t accept that. There’s always a record, it’s just very different – and we need to keep evolving our capability so the record survives.

We can’t constrain working practices artificially, based on what we can preserve, or our view of what a record ought to be. What we have to do is keep on identifying the kinds of things that have the characteristics of records and then make sure that we develop the capability to preserve those things.

The second generation digital archive commits to the relentless engineering effort to preserve and present digital artefacts, whatever they happen to look like when we find them.

It’s not the world that Hilary Jenkinson knew, but I think he’d approve.

2 comments

  1. David Matthew says:

    It does depend on by what you mean by computers as they were around in the 19th Century whereas electronic computers started in the mid-20th Century, as did worries over the use by Government arising from the 1971 Census of Population, all before data protection. I would dispute that Government could find papers as catalogues as such only really started after the Public Record Office was created in 1838 and even today departments like Treasury have gaps (about 100 years) where there are no catalogues, hence indexes which still take about 3 hours to find the file. Of course not everything is on e-mail systems so that there is a ‘grey’ area. New technologies need systems to access them over time, remember the great advance of the early 1970s (cassette tapes) that didn’t last long and at least with paper there is no problem, they will I am sure outlast digital records. Personally a Government record means something physical and not multitudes of data which is probably going to end up being duplicated many times over. as far as Jenkinson goes he was the stumbling block to modern records which is the reason he was stopped from the Government enquiry into public records (ending up with the Public Records Act of 1958) as highlighted by histories and the files at TNA. We should remember that in his time you had to pay a fee to see records under a 100 years old!. One other issue is whether TNA actually could end up with a separate building just for physical records and staff will no longer be needed for a lot of functions and could be replaced by robots, no thanks, we have seen with the events at Northamptonshire Archives what happens when politicians get involved.

  2. Kieran hoare says:

    Interesting blog post. I have heard a lot in recent years about “backward” professional archival views seeking to maintain “traditional” archival practices, in particular efforts to maintain ISAD(G), that we are wedded to Jenkinson at the expense of making our finding aid networks relevant to current researchers. We are told that more product less product is the way to go, accept mass digitisation and imperfect OCR instead of “wasting” resources – accepting of course that we will never have sufficient resources to list everything properly – listing collections correctly. I would suggest, respectfully, that we do our current and future researchers a disservice by dispensing of descriptive standards. A collection will remain underused and unsearched whether it is digitised or not, without appropriate metadata. We can utilise new technology for sure, but we need to migrate metadata and make the new technology work for our researchers, not sell them short to balance current budgets.

Leave a comment

Visit this page for family history and other research enquiries. Please do not post personal information. All comments are pre-moderated. See our moderation policy for more details.

Your email address will not be published. Required fields are marked *