Part A: Concepts and Theory
Prepared by Terry Cook, Summer 2000. Reviewed and Edited by Richard Brown and Judith Roberts-Moore with the Government Records Disposition Program Review Committee: Angèle Alain, Catherine Bailey, Brian Beaven, Gabrielle Blais, Normand Fortier, Yvette Hackett, Andrew Horrall, Candace Loewen, Paul Marsden, Jean-Stéphen Piché , Sheila Powell, Paul Sabourin, Summer 2001
Approved by the National Archivist of Canada
17 October 2001
The general purpose of this document is to provide an appraisal rationale and methodology for archivists in response to the comprehensive, multi-media submissions received by Library and Archives Canada under the Multi-Year Disposition Plan (MYDP) of the planned approach to government records disposition. The main objective is to encourage greater intellectual consistency in records disposition decision-making and in the logic of its explanation and presentation in Appraisal Reports (AR).
The focus of macro-appraisal must be comprehensive. Comprehensive refers to an entire functional or program area (usually a branch or sector), which should include all headquarters, region, and field levels, and all their series, systems, and records collections, in all media. For mid- and small-sized institutions, comprehensive ideally includes all the records of the institution covered in one submission, and thus one appraisal.
The Appraisal Methodology: Macro-Appraisal and Functional Analysis deals exclusively with the substance of appraisal, i.e., it does not explain related business or organizational procedures. It is divided into two parts. The first part (Part A: Concepts and Theory) addresses the intellectual infrastructure supporting Library and Archives Canada's macro-appraisal strategy for government records. The second part (Part B: Guidelines for Performing an Archival Appraisal of Government Records) provides methodological steps for archivists to follow in order to initiate and complete appraisal projects.
The main elements of the Appraisal Methodology include:
It is important to note that the Appraisal Methodology, which broadly outlines the LAC macro-appraisal strategy and its processes, reflects the best current thinking and broad institutional consensus about the appraisal of government records. It is intended for the use of LAC staff both as an operational guideline and as an appraisal orientation tool. It is also expected that this document will continue to grow and evolve to reflect new insights and experiences in the appraisal of the records of federal government institutions.
In addition, Library and Archives Canada must be accountable to the Canadian public for its decisions concerning the preservation of archival records about our national history and collective memory for the benefit and use of future generations. For this reason, Library and Archives Canada is publishing its Appraisal Methodology to offer the public an explanation of how it makes archival records preservation choices.1
Archival Appraisal Theory and Macro-Appraisal
Appraisal theory explores, in a philosophical sense, the sources or influences upon which archivists base their decisions to assign "value" or "significance" or "importance" to records. If a record has "value," one is obliged to ask: to whom, using what criteria, and why? Appraisal strategies and methodologies are a means whereby such theoretical or philosophical definitions of "value" may be identified and implemented in working reality. Theory comes first, from which strategy, methodology and practice are successively derived. Without a progression of theory, strategy, methodology and practice, there can be no logical or defensible rationale for archival appraisal decision-making.
Macro-appraisal at Library and Archives Canada is entirely independent of the medium of the records. It applies explicitly to all records of government institutions subject to the Library and Archives of Canada Act, i.e., textual records in paper form, data and operational program records created and maintained in an electronic environment, photographs, plans, maps, drawings, audio-visual and sound recordings, documentary art, etc.
Macro-appraisal theory at Library and Archives Canada is based on the assumption2 that societal values should provide the context for appraisal decision-making. While no one can objectively know or state with complete assurance what the elements of societal value(s) are or have been within any given generation, archivists can develop appraisal strategies and methodologies that are most likely to provide a comprehensive documentary memory of what has transpired in society over time. At Library and Archives Canada, the primary goal is to offer Canadians sufficient documentary evidence of how government has formulated policy, made decisions, transacted its business and interacted with citizens, leaving researchers and other users the tasks of analyzing and interpreting the meaning of events reflected through archival records. Essentially, LAC macro-appraisal is intended to document both the functionality of government in its role as the public administrator and the impact of its policies, programs and services have on citizens within the broad context of governance3. Of course, appraisal decisions about the value of records created in the private sector should complement and supplement the archival preservation of public sector documentation within a "total archives" framework, but this is beyond the scope of the Appraisal Methodology.
Two other major theories of value determination have been advocated by groups of archivists in the 20th century in addition to the societal focus adopted formally in 1991 by Library and Archives Canada:
Macro-appraisal differs from the methods used to determine and/or the taxonomies of value developed by T.R. Schellenberg and Sir Hilary Jenkinson, respectively, and their followers.
Macro-appraisal embraces certain aspects of Schellenberg's and Jenkinson's approaches as will be explained in Part B. However, it rejects without qualification Jenkinson's position that archivists should not appraise records because this would compromise their role as objective, passive keepers or custodians of a documentary residue left by the creator. Macro-appraisal asserts that archivists - not researchers or creators - are society's professional agents appointed by law to form its collective memory. By virtue of their appraisal decisions, archivists actively shape the documentary legacy of their own time4.
Social theorists and others have found that all societies assign greater or lesser importance to the different dimensions of the interplay between social structures, societal functions, and citizens and groups as social agents. LAC macro-appraisal contends that an understanding of the interplay between government's administrative structures, its business functions and the citizenry is critical to determine the archival value of government records. Essentially, in order to preserve a documentary picture of how government operates in society, macro-appraisal requires archivists to research and analyze functional profiles and administrative structures of government as well as its policies and business programs to identify the nature of the impact these have on individuals and groups. By documenting how government conducts its business, organizes itself, delivers programs and services and the manner in which this business is transacted, LAC will provide an accurate and comprehensive view of government's history5.
The basic formulation of LAC macro-appraisal actually draws inspiration from an insight made some five decades ago by the American archivist Margaret Cross Norton - records follow, relate to and support business functions. This has long been the case both in the corporate and government environments, and is currently evident in business needs analysis and planning, in computer systems design and methodology as well as in contemporary approaches to business process re-engineering and government restructuring. This kind of functional thinking is also at the heart of the macro-appraisal thesis.
In Canada, as in many other countries, public administration is formally assigned responsibilities (functions) by an elected body of representatives with constitutional jurisdiction and mandate through the promulgation of laws, regulations, and policies. To perform these functions, the administration organizes itself into institutions (departments, agencies, boards and offices) with particular jurisdictional mandates, some exclusive to a single institution, some shared with others. Generally speaking, these institutions are created and organized by government to respond to the contemporary requirements and needs of Canadian society, i.e., to what society "values" and to what society deems to be the obligations of the federal state. By documenting how government institutions meet their assigned responsibilities and accountabilities, by preserving records which illustrate how institutions conduct the nation's public business affairs, Library and Archives Canada will preserve government records of enduring archival and historical value to Canadians.
Today, the business of government is extraordinarily complex. LAC macro-appraisal theory proceeds on the assumption that the best way for archivists to understand government business activity and to make appraisal decisions to preserve records providing a comprehensive archival representation of this activity is through an analysis and evaluation of government's assigned business functions. Macro-appraisal theory divides these functions into two categories: those that are assigned to institutions by Parliament on a government-wide portfolio basis through law, regulation and policy; and those that are assigned or delegated to institutions for their internal administrative responsibilities to meet institutional mandates. A hierarchical arrangement of government functionality needs to be assessed and evaluated from an archival appraisal perspective.
At the government-wide level, moving from LAC macro-appraisal theory into its program strategy and methodology, there are broad business domains of responsibility assigned to administrative clusters of government institutions. In Canada, these domains or macro-functions have remained relatively stable since the 1960s. Essentially, there are basic government-wide domains of functional responsibility which implicate one or more institutions in policy formulation, decision-making, and program and service delivery, such as
Within these clusters at the institution-specific level, various elements of these broader macro-functions are normally assigned to the mandate(s) of large departments first, and then to smaller organizations reporting to Parliament. For example, within the broad government business domain of transportation, the Minister of Transport administers and manages transportation policy and regulation in a main department (Transport Canada), but the investigation of transportation accidents is the responsibility of the Transportation Safety Board. Public hearings about transportation safety and other regulations are the responsibility of the Canadian Transportation Agency; the fleet management of the Canadian Coast Guard is the responsibility of the Department of Fisheries and Oceans; and the supervision of Canadian air-space is the responsibility of a not-for-profit quasi-government agency called NAV Canada.
LAC macro-appraisal theory holds that Library and Archives Canada should only acquire records which document the functions on a government-wide or on an institution-specific basis from the information created, accumulated or managed by Offices of Primary Interest (OPI). The OPI is the administrative entity within government which is exclusively responsible and/or accountable for formulating policy, making decisions, or delivering a program or service to Canadians by virtue of law, regulation or mandate, and is the location for the best archival record. The identification of the OPI within the organization of government relevant to particular functions requires substantial and often complicated research and analysis. This is the main reason why the government records disposition program supports its macro-appraisal theory with a research agenda. Library and Archives Canada through this methodological research will achieve consistent appraisal outcomes to create a more focussed records preservation program.
The macro-appraisal thesis means that the contextual milieu in which records are created and subsequently assessed by archivists using the macro-appraisal approach is broadly determined by a variety of factors: administrative structures, macro-functions, functions, sub-functions, programs, activities, transactions, and client interactions, as well as records-creating processes, records systems, and recording technologies. Macro-appraisal provides a balanced documentary view of government's history by focussing archival appraisal research on the analysis of government's business functions rather than on an analysis of records themselves. Archival over-representation of certain records because they suit contemporary research interests is eliminated and records of lesser importance and duplicates are more easily identified. Most importantly, business domains which have been traditionally under-represented in the archival record are more complete.
Essentially, macro-appraisal shifts the primary focus of appraisal from the record - including any research characteristics or values it may contain - to the functional context in which the record is created. The main appraisal questions for the archivist are no longer what has been recorded, where it is, and what research value it has. Instead, the archivist uses knowledge gained by a functional analysis of an institution, including an analysis of the interaction of function and structure, of organizational culture, of records-keeping systems, and of citizen-client involvement with the institution or function. The key appraisal questions are:
By answering these basic questions, archivists can target records or records series for review in order to verify their research hypotheses concerning the importance of the function or activity under analysis. One of two possible outcomes is obtained by reviewing records:
The main proposition of macro-appraisal is that only Offices of Primary Interest create the critical documentation about particular government functions and activities and consequently, Library and Archives Canada will exclusively acquire archival records from these administrative sites. Although macro-appraisal has shifted appraisal emphasis from the record to the context of records creation, it retains records review as a critical last step in its appraisal methodology. First, by reviewing records, archivists are able to test their research and assumptions. Second, and perhaps most importantly, archivists must decide which and how many records are required to sufficiently document the function or activity. The last thing an archivist does in evaluating records is to review the records. Not all records related to a function or activity deemed to have archival importance or national significance must be acquired by the archives, nor do all functions share equal importance, or have equal impact upon the lives of Canadians. As explained in the Methodological Guidelines (Part B), archivists are expected to determine which records adequately and appropriately document the function or activity in question. The archivists should bring to bear their informed judgement, research and knowledge, taking into account the resources of Library and Archives Canada. The theoretical focus of macro-appraisal is "societal": to identify records which provide illustration of how government operates and affects Canadian society. The goal is not to provide archival evidence of functions and activities as an end in itself.
Documentation Goals for the Macro-Appraisal of Government Records
The societal focus of macro-appraisal leading to the archival acquisition or protection of government records by Library and Archives Canada is guided by the following documentation objectives. The primary goal is to preserve selected records which document the deliberations, decisions and actions of government in relation to its assigned business functions, programs and activities, as well as records which establish the sovereignty, organization and administration of government. Other documentation goals are:
The Macro-Appraisal Goal
The macro-appraisal goal is to choose significant and sufficient recorded evidence from Offices of Primary Interest. This recorded evidence should most succinctly reflect, in the best recording medium, the impact of the function or program on Canadians and the public's interaction with the function or program.
The methodological steps conceived to support this strategy are provided in Part B: Guidelines for Performing an Archival Appraisal of Government Records.
Selected Bibliography (Publications Only)
Theoretical Studies by Program Staff:
Richard Brown, "Macro-Appraisal Theory and the Context of the Public Records Creator," Archivaria 40 (Fall 1995), pp. 40-74.
Richard Brown, "Records Acquisition Strategy and Its Theoretical Foundation: The Case for a Concept of Archival Hermeneutics," Archivaria 33 (Winter 1991-92), pp. 34-56.
Richard Brown, "The Value of 'Narrativity' in the Appraisal of Historical Documents: Foundation for a Theory of Archival Hermeneutics," Archivaria 32 (Summer 1991), pp. 152-156.
Terry Cook, The Archival Appraisal of Records Containing Personal Information: A RAMP Study with Guidelines (Paris, 1991), published by the International Council on Archives, UNESCO.
Terry Cook, "Documentation Strategy," Archivaria 34 (Summer 1992), pp. 181-191.
Terry Cook, "Macroappraisal and Functional Analysis: Appraisal Theory, Strategy, and Methodology for Archivists," L'évaluation des archives: des nécessités de la gestion aux exigences du témoignage, Groupe interdisciplinaire de recherche en archivistique, 3e symposium (Montreal, 1998), pp. 27-33.
Terry Cook, "'Many are called but few are chosen': Appraisal Guidelines for Sampling and Selecting Case Files," Archivaria 32 (Summer 1991), pp. 25-50.
Terry Cook, "Mind Over Matter: Towards a New Theory of Archival Appraisal," in Barbara Craig, ed., The Canadian Archival Imagination: Essays in Honour of Hugh Taylor (Ottawa, 1992).
Terry Cook, "What is Past is Prologue: A History of Archival Ideas Since 1898, and the Future Paradigm Shift" Archivaria 43 (Spring 1997), pp. 17-63.
Jean-Stephen Piché, "Macro-Appraisal and Duplication of Information: Federal Real Property Management Records," Archivaria 39 (Spring 1995), pp. 39-50.
Jean-Pierre Wallot, "Building a Living Memory for the History of Our Present: New Perspectives on Archival Appraisal," Journal of the Canadian Historical Association (new series), 2 (1991).
Ian E. Wilson, "The Fine Art of Destruction Revisited", Archivaria 49 (Spring 2000), pp. 124-139.
External Conceptual Influences or Supporting Reflections:
Hans Booms, "Society and the Formation of a Documentary Heritage: Issues in the Appraisal of Archival Sources," Archivaria 24 (Summer 1987), translation by Hermina Joldersma and Richard Klumpenhouwer, with introduction -- original article, 1972.
Hans Booms, "Uberlieferungsbilding: Keeping Archives as a Social and Political Activity," Archivaria 33 (Winter 1991-92), pp. 25-33.
Mark A. Greene and Todd J. Daniels-Howell, "Documentation with an Attitude: A Pragmatist's Guide to the Selection and Acquisition of Modern Business Records," in James M. O'Toole, The Records of American Business (Chicago, 1997), pp. 161-229
Gerald F. Ham, "Archival Choices: Managing the Historical Record in an Age of Abundance," in Nancy E. Peace, ed., Archival Choices: Managing the Historical Record in an Age of Abundance (Lexington, Mass., 1984).
Gerald F. Ham, "The Archival Edge," in Maygene Daniels and Timothy Walch, eds., A Modern Archives Reader (Washington, 1984) -- original article, 1975.
National Archives (Netherlands), PIVOT: Logic Model: Institutional Research (1992).
Greg O'Shea, "The Medium is not the Message: Appraisal of Electronic Records by Australian Archives," Archives and Manuscripts 22, no. 1 (May 1994).
Catherine Robinson, "Records Control and Disposal Using Functional Analysis," Archives and Manuscripts 25 (November 1997), pp. 288-303.
Helen Samuels, Varsity Letters: Documenting Modern Colleges and Universities (1992).
Helen Samuels, "Who Controls the Past?" American Archivist 49, no. 2 (Spring 1986).
Jim Suderman, "Appraising Records of the Expenditure Management Function: An Exercise in Functional Analysis," Archivaria 43 (Spring 1997), pp. 129-42.
United States, National Archives and Records Administration, Office of Records Administration, Appraisal of Department of Justice Case Files: Final Report (Washington, 1989).