Digitization: Difference between revisions
Line 84: | Line 84: | ||
Labour resources and funding also limit digital preservation in many institutions. The cost of upgrading hardware or software every few years can be prohibitively expensive. Training is another issue since many librarians and archivists do not have a computer science background. Intellectual control of digital holdings presents yet another issue that sometimes occurs when the physical holdings have not yet been entirely processed. One suggested timeframe for completely transcribing digital holdings was every ten to twenty years, making the process an ongoing and time-consuming one. |
Labour resources and funding also limit digital preservation in many institutions. The cost of upgrading hardware or software every few years can be prohibitively expensive. Training is another issue since many librarians and archivists do not have a computer science background. Intellectual control of digital holdings presents yet another issue that sometimes occurs when the physical holdings have not yet been entirely processed. One suggested timeframe for completely transcribing digital holdings was every ten to twenty years, making the process an ongoing and time-consuming one. |
||
Finally preserving digitized assets over long periods of time is challenging. Essentially you are storing a massive set of 1s and 0s. These signals can be physically burned onto media, like CDs, or stored magnetically, on hard drives. In either case, the storage mechanisms degrade over time. The physical materials degrade until the 1s or 0 marks can no longer be made out. The magnetic media degrades and loses its charge. If you alter just one 1 or one 0, you can significantly alter the recording. Thus data integrity with digitized assets in storage is a big challenge. |
|||
==Digital reformatting== |
==Digital reformatting== |
Revision as of 20:22, 17 September 2020
Digitization[1] is the process of converting information into a digital (i.e. computer-readable) format, in which the information is organized into bits.[1][2] The result is the representation of an object, image, sound, document or signal (usually an analog signal) by generating a series of numbers that describe a discrete set of points or samples. The result is called digital representation or, more specifically, a digital image, for the object, and digital form, for the signal. In modern practice, the digitized data is in the form of binary numbers, which facilitate computer processing and other operations, but, strictly speaking, digitizing simply means the conversion of analog source material into a numerical format; the decimal or any other number system that can be used instead.
Digitization is of crucial importance to data processing, storage and transmission, because it "allows information of all kinds in all formats to be carried with the same efficiency and also intermingled".[3] Though analog data is typically more stable, digital data can more easily be shared and accessed and can, in theory, be propagated indefinitely, without generation loss, provided it is migrated to new, stable formats as needed. This is why it is a favored way of preserving information for many organizations around the world.
Process
The term digitization is often used when diverse forms of information, such as an object, text, sound, image or voice, are converted into a single binary code. The core of the process is the compromise between the capturing device and the player device so that the rendered result represents the original source with the most possible fidelity, and the advantage of digitization is the speed and accuracy in which this form of information can be transmitted with no degradation compared with analog information.
Digital information exists as one of two digits, either 0 or 1. These are known as bits (a contraction of binary digits) and the sequences of 0s and 1s that constitute information are called bytes.[4]
Analog signals are continuously variable, both in the number of possible values of the signal at a given time, as well as in the number of points in the signal in a given period of time. However, digital signals are discrete in both of those respects – generally a finite sequence of integers – therefore a digitization can, in practical terms, only ever be an approximation of the signal it represents.
Digitization occurs in two parts:
- Discretization
- The reading of an analog signal A, and, at regular time intervals (frequency), sampling the value of the signal at the point. Each such reading is called a sample and may be considered to have infinite precision at this stage;
- Quantization
- Samples are rounded to a fixed set of numbers (such as integers), a process known as quantization.
In general, these can occur at the same time, though they are conceptually distinct.
A series of digital integers can be transformed into an analog output that approximates the original analog signal. Such a transformation is called a DA conversion. The sampling rate and the number of bits used to represent the integers combine to determine how close such an approximation to the analog signal a digitization will be.
Examples
The term is used to describe, for example, the scanning of analog sources (such as printed photos or taped videos) into computers for editing, 3D scanning that creates 3D modeling of an object's surface, and audio (where sampling rate is often measured in kilohertz) and texture map transformations. In this last case, as in normal photos, the sampling rate refers to the resolution of the image, often measured in pixels per inch.
Digitizing is the primary way of storing images in a form suitable for transmission and computer processing, whether scanned from two-dimensional analog originals or captured using an image sensor-equipped device such as a digital camera, tomographical instrument such as a CAT scanner, or acquiring precise dimensions from a real-world object, such as a car, using a 3D scanning device.[5]
Digitizing is central to making digital representations of geographical features, using raster or vector images, in a geographic information system, i.e., the creation of electronic maps, either from various geographical and satellite imaging (raster) or by digitizing traditional paper maps or graphs[6][7] (vector).
"Digitization" is also used to describe the process of populating databases with files or data. While this usage is technically inaccurate, it originates with the previously proper use of the term to describe that part of the process involving digitization of analog sources, such as printed pictures and brochures, before uploading to target databases.
Digitizing may also used in the field of apparel, where an image may be recreated with the help of embroidery digitizing software tools and saved as embroidery machine code. This machine code is fed into an embroidery machine and applied to the fabric. The most supported format is DST file. Apparel companies also digitize clothing patterns[citation needed][8]
Analog signals to digital
Analog signals are continuous electrical signals; digital signals are non-continuous. Analog signals can be converted to digital signals by using an analog-to-digital converter.[9]
Nearly all recorded music has been digitized. About 12 percent of the 500,000+ movies listed on the Internet Movie Database are digitized on DVD.[10][11]
The handling of an analog signal becomes easy [according to whom?] when it is digitized because the signal is digitized before modulation and transmission. The conversion process of analog to digital consists of two processes: sampling and quantizing.
Digitization of personal multimedia, such as home movies, slides, and photographs is a popular method of preserving and sharing older repositories. Slides and photographs may be scanned using an image scanner, but videos are more difficult.[12] Slides can be digitized with different film scanner by Nikon such as the Nikon Coolscan 5000ED.
Another example of digitization is VisualAudio process of the Swiss Fonoteca Nazionale in Lugano, that extract and reconstruct the sound from a high-resolution picture of a record.
Analog texts to digital
At most 1 in 20 texts have been digitized as of 2006.[13]
Older print books are being scanned and optical character recognition technologies have been applied by academic and public libraries, foundations, and private companies like Google.[14]
Unpublished text documents on paper, which have some enduring historical or research value are being digitized by libraries and archives, though frequently at a much slower rate than for books (see digital libraries). In many cases, archives have replaced microfilming with digitization as a means of preserving and providing access to unique documents.
Implications
This shift to digitization in the contemporary media world has created implications for traditional mass media products. However, these "limitations are still very unclear".[15] The more technology advances, the more converged the realm of mass media will become with less need for traditional communication technologies. For example, the Internet has transformed many communication norms, creating more efficiency for not only individuals but also for businesses. However, McQuail suggests traditional media have also benefited greatly from new media, allowing more effective and efficient resources available.[15]
Library preservation
In the context of libraries, archives, and museums, digitization is a means of creating digital surrogates of analog materials, such as books, newspapers, microfilm and videotapes, offers a variety of benefits, including increasing access, especially for patrons at a distance; contributing to collection development, through collaborative initiatives; enhancing the potential for research and education; and supporting preservation activities.[16] Digitization can provide a means of preserving the content of the materials by creating an accessible facsimile of the object in order to put less strain on already fragile originals. For sounds, digitization of legacy analog recordings is essential insurance against technological obsolescence.[17] A fundamental aspect of planning digitization projects is to ensure that the digital files themselves are preserved and remain accessible;[18] the term "digital preservation," in its most basic sense, refers to an array of activities undertaken to maintain access to digital materials over time.[19]
The prevalent Brittle Books issue facing libraries across the world is being addressed with a digital solution for long term book preservation.[20] Since the mid-1800s, books were printed on wood-pulp paper, which turns acidic as it decays. Deterioration may advance to a point where a book is completely unusable. In theory, if these widely circulated titles are not treated with de-acidification processes, the materials upon those acid pages will be lost. As digital technology evolves, it is increasingly preferred as a method of preserving these materials, mainly because it can provide easier access points and significantly reduce the need for physical storage space.
Cambridge University Library is working on the Cambridge Digital Library, which will initially contain digitised versions of many of its most important works relating to science and religion. These include examples such as Isaac Newton's personally annotated first edition of his Philosophiæ Naturalis Principia Mathematica[21] as well as college notebooks[22][23] and other papers,[24] and some Islamic manuscripts such as a Quran[25] from Tipu Sahib's library.
Google, Inc. has taken steps towards attempting to digitize every title with "Google Book Search".[26] While some academic libraries have been contracted by the service, issues of copyright law violations threaten to derail the project.[27] However, it does provide – at the very least – an online consortium for libraries to exchange information and for researchers to search for titles as well as review the materials.
Digitization versus digital preservation
There is a common misconception that to digitize something is the same as digital preservation. To digitize something is to convert something from an analog into a digital format.[28] An example would be scanning a photograph and having a digital copy on a computer. This is essentially the first step in digital preservation. To digitally preserve something is to maintain it over a long period of time.[29][30]
Digital preservation is more complicated because technology changes so quickly that a format that was used to save something years ago may become obsolete, like a 5 1/4" floppy drive. Computers are no longer made with them, and obtaining the hardware to convert a file from an obsolete format to a newer one can be expensive. As a result, the upgrading process must take place every 2 to 5 years,[31] or as newer technology becomes affordable, but before older technology becomes unobtainable. The Library of Congress provides numerous resources and tips for individuals looking to practice digitization and digital preservation for their personal collections.[32]
Digital preservation can also apply to born-digital material. An example of something that is born-digital is a Microsoft Word document saved as a .docx file or a post to a social media site. In contrast, digitization only applies exclusively to analog materials. Born-digital materials present a unique challenge to digital preservation not only due to technological obsolescence but also because of the inherently unstable nature of digital storage and maintenance. Most websites last between 2.5 and 5 years, depending on the purpose for which they were designed.[33]
Many libraries, archives, and museums, as well as other institutions, struggle with catching up and staying current in regards to both digitization and digital preservation. Digitization is a time-consuming process, particularly depending on the condition of the holdings prior to being digitized. Some materials are so fragile that undergoing the process of digitization could damage them irreparably; light from a scanner can damage old photographs and documents. Despite potential damage, one reason for digitizing some materials is because they are so heavily used that digitization will help to preserve the original copy long past what its life would have been as a physical holding.
Digitization can also be quite expensive. Institutions want the best image quality in digital copies so that when they are converted from one format to another over time only a high-quality copy is maintained. Smaller institutions may not be able to afford such equipment. Manpower at many facilities also limits how much material can be digitized. Archivists and librarians must have an idea of what their patrons wish to see most and try to prioritize and meet those needs digitally.
Labour resources and funding also limit digital preservation in many institutions. The cost of upgrading hardware or software every few years can be prohibitively expensive. Training is another issue since many librarians and archivists do not have a computer science background. Intellectual control of digital holdings presents yet another issue that sometimes occurs when the physical holdings have not yet been entirely processed. One suggested timeframe for completely transcribing digital holdings was every ten to twenty years, making the process an ongoing and time-consuming one.
Finally preserving digitized assets over long periods of time is challenging. Essentially you are storing a massive set of 1s and 0s. These signals can be physically burned onto media, like CDs, or stored magnetically, on hard drives. In either case, the storage mechanisms degrade over time. The physical materials degrade until the 1s or 0 marks can no longer be made out. The magnetic media degrades and loses its charge. If you alter just one 1 or one 0, you can significantly alter the recording. Thus data integrity with digitized assets in storage is a big challenge.
Digital reformatting
Digital reformatting is the process of converting analog materials into a digital format as a surrogate of the original. The digital surrogates perform a preservation function by reducing or eliminating the use of the original. Digital reformatting is guided by established best practices to ensure that materials are being converted at the highest quality.
Digital reformatting at the Library of Congress
The Library of Congress has been actively reformatting materials for its American Memory project and developed best standards and practices pertaining to book handling during the digitization process, scanning resolutions, and preferred file formats.[34] Some of these standards are:
- The use of ISO 16067-1 and ISO 16067-2 standards for resolution requirements.
- Recommended 400 ppi resolution for OCR'ed printed text.
- The use of 24-bit color when color is an important attribute of a document.
- The use of the scanning device's maximum resolution for digitally reproducing photographs
- TIFF as the standard file format.
- Attachment of descriptive, structural, and technical metadata to all digitized documents.
A list of archival standards for digital preservation can be found on the ARL website.[35]
The Library of Congress has constituted a Preservation Digital Reformatting Program.[36] The Three main components of the program include:
- Selection Criteria for digital reformatting
- Digital reformatting principles and specifications
- Life cycle management of LC digital data
Audio digitization and reformatting
Audio media offers a rich source of historic ethnographic information, with the earliest forms of recorded sound dating back to 1890.[37] According to the International Association of Sound and Audiovisual Archives (IASA), these sources of audio data, as well as the aging technologies used to play them back, are in imminent danger of permanent loss due to degradation and obsolescence.[38] These primary sources are called “carriers” and exist in a variety of formats, including wax cylinders, magnetic tape, and flat discs of grooved media, among others. Some formats are susceptible to more severe, or quicker, degradation than others. For instance, lacquer discs suffer from delamination. Analog tape may deteriorate due to sticky shed syndrome.
Archival workflow and file standardization have been developed to minimize loss of information from the original carrier to the resulting digital file as digitization is underway. For most at-risk formats (magnetic tape, grooved cylinders, etc), a similar workflow can be observed. Examination of the source carrier will help determine what, if any, steps need to be taken to repair material prior to transfer. A similar inspection must be undertaken for the playback machines. If satisfactory conditions are met for both carrier and playback machine, the transfer can take place, moderated by an analog-to-digital converter.[40] The digital signal is then represented visually for the transfer engineer by a digital audio workstation, like Audacity, WaveLab, or ProTools. Reference access copies can be made at smaller sample rates. For archival purposes, it is standard to transfer at a sample rate of 96 kHz and a bit depth of 24 bits per channel.[37]
Lean philosophy
The broad use of internet and the increasing popularity of lean philosophy has also increased the use and meaning of "digitizing" to describe improvements in the efficiency of organizational processes. Lean philosophy refers to the approach which considers any use of time and resources, which does not lead directly to creating a product, as waste and therefore a target for elimination. This will often involve some kind of Lean process in order to simplify process activities, with the aim of implementing new "lean and mean" processes by digitizing data and activities. Digitization can help to eliminate time waste by introducing wider access to data, or by the implementation of enterprise resource planning systems.
Fiction
Works of science-fiction often include the term digitize as the act of transforming people into digital signals and sending them into digital technology. When that happens, the people disappear from the real world and appear in a virtual world (as featured in the cult film Tron, the animated series Code: Lyoko, or the late 1980s live-action series Captain Power and the Soldiers of the Future). In the video game Beyond Good & Evil, the protagonist's holographic friend digitizes the player's inventory items. One Super Friends cartoon episode showed Wonder Woman and Jayna freeing the world's men (including the male super heroes) onto computer tape by the female villainess Medula.[41]
See also
References
- ^ a b Definition of digitization at WhatIs.com
- ^ "Digitization/digitisation" in Collins English Dictionary
- ^ McQuail, D (2000) McQuail's Mass Communication Theory (4th edition), Sage, London, pp. 16–34
- ^ Flew, Terry. 2008. New Media An Introduction. South Melbourne. 3rd Edition. South Melbourne: Oxford University Press.
- ^ Digimation for 3D Models, 3D Software and Creative Services
- ^ "Open source Engauge Digitizer for digitizing graphs".
- ^ "DigitizeIt graph digitizing software".
- ^ Hedstrom, Margaret (1997-05-01). "Digital Preservation: A Time Bomb for Digital Libraries" (PDF). Computers and the Humanities. 31 (3): 189–202. doi:10.1023/A:1000676723815. hdl:2027.42/42573. ISSN 1572-8412.
- ^ "Analog vs. Digital Signals". 3 March 2008. Archived from the original on 2008-03-03.
- ^ Lee, Kyong-Ho; Slattery, Oliver; Lu, Richang; Tang, Xiao; McCrary, Victor (2002). "The State of the Art and Practice in Digital Preservation". Journal of Research of the National Institute of Standards and Technology. 107 (1): 93–106. doi:10.6028/jres.107.010. ISSN 1044-677X. PMC 4865277. PMID 27446721.
- ^ Waldfogel, Joel (August 2017). "How Digitization Has Created a Golden Age of Music, Movies, Books, and Television" (PDF). Journal of Economic Perspectives. 31 (3): 195–214. doi:10.1257/jep.31.3.195. ISSN 0895-3309.
- ^ Paul Heltzel. "Good-Bye, VHS; Hello, DVD".
- ^ Kelly, Kevin (May 14, 2006). "Scan This Book!". New York Times. Retrieved 2016-10-26.
- ^ "Google Checks Out Library Books Press release" (Press release). December 14, 2004.
- ^ a b McQuail, Denis (2000). McQuail's Mass Communication Theory. 4th ed. Thousand Oaks, Calif.: Sage. p. 28.
- ^ Hughes, Lorna M. (2004). Digitizing Collections: Strategic Issues for the Information Manager. London: Facet Publishing. ISBN 1-85604-466-1. Chapter 1, "Why digitize? The costs and benefits of digitization", p. 3-30; here, especially p. 9-17.
- ^ "Guidelines on the Production and Preservation of Digital Audio Objects (web edition)". iasa-web.org.
- ^ Hughes (2004), p. 204.
- ^ Caplan, Priscilla (February–March 2008). "What is Digital Preservation?". Library Technology Reports. 44 (2): 7. Retrieved 2016-10-26.
- ^ Cloonan, M.V. and Sanett, S. "The Preservation of Digital Content," Libraries and the Academy. Vol. 5, No. 2 (2005): 213–37.
- ^ Newton, Isaac. "Philosophiæ Naturalis Principia Mathematica". Cambridge University Digital Library. Retrieved 10 January 2012.
- ^ Newton, Isaac. "Trinity College Notebook". Cambridge University Digital Library. Retrieved 10 January 2012.
- ^ Newton, Isaac. "College Notebook". Cambridge University Digital Library. Retrieved 10 January 2012.
- ^ Newton, Isaac. "Newton Papers". Cambridge University Digital Library. Retrieved 10 January 2012.
- ^ "al-Qurʼān". Cambridge University Digital Library. Retrieved 10 January 2012.
- ^ Google Books.
- ^ Baksik, C. "Fair Use or Exploitation? The Google Book Search Controversy," Libraries and the Academy. Vol. 6, No. 2 (2006): 399–415.
- ^ "why digitization is not digital preservation". 7 October 2011.
- ^ Ross, Seamus (2000). Changing Trains at Wigan: Digital Preservation and the Future of Scholarship (PDF) (1 ed.). London: British Library (National Preservation Office).
- ^ "Digitization is Different than Digital Preservation: Help Prevent Digital Orphans!". loc.gov.
- ^ "Digitization vs. Preservation". prairienet.org.
- ^ "Digital Preservation". digitalpreservation.gov.
- ^ "Website Lifespan and You". Orbit Media Studios.
- ^ "Library of Congress. (2007). Technical Standards for Digital Conversion of Text and Graphic Materials" (PDF).
- ^ "Search Publications – Association of Research Libraries® – ARL®" (PDF). www.arl.org.
- ^ Library of Congress, (2006). Preservation Digital Reformatting Program. https://www.loc.gov/preserv/prd/presdig/presintro.html
- ^ a b "ARSC Guide to Audio Preservation" (PDF).
- ^ Casey, Mike (January 2015). "Why Media Preservation Can't Wait: The Gathering Storm" (PDF). IASA Journal. 44: 14–22.
- ^ "ARSC Guide to Audio Preservation" (PDF). Retrieved 2019-05-04.
- ^ Institute, Canadian Conservation (2017-09-14). "The Digitization of Audio Tapes – Technical Bulletin 30". aem. Retrieved 2019-05-04.
- ^ The Mind Maidens. Aired Nov. 5 1977 on the ABC Network along with other segments.
Further reading
- Anderson, Cokie G.; Maxwell, David C, Starting a Digitization Center, Chandos Publishing, 2004, ISBN 978-1843340737
- Bulow, Anna; Ahmon, Jess, Preparing Collections for Digitization, Facet Publishing, 2010, ISBN 978-1856047111
- Perrin, Joy, ‘’Digitization of Flat Media: Principles and Practices’’, Rowman & Littlefield Publishers, 2015, ISBN 978-1442258099
- Piepenburg, Scott, "Digitizing Audiovisual and Nonprint Materials: the Innovative Librarian's Guide", Libraries Unlimited, 2015, ISBN 978-1440837807
- Robinson, Peter, Digitization of Primary Textual Sources, Office for Humanities Communication, 1993, ISBN 978-1897791059
- S Ross; I Anderson; C Duffy; M Economou; A Gow; P McKinney; R Sharp; The NINCH Working Group on Best Practices, Guide to Good Practice in the Digital Representation and Management of Cultural Heritage Materials, Washington DC: NINCH, 2002.
- Speranski, V. Challenges in AV Digitization and Digital Preservation
- 'The Library of Congress National Recording Preservation Plan'