A dataset to advance the study of life-cycle interactions of biomedical and socioeconomic factors in the aging process. The EI project has assembled a variety of large datasets covering the life histories of approximately 39,616 white male volunteers (drawn from a random sample of 331 companies) who served in the Union Army (UA), and of about 6,000 African-American veterans from 51 randomly selected United States Colored Troops companies (USCT). Their military records were linked to pension and medical records that detailed the soldiers������?? health status and socioeconomic and family characteristics. Each soldier was searched for in the US decennial census for the years in which they were most likely to be found alive (1850, 1860, 1880, 1900, 1910). In addition, a sample consisting of 70,000 men examined for service in the Union Army between September 1864 and April 1865 has been assembled and linked only to census records. These records will be useful for life-cycle comparisons of those accepted and rejected for service. Military Data: The military service and wartime medical histories of the UA and USCT men were collected from the Union Army and United States Colored Troops military service records, carded medical records, and other wartime documents. Pension Data: Wherever possible, the UA and USCT samples have been linked to pension records, including surgeon''''s certificates. About 70% of men in the Union Army sample have a pension. These records provide the bulk of the socioeconomic and demographic information on these men from the late 1800s through the early 1900s, including family structure and employment information. In addition, the surgeon''''s certificates provide rich medical histories, with an average of 5 examinations per linked recruit for the UA, and about 2.5 exams per USCT recruit. Census Data: Both early and late-age familial and socioeconomic information is collected from the manuscript schedules of the federal censuses of 1850, 1860, 1870 (incomplete), 1880, 1900, and 1910. Data Availability: All of the datasets (Military Union Army; linked Census; Surgeon''''s Certificates; Examination Records, and supporting ecological and environmental variables) are publicly available from ICPSR. In addition, copies on CD-ROM may be obtained from the CPE, which also maintains an interactive Internet Data Archive and Documentation Library, which can be accessed on the Project Website. * Dates of Study: 1850-1910 * Study Features: Longitudinal, Minority Oversamples * Sample Size: ** Union Army: 35,747 ** Colored Troops: 6,187 ** Examination Sample: 70,800 ICPSR Link: http://www.icpsr.umich.edu/icpsrweb/ICPSR/studies/06836
Attribution 4.0 (CC BY 4.0)https://creativecommons.org/licenses/by/4.0/
License information was derived automatically
NARA PoW Data W.D. A.G.O. FORM NO. 0326.
This deposit contains a dataset relating to persons interned between December 7, 1941 and November 19, 1946, which has been enhanced to make it more accessible to scientists. It is based on information from the U.S. National Archives and Records Administration (NARA), which is unrestricted and available at https://aad.archives.gov/aad/series-description.jsp?s=644&popup=Y, and informs this summary. The NARA 'series' is part of Record Group 389: Records of the Office of the Provost Marshal General. It identifies 79 'places of capture' globally "Using copies of reports from the International Committee of the Red Cross ...". The Scope & Content Note states:
"This series has information about U.S. military officers and soldiers and U.S. and some Allied civilians who were prisoners of war and internees. The record for each prisoner provides serial number, personal name, branch of service or civilian status, grade, date reported, race, state of residence, type of organization, parent unit number and type, place of capture (theater of war), source of report, status, detaining power, and prisoner of war or civilian internee camp site. Records of prisoners of the Japanese who died also document whether the prisoner was on a Japanese ship that sank or if he or she died during transport from the Philippine Islands to Japan. There are no records for some prisoners of war whose names appear in the lists or cables transmitted to the Office of the Provost Marshal General by the International Committee of the Red Cross."
The U.S. War Department used punched cards to manage this information, although "The punch card records were transferred to NARA with virtually no agency documentation." According to the Custodial History Note:
"The U.S. Army transferred punch card records of World War II prisoners of war (POWs) to NARA as a unique series in its 1959 transfer of all of the U.S. Army's Departmental Archives. In 1978 the Veterans Administration borrowed most of the punch card records of repatriated U.S. military personnel for a study of Repatriated U.S. Military Prisoners of War, migrated the data on almost all of the borrowed cards to an electronic format and returned the punch cards and two electronic records data files to NARA. In 1995 NARA migrated the data from almost all of the remaining punch card records to an electronic format and has subsequently preserved all of the records in a single data file."
It is evident that the organization of this data file assumes access to other information, also accessible in CSV files in the series, in order to interpret detailed information, such as branch of service, grade, parent unit number and detaining power. For example, records appear in the following format:
O&745255ABDALLAH EDWARD A 2 LT G1AC 200803413223003620O7222094171035
32214872ABDALLAH JOSEPH T CPL 61INF10230241231100157069802075181087
36336867ABDAY JOSEPH C PVT 81INF10170231611100168069516075181004
constituting a serial number, then a name, then a textual code for rank; followed by a string, (starting G1AC on the first line) which encodes the remaining information. For example, the first digit (G) can be looked up in cl_1279.csv to decode ‘2nd lieutenant’, corroborating in this case the appearance of '2 LT. 'AC' indicates 'armofservicecode: AIR CORPS', but less obviously, 'detainingpower: Germany'; 'race: White' and 'theater: European Theater: Germany'. This single line is the entirety of the information provided per person instance by the NARA series. Users of this potentially valuable resource must develop automation in order to be able to search and employ it effectively; no such tools or specification from which software might be developed immediately is provided.
Significantly, this task is hampered by evidence of corruption of the some of the information, which may be due solely to the digitization process mentioned above being applied to the paper records, but possibly with subsequent contribution of fixity effects. NARA documentation does not refer to data integrity issues and, especially since the dataset which NARA provides is large, it may only be during development of automation to employ the series that such issues are discovered. Examples of problems include substitution of characters, such as 'O' replacing '0' and vice-versa; '}' replacing '3' and '&' replacing '8', or less obviously 'L' mis-recognized as '-' and 'II' replacing 'H'.
12138003 AREY GERALD J S SG 41AC 2002064123S55}340069802055181033
Ideally, access to high resolution scans of the paper documents could be used to address these issues, or external documents. However, checking for completeness of each of the components of a person record enables detection of compromised entries and, where character substitution affects decoding of key information, other contextual information is often available to validate decoding such strings with these characters re-substituted. The larger percentage of strings which already decode plausibly without intervention do not contain incidences of such characters (so there is strong evidence that they are invalid in particular positions.
Unfortunately, there is a proportion of digital records with more severe corruption which cannot be addressed without access to scanned imagery of the paper records, for example:
O&557875ANDREW THOMAS A 2 LT G1AC 2011094115 70140
6881276AFTEWICZ EDWARD L PVT 81INF10150231321100135069508065181004
6 APLIN -OR-& - 3 1INF102 1 1 0 1 1
As of the initial date of this deposit is anticipated that such access will be possible to support further work on this series.
The dataset in this deposit does not contain records for which decoding is compromised to the extent that information to populate a basic person schema is incomplete. However, although 36,791 of the 143,374 person records in the NARA series were found to be compromised in some way, 19,624 of those have been substantially decoded and/or repaired and further work is being undertaken to both improve decoding of the 126,207 available here and to retrieve others among the 17,167 which are currently inaccessible.
This dataset has been enhanced to present the original NARA 'single data file' as a JSON resource which is more accessible for search and analysis, since each record is document-oriented (containing labels and values for each field, together with provenance information) for example:
{
"$schema": "https://schemata.hasdai.org/historic-persons/historic-person-entry-v0.0.2.json",
"location": [
{
"association": "military service",
"transcription": "European Theater: Germany"
},
{
"association": "interred",
"transcription": "Stalag 2D Stargard Pomerania, Prussia 53-15"
}
],
"name": {
"familyname": "AARON",
"givenname": "JACK",
"rank": "SGT",
"transcription": "AARON JACK"
},
"set": {
"id": "https://persons.freizo.org/export/pow/1.0.0",
"partof": "10.5281/zenodo.3565392",
"title": "WDAGO-0326"
},
"source": {
"type": "data file"
}
},
The schema employed here serves a specific purpose, in addition to on-going work identifying and correcting errors in the NARA data: it supports work to discover other instances of persons appearing in this NARA series 0326, which also appear in external documentation. For example, in a separate collaborative project with Europa Institute at the University of Basel, a benchmark dataset has been produced based on listings of foreign residents in the Asian Directories and Chronicles, which forms a deposit at 10.5281/zenodo.2580997 and employs a compatible schema for the purpose of efficient comparison with this and other datasets. Other schemata could be employed for different purposes—leading to alternate datasets, all derived from series 0326. The full extent of information currently decoded from NARA series 0326 is presented at https://pow.freizo.org/ which provides search facilities by person name, plus interactive filters for person rank, service and theater of conflict.
This interactive map commemorates Canada’s participation in armed conflicts at home and abroad by highlighting a sample of the many geographical features and places named for those that served our country. These commemorative geographical names help us remember war casualties, soldiers, sailors, airmen and airwomen, military leaders, and civilians recognized or decorated for outstanding acts of bravery and sacrifice in battle. These names also commemorate notable battles in which Canada participated, and Canadian military units, regiments, squadrons, and ships in which Canadians served. Federal, provincial and territorial members of the Geographical Names Board of Canada provided these commemorative names for the development of the map. Many more commemorative place names exist in Canada, and will be added in future releases of this evergreen interactive map. If you would like to contribute names to this project, please contact the Geographical Names Board of Canada Secretariat at Natural Resources Canada.
Not seeing a result you expected?
Learn how you can add new datasets to our index.
A dataset to advance the study of life-cycle interactions of biomedical and socioeconomic factors in the aging process. The EI project has assembled a variety of large datasets covering the life histories of approximately 39,616 white male volunteers (drawn from a random sample of 331 companies) who served in the Union Army (UA), and of about 6,000 African-American veterans from 51 randomly selected United States Colored Troops companies (USCT). Their military records were linked to pension and medical records that detailed the soldiers������?? health status and socioeconomic and family characteristics. Each soldier was searched for in the US decennial census for the years in which they were most likely to be found alive (1850, 1860, 1880, 1900, 1910). In addition, a sample consisting of 70,000 men examined for service in the Union Army between September 1864 and April 1865 has been assembled and linked only to census records. These records will be useful for life-cycle comparisons of those accepted and rejected for service. Military Data: The military service and wartime medical histories of the UA and USCT men were collected from the Union Army and United States Colored Troops military service records, carded medical records, and other wartime documents. Pension Data: Wherever possible, the UA and USCT samples have been linked to pension records, including surgeon''''s certificates. About 70% of men in the Union Army sample have a pension. These records provide the bulk of the socioeconomic and demographic information on these men from the late 1800s through the early 1900s, including family structure and employment information. In addition, the surgeon''''s certificates provide rich medical histories, with an average of 5 examinations per linked recruit for the UA, and about 2.5 exams per USCT recruit. Census Data: Both early and late-age familial and socioeconomic information is collected from the manuscript schedules of the federal censuses of 1850, 1860, 1870 (incomplete), 1880, 1900, and 1910. Data Availability: All of the datasets (Military Union Army; linked Census; Surgeon''''s Certificates; Examination Records, and supporting ecological and environmental variables) are publicly available from ICPSR. In addition, copies on CD-ROM may be obtained from the CPE, which also maintains an interactive Internet Data Archive and Documentation Library, which can be accessed on the Project Website. * Dates of Study: 1850-1910 * Study Features: Longitudinal, Minority Oversamples * Sample Size: ** Union Army: 35,747 ** Colored Troops: 6,187 ** Examination Sample: 70,800 ICPSR Link: http://www.icpsr.umich.edu/icpsrweb/ICPSR/studies/06836