analyze the current population survey (cps) annual social and economic supplement (asec) with r the annual march cps-asec has been supplying the statistics for the census bureau's report on income, poverty, and health insurance coverage since 1948. wow. the us census bureau and the bureau of labor statistics ( bls) tag-team on this one. until the american community survey (acs) hit the scene in the early aughts (2000s), the current population survey had the largest sample size of all the annual general demographic data sets outside of the decennial census - about two hundred thousand respondents. this provides enough sample to conduct state- and a few large metro area-level analyses. your sample size will vanish if you start investigating subgroups b y state - consider pooling multiple years. county-level is a no-no. despite the american community survey's larger size, the cps-asec contains many more variables related to employment, sources of income, and insurance - and can be trended back to harry truman's presidency. aside from questions specifically asked about an annual experience (like income), many of the questions in this march data set should be t reated as point-in-time statistics. cps-asec generalizes to the united states non-institutional, non-active duty military population. the national bureau of economic research (nber) provides sas, spss, and stata importation scripts to create a rectangular file (rectangular data means only person-level records; household- and family-level information gets attached to each person). to import these files into r, the parse.SAScii function uses nber's sas code to determine how to import the fixed-width file, then RSQLite to put everything into a schnazzy database. you can try reading through the nber march 2012 sas importation code yourself, but it's a bit of a proc freak show. this new github repository contains three scripts: 2005-2012 asec - download all microdata.R down load the fixed-width file containing household, family, and person records import by separating this file into three tables, then merge 'em together at the person-level download the fixed-width file containing the person-level replicate weights merge the rectangular person-level file with the replicate weights, then store it in a sql database create a new variable - one - in the data table 2012 asec - analysis examples.R connect to the sql database created by the 'download all microdata' progr am create the complex sample survey object, using the replicate weights perform a boatload of analysis examples replicate census estimates - 2011.R connect to the sql database created by the 'download all microdata' program create the complex sample survey object, using the replicate weights match the sas output shown in the png file below 2011 asec replicate weight sas output.png statistic and standard error generated from the replicate-weighted example sas script contained in this census-provided person replicate weights usage instructions document. click here to view these three scripts for more detail about the current population survey - annual social and economic supplement (cps-asec), visit: the census bureau's current population survey page the bureau of labor statistics' current population survey page the current population survey's wikipedia article notes: interviews are conducted in march about experiences during the previous year. the file labeled 2012 includes information (income, work experience, health insurance) pertaining to 2011. when you use the current populat ion survey to talk about america, subract a year from the data file name. as of the 2010 file (the interview focusing on america during 2009), the cps-asec contains exciting new medical out-of-pocket spending variables most useful for supplemental (medical spending-adjusted) poverty research. confidential to sas, spss, stata, sudaan users: why are you still rubbing two sticks together after we've invented the butane lighter? time to transition to r. :D

analyze the area resource file (arf) with r the arf is fun to say out loud. it's also a single county-level data table with about 6,000 variables, produced by the united states health services and resources administration (hrsa). the file contains health information and statistics for over 3,000 us counties. like many government agencies, hrsa provides only a sas importation script and an as cii file. this new github repository contains two scripts: 2011-2012 arf - download.R download the zipped area resource file directly onto your local computer load the entire table into a temporary sql database save the condensed file as an R data file (.rda), comma-separated value file (.csv), and/or stata-readable file (.dta). 2011-2012 arf - analysis examples.R limit the arf to the variables necessary for your analysis sum up a few county-level statistics merge the arf onto other data sets, using both fips and ssa county codes create a sweet county-level map click here to view these two scripts for mo re detail about the area resource file (arf), visit: the arf home page the hrsa data warehouse notes: the arf may not be a survey data set itself, but it's particularly useful to merge onto other survey data. confidential to sas, spss, stata, and sudaan users: time to put down the abacus. time to transition to r. :D

The Crime Survey for England and Wales (CSEW) asks a sole adult in a random sample of households about their, or their household's, experience of crime victimisation in the previous 12 months. These are recorded in the victim form data file (VF). A wide range of questions are then asked, covering demographics and crime-related subjects such as attitudes to the police and the criminal justice system (CJS). These variables are contained within the non-victim form (NVF) data file. In 2009, the survey was extended to children aged 10-15 years old; one resident of that age range was also selected from the household and asked about their experience of crime and other related topics. The first set of children's data covered January-December 2009 and is held separately under SN 6601. From 2009-2010, the children's data cover the same period as the adult data and are included with the main study.

The Telephone-operated Crime Survey for England and Wales (TCSEW) became operational on 20 May 2020. It was a replacement for the face-to-face CSEW, which was suspended on 17 March 2020 because of the coronavirus (COVID-19) pandemic. It was set up with the intention of measuring the level of crime during the pandemic. As the pandemic continued throughout the 2020/21 survey year, questions have been raised as to whether the year ending March 2021 TCSEW is comparable with estimates produced in earlier years by the face-to-face CSEW. The ONS Comparability between the Telephone-operated Crime Survey for England and Wales and the face-to-face Crime Survey for England and Wales report explores those factors that may have a bearing on the comparability of estimates between the TCSEW and the former CSEW. These include survey design, sample design, questionnaire changes and modal changes.

More general information about the CSEW may be found on the ONS Crime Survey for England and Wales web page and for the previous BCS, from the GOV.UK BCS Methodology web page.

History - the British Crime Survey

The CSEW was formerly known as the British Crime Survey (BCS), and has been in existence since 1981. The 1982 and 1988 BCS waves were also conducted in Scotland (data held separately under SNs 4368 and 4599). Since 1993, separate Scottish Crime and Justice Surveys have been conducted. Up to 2001, the BCS was conducted biennially. From April 2001, the Office for National Statistics took over the survey and it became the CSEW. Interviewing was then carried out continually and reported on in financial year cycles. The crime reference period was altered to accommodate this.

Secure Access CSEW data
In addition to the main survey, a series of questions covering drinking behaviour, drug use, self-offending, gangs and personal security, and intimate personal violence (IPV) (including stalking and sexual victimisation) are asked of adults via a laptop-based self-completion module (questions may vary over the years). Children aged 10-15 years also complete a separate self-completion questionnaire. The questionnaires are included in the main documentation, but the data are only available under Secure Access conditions (see SN 7280), not with the main study. In addition, from 2011 onwards, lower-level geographic variables are also available under Secure Access conditions (see SN 7311).

New methodology for capping the number of incidents from 2017-18
The CSEW datasets available from 2017-18 onwards are based on a new methodology of capping the number of incidents at the 98th percentile. Incidence variables names have remained consistent with previously supplied data but due to the fact they are based on the new 98th percentile cap, and old datasets are not, comparability has been lost with years prior to 2012-2013. More information can be found in the 2017-18 User Guide (see SN 8464) and the article ‘Improving victimisation estimates derived from the Crime Survey for England and Wales’.

Variable 'PFA' (Police Force Area):
From 2008-2009 onwards, the BCS variable 'PFA' (Police Force Area) is now only available within the associated dataset SN 6368, British Crime Survey, 2008-2009: Special Licence Access, Low-Level Geographic Data, which is subject to restrictive access conditions; see 'Access' section below.

2008-2009 self-completion modules:
From October 2016, the self-completion questionnaire modules covering drug use, drinking behaviour, and domestic violence, sexual victimisation and stalking are subject to Controlled data access conditions - see SN 7280.

CSEW Historic back series – dataset update (March 2022)