1.1. Contact organisation
Office for National Statistics
1.2. Contact organisation unit
Labour Market Division
1.3. Contact name
Confidential because of GDPR1.4. Contact person function
Confidential because of GDPR1.5. Contact mail address
1.6. Contact email address
Confidential because of GDPR1.7. Contact phone number
Confidential because of GDPR1.8. Contact fax number
Confidential because of GDPR2.1. Data description
[Not requested]
2.2. Classification system
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
2.3. Coverage - sector
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
2.4. Statistical concepts and definitions
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
2.5. Statistical unit
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
2.6. Statistical population
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
2.7. Reference area
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
2.8. Coverage - Time
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
2.9. Base period
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
3.1. Source data
ASHE is based on a 1% sample of employee jobs from the UK PAYE (Pay As You Earn) tax register held by HM Revenue and Customs. All employees with National Insurance numbers ending in a particular pair of digits are selected and questionnaires are sent to their employers. This method gives a random 1% sample of the frame population to be selected, across businesses in all industries and of all sizes. Since National Insurance numbers are allocated randomly to individuals, the basis of ASHE sampling is probability sampling. However, the same pair of digits for National Insurance numbers is chosen each year to allow continuity in the data and enable comparisons of earnings year on year.
3.2. Frequency of data collection
[Not requested]
3.3. Data collection
[Not requested]
3.4. Data validation
[Not requested]
3.5. Data compilation
[Not requested]
3.6. Adjustment
[Not requested]
4.1. Quality assurance
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
4.2. Quality management - assessment
[Not requested]
5.1. Relevance - User Needs
The data for the UK Structure of Earnings Survey (SES) is taken from the Annual Survey of Hours and Earnings (ASHE). This is the most comprehensive source of data on the structure of earnings in the UK. ASHE estimates are used throughout government for policy purposes, such as setting the National Minimum Wage, looking at gender pay issues, pensions policy, transport policy, allocation of local government grants, allocation of health funding and estimating effects of tax changes. They are also used in the wider community for wage negotiations, research projects, recruitment and a wide variety of other purposes. Some government departments and academics have access to the microdata through data access agreements. Other users request ad-hoc analyses, which are produced by the Office for National Statistics (ONS) at a charge. Some of the main users of ASHE data include HM Treasury, the Low Pay Commission, the Department for Business, Innovation and Skills, the Department for Work and Pensions, and the Department of Health. Standing instructions on the control of government statistical surveys require that regular annual surveys to businesses and local authorities are reviewed at least once every five years. Feedback from key ASHE users has shown that the data collected meets most of their needs. Additional data will be collected from 2013 in order to meet the emerging needs of some users.
The 2011 provisional ASHE estimates, from which the SES 2010 data are taken, were published in full and were complete. The published tables are released in the public domain and are available on the ONS website along with articles of interest and methodological information. Some ministers and nominated individuals from government departments have pre-release access to the published results 24 hours prior to the release.
5.2. Relevance - User Satisfaction
Government users
ONS has established an ASHE user group which meets annually and includes representatives from 23 teams in 17 government departments. This group discusses changes to the questionnaire, methodology and survey outputs. ONS also meets with some of these users as and when necessary.
ONS conducted a triennial review of ASHE in 2011 which included a user questionnaire. With few exceptions, users said that they regarded the ASHE data and outputs as ‘good’ or better in respect of their accuracy, relevance, timeliness, coherence, comparability and accessibility.
Non-government users
ONS conducted four strands of research into the uses made of ASHE by non-government users between 2012 and 2013. Feedback from these users indicated that the majority were satisfied or very satisfied with the extent to which ASHE outputs met their needs.
5.3. Completeness
[Not requested]
5.3.1. Data completeness - rate
[Not requested]
-
6.1. Accuracy - overall
[Not requested]
6.2. Sampling error
Sampling error occurs because estimates are based on a sample rather than a census. ASHE estimates this error through coefficients of variation (CV) which are published alongside all ASHE outputs. The CV is the ratio of the standard error of an estimate to the estimate itself, expressed as a percentage. Generally, if all other factors are constant, the smaller the CV the higher the quality of the estimate.
6.2.1. Sampling error - indicators
The tables in the attached document Sampling errors display mean values and coefficients of variation (CV) for male, female, full-time and part-time breakdowns covering hourly and monthly earnings. These statistics are available by age band, level of education (ISCED), major occupation group (ISCO-08), industry (NACE section), region (NUTS Level 1) and enterprise size band.
Annexes:
Sampling errors
6.3. Non-sampling error
ASHE statistics are also subject to non-sampling errors. For example, there are known differences between the coverage of the ASHE sample and the target population (i.e. all employee jobs). Further, non-response bias may also affect ASHE estimates. This may happen if the jobs for which respondents do not provide information are different to the jobs for which respondents do provide information.
In addition, ASHE results tables do not account for differences in the composition of different 'slices' of the employee workforce. For example, figures for the public and private sectors include all jobs in those sectors and are not adjusted to account for differences in the age, qualifications or seniority of the employees or the nature of their jobs; all factors which may affect how much employees earn.
6.3.1. Coverage error
The use of the sampling procedure described above results in areas of under-coverage. For example, some low-paid jobs in businesses that do not operate PAYE schemes are not on the PAYE register. An investigation into this in 2004-2005 showed that the impact of this under-coverage on ASHE estimates was very small. In addition, the ASHE sample does not include the self-employed, employees working abroad or working in the armed forces.
All employees who had a period of unpaid absence during the reference month have been excluded from the SES dataset. This will not affect the weights as they have been calculated based on the exclusion of those employees whose pay for the pay period was not affected by absence.
6.3.1.1. Over-coverage - rate
ASHE also selects people outside of the scope of the Structure of Earnings Survey, i.e. those in agricultural industries, but these employees have been removed from the SES dataset.
6.3.1.2. Common units - proportion
[Not requested]
6.3.2. Measurement error
The ASHE questionnaire underwent a major redesign in 2004, at which point the questions were fully tested and approved. ONS data validation and survey methodology colleagues review the content and design of the questionnaire annually. Missing data for key variables are imputed on the basis of shared characteristics with imputation ‘donors’.
Although ASHE collects information on bonuses, it is known that some respondents do not have access to this information at the time of responding. Consequently, the levels of gross pay for some individuals on the SES dataset may be lower than they are in reality. It is not possible to quantify the impact of the under-coverage of bonus payments.
6.3.3. Non response error
The table below displays response rates for the Annual Survey of Hours and Earnings 2011 (provisional). The unit considered for response purposes is individual employee jobs; therefore response rates are expressed in terms of employee job records. Note that data from respondents in Northern Ireland are collected via the Department of Enterprise, Trade and Investment, Northern Ireland (DETINI) on behalf of ONS; hence the table displays response rates for Great Britain, Northern Ireland and the UK.
| Great Britain | Northern Ireland | UK | ||||
| Questionnaires | Rate (%) | Questionnaires | Rate (%) | Questionnaires | Rate (%) | |
| Despatched | 296.795 | 6.838 | 303.633 | |||
| Received | 246.325 | 83,0 | 6.680 | 97,7 | 253.005 | 83,3 |
| Valid for ASHE | 184.498 | 62,1 | 5.770 | 84,4 | 190.268 | 62,7 |
| Valid for SES | 174.499 | 58,8 | 5.218 | 76,3 | 179.717 | 59,2 |
Item non-response is dealt with differently for variables relating to hours and pay than other variables. For five main variables (annual gross pay, basic pay, basic hours, overtime pay and overtime hours) imputation is done in full for the Annual Survey of Hours and Earnings, from which SES is derived. Donor imputation is performed by the BANFF imputation tool written in SAS.
Imputation classes are defined with relation to occupation, region, sex, adult rate marker and age band to define donor sets. Donors are then selected from another record within the appropriate donor set with similar responses for other pay and hours variables.
6.3.3.1. Unit non-response - rate
[Not requested]
6.3.3.2. Item non-response - rate
[Not requested]
6.3.4. Processing error
ASHE employs a range of validation checks referred to as selective editing to identify potential errors in the data collected. This system ranks all potential errors based on the level of impact that the data item would have on aggregate statistics for key variables if that data item was found to be in error. Errors with the highest selective editing scores, i.e. with the highest potential impact on aggregate statistics, are validated. In these cases, respondents are contacted via telephone to validate the data they have returned. A selective editing approach to data processing does not aspire to achieve accuracy throughout the dataset at microdata level, since it does not flag data that may be in error but that would have little impact on aggregate statistics. Instead, prioritising high-impact data items allows ONS to target validation resources in the most efficient way.
6.3.4.1. Imputation - rate
The table below shows item non-response for the five main variables prior to imputation in ASHE 2011, based on 190,268 records.
| Variable | Basic pay | Overtime pay | Basic hours | Overtime hours | Annual gross pay |
| Imputation rate (%) | 1.0 | 0.1 | 1.7 | 0.6 | 1.0 |
Other variables, e.g. classification variables, are not imputed for within the Annual Survey of Hours and Earnings. The highest level of educational attainment is not collected within the ASHE. The values for this variable have been imputed using donors with similar characteristics from the Labour Force Survey (LFS).
6.3.5. Model assumption error
The sample unit for the survey is individual employee jobs. Investigations have shown that not all respondents are equally likely to respond to the survey. For example, respondents in higher earning occupations are less likely to respond that those in lower earning occupations. Therefore, a weighting system is used which takes account of the factors that have been shown to relate most to the likelihood of response and relative earning levels. This weighting system uses 108 weighting classes based on occupation (nine classes), age (three classes), gender (two classes) and geographic location (two classes). Responses within these classes are weighted to population totals taken from the LFS, which in turn is benchmarked against the Census. Note that there is no intermediate stage of weighting to local unit.
6.4. Seasonal adjustment
[Not requested]
6.5. Data revision - policy
[Not requested]
6.6. Data revision - practice
[Not requested]
6.6.1. Data revision - average size
[Not requested]
7.1. Timeliness
The reference month used for the Annual Survey of Hours and Earnings, that the SES 2010 is based on, is April 2011. ASHE and its predecessor, the New Earnings Survey, have been conducted in April of each year since 1975. The April 2011 survey was chosen rather than April 2010 for SES 2010 because data collected for the tax year ending in April 2011 would result in annual data with nine months of relevant coverage.
7.1.1. Time lag - first result
[Not requested]
7.1.2. Time lag - final result
[Not requested]
7.2. Punctuality
The table below displays a basic timetable of events for the 2011 Annual Survey of Hours and Earnings.
| Timetable for 2011 Annual Survey of Hours and Earnings | |
| Main despatch of questionnaires | 11-15 April 2011 |
| Survey reference date (for the pay period including) | 13 April 2011 |
| Despatch of reminders | Mid-June 2011 |
| End of collection and validation phase | Early-September 2011 |
| First release of 2011 results | 23 November 2011 |
7.2.1. Punctuality - delivery and publication
[Not requested]
8.1. Comparability - geographical
As far as possible the definitions used in the UK SES meet those specified in the Eurostat regulations and hence will be broadly comparable to other European member states. Any deviations from the definitions have been described elsewhere in this report.
8.1.1. Asymmetry for mirror flow statistics - coefficient
[Not requested]
8.2. Comparability - over time
The only significant change since the 2006 SES was the move, in 2011, to the Standard Occupational Classification 2010 (SOC 2010), which replaced the Standard Occupational Classification 2000 (SOC 2000). This affected the calibration weights for individual ASHE records. At UK level, the difference between the SOC 2000 estimate and the SOC 2010 estimate for full-time median gross weekly earnings in 2011 was 0.5%.
8.2.1. Length of comparable time series
[Not requested]
8.3. Coherence - cross domain
The current year of ASHE statistics is provisional and is then revised when the following year is published, as this is when information from any late returns is added to the current year. Therefore the ASHE 2011 microdata, from which the SES 2010 is taken, were provisional at the time of transmission. The number of late returns is small and so there is rarely a large difference in provisional and revised ASHE statistics.
The two main alternative sources of earnings data in the UK are the Average Weekly Earnings (AWE) statistic and the Labour Force Survey. The AWE statistic, based on the Monthly Wages and Salaries Survey of about 9,000 employers, is the lead measure of short-term changes in average earnings in Great Britain and figures are broadly in line with estimates produced from ASHE (although methodological differences between the surveys make comparisons difficult, especially as AWE has more complete coverage of bonus pay than ASHE). AWE figures are available with industrial breakdowns and public/private sector splits. However no information is available on occupation, hours worked, and other characteristics of the workforce. The LFS collects information on the earnings and normal and actual hours worked of about 15,000 people aged 16 and over each quarter. In addition it collects data on a wide range of personal characteristics, including education level and ethnic origin. This enables the preparation of statistics on levels and distribution of earnings similar to ASHE but with lower precision due to the much smaller sample size.
8.4. Coherence - sub annual and annual statistics
[Not requested]
8.5. Coherence - National Accounts
[Not requested]
8.6. Coherence - internal
[Not requested]
9.1. Dissemination format - News release
[Not requested]
9.2. Dissemination format - Publications
The ASHE results published are not wholly consistent with the SES data, since the requirements of the regulation differ from the normal survey practices.
9.3. Dissemination format - online database
Full results of the 2011 provisional Annual Survey of Hours and Earnings are published on the ONS website (http://www.ons.gov.uk/ons/rel/ashe/annual-survey-of-hours-and-earnings/2011-provisional-results--soc-2010-/index.html) in a series of standard Excel tables. All statistics have accompanying coefficient of variation levels.
9.3.1. Data tables - consultations
[Not requested]
9.4. Dissemination format - microdata access
It is possible, under certain circumstances, for researchers to obtain access to the microdata with a data access agreement in place. Any analysis can be carried out at the Virtual Microdata Laboratories at ONS’s London and Newport sites.
9.5. Dissemination format - other
ONS's recommended format for accessible content is a combination of HTML web pages for narrative, charts and graphs, with data being provided in usable formats such as CSV and Excel. The ONS website also offers users the option to download the narrative in PDF format. In some instances other software may be used, or may be available on request.
9.6. Documentation on methodology
The statistical bulletin that accompanies the release of the ASHE results contains high-level metadata. A more detailed Quality and Methodology Information report with additional methodological information is published on the ONS website at http://www.ons.gov.uk/ons/guide-method/method-quality/quality/quality-information/labour-market/index.html. This report describes the intended uses of the statistics presented in the publication, their general quality and the methods used to produce them. Further information is also available from the ASHE Guidance and Methodology section at http://www.ons.gov.uk/ons/guide-method/method-quality/specific/labour-market/annual-survey-of-hours-and-earnings/annual-survey-of-hours-and-earnings/index.html. In addition, an ASHE User Group meets regularly to discuss data issues.
9.7. Quality management - documentation
[Not requested]
9.7.1. Metadata completeness - rate
[Not requested]
9.7.2. Metadata - consultations
[Not requested]
[Not requested]
11.1. Confidentiality - policy
[Not requested]
11.2. Confidentiality - data treatment
[Not requested]
N/A
[Not requested]
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
Not available.
New concept added with the migration to SIMS 2.0.
Information (content) will be available after the next collection.
[Not requested]
[Not requested]
ASHE is based on a 1% sample of employee jobs from the UK PAYE (Pay As You Earn) tax register held by HM Revenue and Customs. All employees with National Insurance numbers ending in a particular pair of digits are selected and questionnaires are sent to their employers. This method gives a random 1% sample of the frame population to be selected, across businesses in all industries and of all sizes. Since National Insurance numbers are allocated randomly to individuals, the basis of ASHE sampling is probability sampling. However, the same pair of digits for National Insurance numbers is chosen each year to allow continuity in the data and enable comparisons of earnings year on year.
The reference month used for the Annual Survey of Hours and Earnings, that the SES 2010 is based on, is April 2011. ASHE and its predecessor, the New Earnings Survey, have been conducted in April of each year since 1975. The April 2011 survey was chosen rather than April 2010 for SES 2010 because data collected for the tax year ending in April 2011 would result in annual data with nine months of relevant coverage.
As far as possible the definitions used in the UK SES meet those specified in the Eurostat regulations and hence will be broadly comparable to other European member states. Any deviations from the definitions have been described elsewhere in this report.
The only significant change since the 2006 SES was the move, in 2011, to the Standard Occupational Classification 2010 (SOC 2010), which replaced the Standard Occupational Classification 2000 (SOC 2000). This affected the calibration weights for individual ASHE records. At UK level, the difference between the SOC 2000 estimate and the SOC 2010 estimate for full-time median gross weekly earnings in 2011 was 0.5%.