UK Data Service data catalogue record for:

New Earnings Survey Panel Dataset, 1975-2016: Secure Access

Title details

SN: 6706
Title: New Earnings Survey Panel Dataset, 1975-2016: Secure Access
Alternative title: NESPD
Persistent identifier: 10.5255/UKDA-SN-6706-7
Depositor: Office for National Statistics
Principal investigator(s): Office for National Statistics
Data collector(s): Office for National Statistics
Sponsor(s): Office for National Statistics


The citation for this study is:

Office for National Statistics. (2017). New Earnings Survey Panel Dataset, 1975-2016: Secure Access. [data collection]. 7th Edition. UK Data Service. SN: 6706,

Select the text above to add data citation in your outputs.

Select citation format: 
XML citation formats:  CSL  EndNote

Subject Categories

General - Employment and labour
Income, property and investment - Economics


Abstract copyright UK Data Service and data collection copyright owner.

The New Annual Survey Panel Dataset (NESPD) contains the New Earnings Survey (NES) data (UK Data Archive SN 6704) in panel form. The NES is sampled on individuals whose National Insurance numbers end in a given pair of digits. Since the same pair of terminating digits are used as the basis for each year's sample, a panel is automatically generated within the surveys.

The NES is an annual survey of the earnings of employees in Great Britain. Its primary purpose is to obtain information about the levels, distribution and make-up of earnings, and for the collective agreements that cover them. It is designed to represent all categories of employees in businesses of all kinds and sizes. The questionnaire is directed to the employer, who completes it on the basis of payroll records for the employee. The earnings, hours of work and other information relate to a specified week in April of each year. The NESPD is a reduced form of the NES as it is based on a consistent variable sample.

Please see the catalogue record for UK Data Archive SN 6704 for a fuller description of the NES.

For the seventh edition (July 2017), data for 2016 have been added to the study.
Main Topics:
The NES and the NESPD include the following data for employees in all industries and occupations and for the major national collective agreements:
  • levels, distributions and make-up of earnings
  • hours worked
  • industry
  • occupation
  • place of work
  • gender
  • age

Coverage, universe, methodology

Time period: 1975 - 2016
Country: Great Britain
Spatial units: Government Office Regions
Westminster Parliamentary Constituencies
Local Authority Districts
Travel to Work Areas
Observation units: Individuals
Kind of data: Alpha/numeric data
Individual (micro) level
Universe: National
Working individuals aged from 16 years residing and working in Great Britain in 1975-2016.
Time dimensions: Longitudinal/panel/cohort
Sampling procedures: Simple random sample
One per cent sample of individuals from National Insurance records
Number of units: Approximately 140,000 to 180,000 individuals
Method of data collection: Compilation or synthesis of existing material
Panel version of NES
Weighting: No weighting used

Thesaurus search on keywords

Administrative and access information

Date of release:
First edition: 25 March 2011
Latest edition: 13 July 2017 (7th Edition)
Copyright: Crown copyright material is reproduced with the permission of the Controller of HMSO and the Queen's Printer for Scotland
Access conditions: Registration is required and standard conditions of use apply. The depositor may be informed about usage. Controlled data requirements and conditions also apply. Further information is available from Access Secure Lab.

In addition, the Service is required to request explicit permission from the data owner prior to providing the researcher with access to the data

Please note:
Since these data are more sensitive and/or pose a higher risk of disclosure than data made available under the standard End User Licence, they are not available for download but may be accessed through our Secure Lab. Access requires: ONS Accredited Researcher status (including the requirement to attend and pass the Safe User of Research data Environments (SURE) training course); submission of a project proposal; and completion of a Secure Access User Agreement. This is to ensure that the guarantee of confidentiality given to survey respondents is protected. Users are required to read and follow the Microdata Handling and Security: Guide to Good Practice.

To apply for access, users should use the Download/Order link on this page and will be directed to the relevant forms as part of the ordering process.

Availability: UK Data Service
Contact: Get in touch


Title File Name Size (KB)
NESPD Variable Catalogue ashe_panel_vml_var_cat.xls 32
UK Data Archive Data Dictionary 6706allfiles_ukda_data_dictionary.pdf 424
NES and NESPD Occupational Codes 6706occupational_codes.pdf 3299
NESPD User Guide 2003/2007 6706userguide.pdf 6830
NESPD/ASHEPD User Documentation 2012 6706userguide_2012.pdf 3036
NESPD/ASHEPD User Documentation 2013 6706userguide_2013.pdf 415
NESPD/ASHEPD User Documentation 2014 6706userguide_2014.pdf 307
NESPD/ASHEPD User Documentation 2016 6706userguide_2016.pdf 1107
Study information and citation UKDA_Study_6706_Information.htm 6
READ File read6706.htm 11
View related studies and guides... Hide related studies and guides...


View publications... Hide publications...

By principal investigator(s):

Resulting from secondary analysis:
Tarasonis, L. (2013) Three essays on wage information in imperfect labour markets, unpublished Ph.D. thesis, University of Bristol.

Adam, S., Phillips, D. and Roantree, B. (2017) 35 years of reforms: a panel analysis of the incidence of, and employee and employer responses to, Social Security contributions in the UK, NBER Working Paper No. 23336. Retrieved July 5th, 2017 from

Adam, S., Browne, J., Phillips, D. and Roantree, B. (2017) Frictions and taxpayer responses: evidence from bunching at personal tax thresholds, IFS Working Paper (W17/14), London: Institute for Fiscal Studies. Retrieved September 25, 2017 from

Schaefer, D. and Singleton, C. (2017) Real wages and hours in the Great Recession: evidence from firms and their entry-level jobs, CESifo Working Paper No. 6766, November. Retrieved December 8th, 2017 from

Schaefer, D. and Singleton, C. (2017), Recent changes in British wage inequality: evidence from firms and occupations, No 459, 2017 Meeting Papers, Society for Economic Dynamics. Retrieved December 8th, 2017 from


No previously uploaded files

  (login required)

Upload syntax/code file

New Earnings Survey Panel Dataset, 1975-2016: Secure Access

I agree to the terms and conditions *

Confirm new syntax/code file version

A previous version of syntax file "" has already been uploaded and approved.

If you continue with this upload, the previous version of the syntax file will be overwritten with this new version.

This new version of the syntax file will be subject to the UK Data Service approval process before it becomes available for download.

Do you want to continue?


Back to top