What is it about?

For official statistics, Big Data open new opportunities: Statistical products may be delivered in shorter time, with more detailed breakdowns, at lesser costs, and with reduced response burden. However, a number of challenges are involved in using Big Data in official statistics: Solutions for methodological and technological issues are needed, a quality framework must be developed, and the staff has to get acquainted with new skills. Further issues concern the statistical environment such as legislative requirements, costs of sourcing of Big Data, and privacy, and have only indirectly to do with the statistical production. Finding solutions for these issues and developing standards that will be accepted internationally may require substantial efforts and take some time.

Featured Image

Why is it important?

Lessons learned from Big Data projetcs show that official statistics cannot expect that Big Data will substitute actual data sources like data from surveys and administration; Big Data may be used as supplements for existing data in the production of certain statistics. This will allow taking advantage of their high actuality and might reduce the response burden on some respondents. However, finding solutions for dealing with the various methodological and other issues and developing standards that will be accepted internationally may require substantial efforts and take time.

Perspectives

Big Data still is an exciting notion, and many projects have shown how successful the use of such data can be in particular in business applications. In official statistics, in spite of substantial efforts by highly competent experts during the last five or more years it is not clear whether the high expectations will be fulfilled in the near future.

Dr Peter Hackl
Vienna University of Economics and Business

Read the Original

This page is a summary of: Big Data: What can official statistics expect?, Statistical Journal of the IAOS, February 2016, IOS Press,
DOI: 10.3233/sji-160965.
You can read the full text:

Read

Contributors

The following have contributed to this page