World Library  
Flag as Inappropriate
Email this Article

Open data

Article Id: WHEBN0007697770
Reproduction Date:

Title: Open data  
Author: World Heritage Encyclopedia
Language: English
Subject: Transport Direct, Open knowledge, Open Data in the United Kingdom, Open notebook science, Peter Murray-Rust
Collection: Free Culture Movement, Open Data
Publisher: World Heritage Encyclopedia

Open data

Open Data Map
Linked Open Data Cloud in August 2014
Clear labeling of the licensing terms is a key component of Open data, and icons like the one pictured here are being used for that purpose.

Open data is the idea that some data should be freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control.[1] The goals of the open data movement are similar to those of other "Open" movements such as open source, open hardware, open content, and open access. The philosophy behind open data has been long established (for example in the Mertonian tradition of science), but the term "open data" itself is recent, gaining popularity with the rise of the Internet and World Wide Web and, especially, with the launch of open-data government initiatives such as and


  • Overview 1
  • Major sources of open data 2
    • Open data in science 2.1
    • Open data in government 2.2
  • Arguments for and against open data 3
  • Relation to other open activities 4
  • Funders' mandates 5
  • Closed data 6
  • Organisations promoting open data 7
  • See also 8
  • References 9
  • External links 10


The concept of open data is not new; but a formalized definition is relatively new—the primary such formalization being that in the Open Definition which can be summarized in the statement that "A piece of data is open if anyone is free to use, reuse, and redistribute it — subject only, at most, to the requirement to attribute and/or share-alike."[2]

Open data is often focused on non-textual material such as maps, genomes, connectomes, chemical compounds, mathematical and scientific formulae, medical data and practice, bioscience and biodiversity. Problems often arise because these are commercially valuable or can be aggregated into works of value. Access to, or re-use of, the data is controlled by organisations, both public and private. Control may be through access restrictions, licenses, copyright, patents and charges for access or re-use. Advocates of open data argue that these restrictions are against the communal good and that these data should be made available without restriction or fee. In addition, it is important that the data are re-usable without requiring further permission, though the types of re-use (such as the creation of derivative works) may be controlled by a license.

A typical depiction of the need for open data:

Numerous scientists have pointed out the irony that right at the historical moment when we have the technologies to permit worldwide availability and distributed process of scientific data, broadening collaboration and accelerating the pace and depth of discovery…..we are busy locking up that data and preventing the use of correspondingly advanced technologies on knowledge[3] John Wilbanks, VP Science, Creative Commons

Creators of data often do not consider the need to state the conditions of ownership, licensing and re-use. For example, many scientists do not regard the published data arising from their work to be theirs to control and the act of publication in a journal is an implicit release of the data into the commons. However the lack of a license makes it difficult to determine the status of a data set and may restrict the use of data offered in an Open spirit. Because of this uncertainty it is also possible for public or private organizations to aggregate said data, protect it with copyright and then resell it. The issue of indigenous knowledge (IK) poses a great challenge in terms of capturing, storage and distribution. Many societies in third-world countries lack the technicality processes of managing the IK.

At his presentation at the XML 2005 conference, Connolly[4] displayed these two quotations regarding open data:

  • I want my data back. (Jon Bosak circa 1997)
  • I've long believed that customers of any application own the data they enter into it. [5] (This quote refers to Veen's own heart-rate data.)

Major sources of open data

Open data can come from any source. This section lists some of the fields that publish (or at least discuss publishing) a large amount of open data.

Open data in science

The concept of open access to scientific data was institutionally established with the formation of the World Data Center system, in preparation for the International Geophysical Year of 1957–1958.[6] The International Council of Scientific Unions (now the International Council for Science) established several World Data Centers to minimize the risk of data loss and to maximize data accessibility, further recommending in 1955 that data be made available in machine-readable form.[7]

While the open-science-data movement long predates the Internet, the availability of fast, ubiquitous networking has significantly changed the context of Open science data, since publishing or obtaining data has become much less expensive and time-consuming.

The Human Genome Project was a major initiative that exemplified the power of open data. It was built upon the so-called Bermuda Principles, stipulating that: "All human genomic sequence information (…) should be freely available and in the public domain in order to encourage research and development and to maximise its benefit to society’.[8] More recent initiatives such as the Structural Genomics Consortium have illustrated that the open data approach can also be used productively within the context of industrial R&D.[9]

In 2004, the Science Ministers of all nations of the

  • Open Data - An Introduction - from the Open Knowledge Foundation
  • OpenDefinition - defining 'openness' in relation to content and data
  • #opendata - short film about open government data from the Open Knowledge Foundation
  • OpenPSI the (OpenPSI project) is a community effort to create UK government linked data service that supports research. It is a collaboration between the University of Southampton and the UK government, led by OPSI at the National Archive and is supported by JISC funding.
  • Open Data Commons Database Licence (an update to the Talis Community License)
  • Open Data Commons - legal tools for open data
  • The Data Hub - a community hub for open data powered by the Open Knowledge Foundation's open source CKAN data portal platform
  • Video of Tim Berners-Lee at TED (conference) 2009 calling for "Raw Data Now"
  • Six minute Video of Tim Berners-Lee at TED (conference) 2010 showing examples of open data
  • Open Data Stack Exchange, Q&A forum on open data
  • Video of Alper Çuğun at Dutch E-Culture Days 2012 talking about the importance of open data
  • G8 Open Data Charter
  • Towards a Genealogy of Open Data - research paper tracing different historical threads contributing to current conceptions of open data.

External links

  1. ^ Auer, S. R.; Bizer, C.; Kobilarov, G.; Lehmann, J.; Cyganiak, R.; Ives, Z. (2007). "DBpedia: A Nucleus for a Web of Open Data". The Semantic Web. Lecture Notes in Computer Science 4825. p. 722.  
  2. ^ See Open Definition home page and the full Open Definition
  3. ^ Science Commons
  4. ^ Connolly, Dan (16 November 2005). "Semantic Web Data Integration with hCalendar and GRDDL". W3C Talks and Presentations. XML Conference & Exposition 2005, Atlanta, Georgia, USA: W3C. p. 2. Retrieved 2 May 2015. 
  5. ^ Veen, Jeffrey (2 November 2005). "Polar Heart Rate Monitors: Gimme my data!". A website by Jeffrey Veen. 
  6. ^ Committee on Scientific Accomplishments of Earth Observations from Space, National Research Council (2008). Earth Observations from Space: The First 50 Years of Scientific Achievements. The National Academies Press. p. 6.  
  7. ^ World Data Center System (2009-09-18). "About the World Data Center System". NOAA, National Geophysical Data Center. Retrieved 2010-11-24. 
  8. ^ Human Genome Project, 1996. Summary of Principles Agreed Upon at the First International Strategy Meeting on Human Genome Sequencing (Bermuda, 25–28 February 1996)
  9. ^ Perkmann, Markus and Schildt, Henri, Open Data Partnerships between Firms and Universities: The Role of Boundary Organizations, Research Policy 44 (2015) 1133–1143
  10. ^ OECD Declaration on Open Access to publicly funded data
  11. ^ OECD Principles and Guidelines for Access to Research Data from Public Funding
  12. ^ Dataverse Network Project
  13. ^ Gray, Jonathan. "Towards a Genealogy of Open Data". Social Science Research Network (SSRN). 
  14. ^ Brito, Jerry. "Hack, Mash, & Peer: Crowdsourcing Government Transparency". Colum. Sci. & Tech. L. Rev. 119 (2008). 
  15. ^ [10]
  16. ^ [11]
  17. ^ [12]
  18. ^ [13]
  19. ^ [14]
  20. ^ [15]
  21. ^
  22. ^ [16]
  23. ^ [17]
  24. ^ EU Open Data Portal
  25. ^ [18]
  26. ^ "The Open Data Charter: A Roadmap for Using a Global Resource". The Huffington Post. Retrieved 2015-10-29. 
  27. ^ On the road to open data, by Ian Manocha
  28. ^ "Big Data for Development: From Information- to Knowledge Societies", Martin Hilbert (2013), SSRN Scholarly Paper No. ID 2205145. Rochester, NY: Social Science Research Network;
  29. ^ How to Make the Dream Come True argues in one research area (Astronomy) that access to open data increases the rate of scientific discovery.
  30. ^ Khodiyar, Varsha. "Stopping the rot: ensuring continued access to scientific data, irrespective of age". F1000 Research. F1000. Retrieved 2015-03-11. 
  31. ^ Magee, Andrew F.; May, Michael R.; Moore, Brian R.; Murphy, William J. (24 October 2014). "The Dawn of Open Access to Phylogenetic Data". PLoS ONE 9 (10): e110268.  
  32. ^ Towards a Science Commons includes an overview of the basis of Openness in science data.
  33. ^ Protocol for Implementing Open Access Data
  34. ^ creation of term
  35. ^ Kauppinen, T.; Espindola, G. M. D. (2011). "Linked Open Science-Communicating, Sharing and Evaluating Data, Methods and Results for Executable Papers". Procedia Computer Science 4: 726.  
  36. ^ Mailing List Archive
  37. ^ Galsworthy, M.J. & McKee, M. (2013). Europe's "Horizon 2020" science funding programme: How is it shaping up? Journal of Health Services Research and Policy. doi: 10.1177/1355819613476017
  38. ^ Review of history and positions by the University of California
  39. ^ "Free our data" (The Guardian technology section)
  40. ^ GODAN background
  41. ^
  42. ^ Open Cultuur Data, Rijksmuseum, 11 September 2012
  43. ^ Linking Open Data on the Semantic Web


See also

Organisations promoting open data

  • making data available for a charge.
  • compilation in databases or websites to which only registered members or customers can have access.
  • use of a proprietary or closed technology or encryption which creates a barrier for access.
  • copyright forbidding (or obfuscating) re-use of the data.
  • patent forbidding re-use of the data (for example the 3-dimensional coordinates of some experimental protein structures have been patented)
  • restriction of robots to websites, with preference to certain search engines
  • aggregating factual data into "databases" which may be covered by "database rights" or "database directives" (e.g. Directive on the legal protection of databases)
  • time-limited access to resources such as e-journals (which on traditional print were available to the purchaser indefinitely)
  • webstacles, or the provision of single data points as opposed to tabular queries or bulk downloads of data sets.
  • political, commercial or legal pressure on the activity of organisations providing Open Data (for example the American Chemical Society lobbied the US Congress to limit funding to the National Institutes of Health for its Open PubChem data).[38]

Several mechanisms restrict access to or reuse of data. They include:

Closed data

Other bodies active in promoting the deposition of data as well as fulltext include the Wellcome Trust. An academic paper published in 2013 advocated that Horizon 2020 (the science funding mechanism of the EU, due to launch in 2014) should mandate that funded projects hand in their databases as "deliverables" at the end of the project, so that they can be checked for third party usability then shared.[37]

Note the fundamental requirement to be able to replicate the experiment.

  • to deposit bioinformatics, atomic and molecular coordinate data, experimental data into the appropriate public database immediately upon publication of research results.
  • to retain original data sets for a minimum of five years after the grant. This applies to all data, whether published or not.

Several funding bodies which mandate Open Access also mandate Open Data. A good expression of requirements (truncated in places) is given by the Canadian Institutes of Health Research (CIHR):[36]

Funders' mandates

  • Open access is concerned with making scholarly publications freely available on the internet. In some cases, these articles include open datasets as well.
  • Open content is concerned with making resources aimed at a human audience (such as prose, photos, or videos) freely available.
  • Open knowledge. The Open Knowledge Foundation argues for Openness in a range of issues including, but not limited to, those of Open Data. It covers (a) scientific, historical, geographic or otherwise (b) Content such as music, films, books (c) Government and other administrative information. Open data is included within the scope of the Open Knowledge Definition, which is alluded to in Science Commons' Protocol for Implementing Open Access Data.[33]
  • Open notebook science refers to the application of the Open Data concept to as much of the scientific process as possible, including failed experiments and raw experimental data.[34]
  • Open source (software) is concerned with the licenses under which computer programs can be distributed and is not normally concerned primarily with data.
  • Open research/Open science/Open science data (Linked open science) means an approach to open and interconnect scientific assets like data, methods and tools with Linked Data techniques to enable transparent, reproducible and transdisciplinary research.[35]

The goals of the Open Data movement are similar to those of other "Open" movements.

Relation to other open activities

  • Government funding may not be used to duplicate or challenge the activities of the private sector (e.g. PubChem).
  • Governments have to be accountable for the efficient use of taxpayer's money: If public funds are used to aggregate the data and if the data will bring commercial (private) benefits to only a small number of users, the users should reimburse governments for the cost of providing the data.
  • The revenue earned by publishing data permits non-profit organisations to fund other activities (e.g. learned society publishing supports the society).
  • The government gives specific legitimacy for certain organisations to recover costs (NIST in US, Ordnance Survey in UK).
  • Privacy concerns may require that access to data is limited to specific users or to sub-sets of the data.
  • Collecting, 'cleaning', managing and disseminating data are typically labour- and/or cost-intensive processes - whoever provides these services should receive fair remuneration for providing those services.
  • Sponsors do not get full value unless their data is used appropriately - sometimes this requires quality management, dissemination and branding efforts that can best be achieved by charging fees to users.
  • Often, targeted end-users cannot use the data without additional processing (analysis, apps etc.) - if anyone has access to the data, none may have an incentive to invest in the processing required to make data useful (Typical examples include biological, medical, and environmental data).

Arguments against making all data available as Open Data include the following:

Unlike Open Access, where groups of publishers have stated their concerns, Open Data is normally challenged by individual institutions. Their arguments have been discussed less in public discourse and there are fewer quotes to rely on at this time.

While the human abstraction of facts from paper publications is normally accepted as legal there is often an implied restriction on the machine extraction by robots.

It is generally held that factual data cannot be copyrighted.[32] However, publishers frequently add copyright statements (often forbidding re-use) to scientific data accompanying publications. It may be unclear whether the factual data embedded in full text are part of the copyright.

  • "Data belong to the environmental data following the Aarhus Convention
  • Public money was used to fund the work and so it should be universally available.[27]
  • It was created by or at a government institution (this is common in US National Laboratories and government agencies)
  • Facts cannot legally be copyrighted.
  • Sponsors of research do not get full value unless the resulting data are freely available.
  • Restrictions on data re-use create an anticommons.
  • Data are required for the smooth process of running communal human activities and are an important enabler of socio-economic development (health care, education, economic productivity, etc.).[28]
  • In scientific research, the rate of discovery is accelerated by better access to data.[29]
  • Making data open helps combat "data rot" and ensure that scientific research data is preserved over time.[30][31]

Arguments made on behalf of Open Data include the following:

The debate on Open Data is still evolving. The best open government applications seek to empower citizens, to help small businesses, or to create value in some other positive, constructive way. Open government data is only a way-point on the road to improving education, improving government, and building tools to solve other real world problems. While many arguments have been made categorically, the following discussion of arguments for and against open data highlights that these arguments often depend highly on the type of data and its potential uses.

Arguments for and against open data

In October 2015, the Open Government Partnership launched the International Open Data Charter, a set of principles and best practices for the release of governmental open data formally adopted by seventeen governments of countries, states and cities during the OGP Global Summit in Mexico.[26]

At the international level, the United Nations has an open data website that publishes statistical data from Member States and UN Agencies,[22] and The World Bank published a range of statistical data relating to developing countries.[23] The European Commission has created two portals for the European Union: the EU Open Data Portal which gives access to open data from the EU institutions, agencies and other bodies [24] and the PublicData portal that provides datasets from local, regional and national public bodies across Europe.[25]

Additionally, other levels of government have established open data websites. There are many government entities pursuing Open Data in Canada. lists the sites of a total of 40 US states and 46 US cities and counties with web sites to provide open data; e.g. the state of Maryland, the state of California, US.[21]

  • Ghana Open Data Initiative, launched in January, 2012;[16]
  • Japan Open Data Initiative, launched in December, 2013;[17]
  • Kenya Open Data Portal, launched in July, 2011;[18]
  • United Kingdom platform, launched in January, 2010;[19]
  • United States Open Government Initiative, which operates at the federal level.[20]

Several national governments have created web sites to distribute a portion of the data they collect. It is a concept for a collaborative project in municipal Government to create and organize Culture for Open Data or Open government data. A list of over 200 local, regional and national open data catalogues is available on the open source Data Portals project, which aims to be a comprehensive list of data catalogues from around the world.[15] Prominent examples include:

There are a range of different arguments for open government data.[13][14] For example, some advocates contend that making government information available to the public as machine readable open data can facilitate government transparency, accountability and public participation. Some make the case that opening up official information can support technological innovation and economic growth by enabling third parties to develop new kinds of digital applications and services.

Open data in government

  • The Dataverse Network Project - archival repository software promoting data sharing, persistent data citation, and reproducible research[12]
  • - Open data about scientific artifacts from University of Muenster, Germany. Launched in 2011.
  • - Open scientific datasets encoded as Linked Data. Launched in 2011.

Examples of open data in science:

[11] recommendation.soft-law as a OECD Principles and Guidelines for Access to Research Data from Public Funding Following a request and an intense discussion with data-producing institutions in member states, the OECD published in 2007 the [10]

This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.

Copyright © World Library Foundation. All rights reserved. eBooks from Project Gutenberg are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.