Government Open Data: Benefits, Strategies, and Use
Government Open Data: Benefits, Strategies, and Use
But “opening the data” can be a thorny issue for elected of-
ficials. This paper highlights both the benefits and the obstacles fac-
ing elected and senior government officials in opening the datasets
within their custody. It suggests approaches to overcoming those
obstacles, methods to harvest the benefits, and highlights how inno-
vative governments can harness open data to better engage citizens
and improve services to constituents.
The United States Congress passed the Federal govern-
ment’s Freedom of Information Act (FoIA) in 1966.1 FoIA attempts
to guarantee access by citizens to information collected and use by
federal agencies.. FoIA is mirrored in most states with similar laws,
such as the Public Records Act (PRA) in the State of Washington.2
However these are “pull” laws – citizens wanting access to infor-
mation must file a request specifying the information desired with
the specific government agency holding the information. In other
words, the individual citizen is responsible to know the data exists
and then must pursue a formal request to “pull” the information
12 THE EVANS SCHOOL REVIEW
Schrier
from the agency. Many types of data are excluded from FoIA and PRA for a wide
variety of reasons, such as homeland security and privacy of personal information.
In approximately 2006, however, some governments began to take a differ-
ent approach, where they voluntarily began publishing datasets on public websites.
This “open data” movement has now been adopted by a number of United States cit-
ies, counties and states,3 as well as the federal government and other governments
around the world.
There are significant challenges to expanding the availability of open data.
But there are also direct, indirect and economic benefits to citizens, businesses,
governments and public officials. Informed citizens will suggest new government
policies and better improved business processes for government services. Research-
ers will comb datasets to produce new insights into problems facing government,
and how to address them. Small businesses will start-up using government data in
combination with other information to offer new services to consumers. A better-
informed, more-engaged citizenry will improve democracy.
Introduction
United States’ democracy is “of the people, by the people and for the peo-
ple.” This definition implies government should be open and transparent in how it
4
makes its decisions. Furthermore, those decisions should be logical and explainable
to constituents. Decisions must be data-driven. Data used in decision making should
be open to inspection by any constituent or member of the public who, in turn,
could suggest alternate interpretations and solutions.
“Open Data” is a relatively new concept in transparency: open data is freely
available or accessible, without license, and machine-readable, among other charac-
teristics5:
• “Freely available and accessible” means the data can be easily obtained, pref-
erably on a website or in another place on the Internet without onerous restrictions
such as login-passwords or other security measures. These terms also mean without
discrimination as to the user or reason for use.
• “Without license” means the data can be re-used and re-published without
obtaining a license or other legal contract. Some restrictions, such as attribution6 and
immutability7, are allowed.
• “Machine readable” is another way of saying usable without technological
hindrances. Data contained in a portable-document-format (PDF) is not machine-
readable – it is not easy for a computer to read and use the data. Machine readability
is extraordinarily important so that the dataset can be used in applications such as
mapping points on a handheld device such as a smart phone or tablet.
Cultural Obstacles
Open data movements face a wide variety of obstacles, almost all of them
internal to governments. Chris Martin, researcher at the University of Leeds, has
chronicled a number of these obstacles, including:
• The risk-averse culture of governments;
• Opening data is an extra activity, rather than day-to-day responsibility
of employees, and therefore will not occur in a consistent manner;
• Governments lack a coherent vision for funding and promoting open
data;
• Government officials feel there is little demand or value in the data
within their custody;
• Government will lose revenue by opening data, while, conversely, the
private sector will focus on exploiting the financial value while ignor-
ing the social and environmental value of the data;
• Many citizens and advocacy groups are concerned about protecting
the privacy of individuals;
• Fear that opening the data will result in criticism for incomplete or
inaccurate datasets.
Legitimate Constraints
Furthermore, there is a set of legitimate constraints as to what data may be
available to the public. Such constraints include the Criminal Justice Information
Services Policy, the Health Insurance Portability and Accountability Act, the Family
Educational Rights and Privacy Act, and others including state and local laws and
ordinances. These laws protect personal privacy. But some also protect states and the
nation from release of information which may be harmful to collective security, for
example the location of critical electric power substations or transportation hubs.
VOL 4, NO. 1, SPRING 2014 15
Government Open Data: Benefits, Strategies, and Use
Before placing data on an open portal, governments need to filter the data
based on these laws and ordinances. However, most of these rules are well under-
stood by governments because they invoke them daily in response to FoIA and PRA
records requests.
Executive Support
Given the obstacles and culture of government, all successful open data ini-
tiatives to date have required strong and explicit support from the chief executive of
the government entity involved in the effort. Examples include:
• President Barack Obama’s Executive Order and data.gov
• New York City Council law 11 of 2012, which basically says “all data which
can be opened, will be opened”, with the support of Mayor Michael Bloomberg, and
the resulting open data program of the City’s Department of Information Technol-
ogy and Telecommunications
• Chicago Mayor Rahm Emanuel’s Executive Order 2012-2 on Open Data
• And a number of other examples from Oakland and San Francisco, Califor-
nia, Louisville, Kentucky and other places
Executive support is critical to open data movements because every govern-
ment and its bureaucracy resist change. Governments are, inherently, conservative,
always striving to maintain the status quo. Government officials constantly feel their
programs are underfunded and already burdened with work. Since this conservatism
is inherently a part of government, it takes extraordinary effort to overcome the
inertia through senior leadership.
Social Media
Social media is extensively used by consumers and businesses. Facebook, for ex-
ample, has more than a billion registered users. Other examples of social media are
Twitter, LinkedIn,YouTube, Instagram, and Google+. Each social media site collects
data on its users from personal profiles and posts. Social media users voluntarily
complete such profiles and post news and information about themselves and others
Private Business
Private businesses collect extensive databases on their customers. That data
can be collected online, by, say Amazon or a retail website. But it is also collected in
the form of loyalty cards such as those issued by Safeway or many other retail estab-
lishment. These databases track not only personal information, but every purchase
made by a customer. Again this information is used to tailor and target advertise-
ments, email, postal mail and other messages directed at individuals.
Big Data
Big Data is the term for a collection of data sets so large and complex that it
becomes difficult to process using on-hand database management tools or traditional
data processing applications. Processing such datasets requires specialized software
such as Hadoop and from firms such as Splunk and Tableau. More and more govern-
ment datasets fall into the category of “big data”. These include meteorological, data
obtained from traffic sensors and license plate reader datasets. Furthermore, as gov-
ernment datasets are combined with a wide variety of external sources (also called a
mash-up ), the processing techniques will require Big Data analytics and techniques.
A Political “Win”
FoIA and similar laws are often seen as liabilities by elected officials. Un-
der FoIA, email messages, memoranda and even text messages created by elected
(and other) officials must be exposed to public scrutiny. But open data can be assets
to politicians and elected officials as well. Making a government more transparent,
exposing its data for use by others, and allowing private enterprise to create useful
applications all are accomplishments that an official can trumpet when running for
election.
The Open Knowledge Foundation has created an index of openness for 84
different kinds of open data across 70 countries. Such scorecards or dashboards give
elected officials “bragging rights” for their transparency of their governments.
Engagement
Citizen engagement is a holy grail for elected officials. Or, rather, usable
citizen engagement is the Holy Grail. Getting widespread engagement is difficult,
however, unless the issue is either a “hot button” or NIMBY (“not in my backyard”)
issue. Any example of “hot button” issues are those relating to schools and students.
NIMBY issues include siting of public facilities such as a jail or freeway.
Open data and associated apps provide a way for citizens to become engaged
with their governments in a set of more “normal” circumstances, like budget devel-
opment using open data and mobile apps. Another example of potential engagement
is Living Voters’ Guide, an app with which constituents can discuss and rate argu-
ments for and against initiatives and referenda. A Seattle company, Ideascale, has
built an entire business around citizen engagement.
Conclusion
Through their legitimate business processes governments generate signifi-
cant amounts of data about people, property, licenses, crimes, public health and a
wide variety of other entities. This data is used by elected and senior officials to make
laws, set policies and operate government services. In a democracy like the United
States, citizens must be engaged and involved in the processes of law and policy mak-
ing, and even in service provision.
The government open data movement endeavors to open as much of this
data as possible for use by citizens, advocacy groups, researchers and private busi-
nesses, within the constraints of protection of privacy and security. A small but sig-
nificant number of governments embrace the concept of open data and have estab-
lished open data portals on the Internet.
At the same time, the Internet is widely used by consumers, citizens and
businesses for social media, financial transactions, purchases and simply to find in-
formation. Businesses, especially Internet-based ones such as Amazon and Google,
are collecting vast amounts of data about their users. Some of this data is open, and
most of it is bought-and-sold on private exchanges.
A number of new businesses have started using government open data along
with other publicly and privately available information. These businesses improve
VOL 4, NO. 1, SPRING 2014 23
Government Open Data: Benefits, Strategies, and Use
quality of life by producing new products and services. Citizen advocacy groups
use open data to produce new insights into public policy problems. These insights
improve the process of creating laws and public policy, and improve the delivery of
government services.
Most governments, however, are slow to embrace open data due to bud-
getary and cultural constraints. Senior elected officials – Mayors, County Execu-
tives and Governors, can follow a playbook with specific actions to overcome the
obstacles and open their government data for use by citizens, academics and private
businesses. The result will be improved and wider citizen engagement with govern-
ment, and new services such as 311 which improve quality of life for constituents.
End Notes
1. FOIA: https://www.eff.org/issues/transparency/history-of-foia, Public Law
5 USC § 552 at http://www.law.cornell.edu/uscode/text/5/552
2. Chapter 42.56, Revised Code of Washington, http://apps.leg.wa.gov/rcw/
default.aspx?cite=42.56
3. http://www.data.gov/open-gov/
4. Abraham Lincoln, Gettysburg Address: http://en.wikipedia.org/wiki/Get-
tysburg_Address
5. A more complete definition of open data: http://opendefinition.org/od/
6. Attribution means any public use of the data must reference the source under
the terms of the license to use the data. See also http://opendatacommons.
org/licenses/by/summary/
7. Immutability refers to keeping the original data intact, i.e. not changing the
original data except as explicitly allowed by a license or explicitly noted when
the data is used.
8. Paris Tech Review, “A Brief History of Open Data”, March, 2013. http://
www.paristechreview.com/2013/03/29/brief-history-open-data/
9. DCStat is now the D.C. “data catalog”: http://data.octo.dc.gov/
10. District of Columbia Open Data catalog’s history: http://www.infoworld.
com/d/developer-world/open-government-meets-it-161
11. Apps for Democracy: http://istrategylabs.com/work/apps-for-democracy-
contest/
12. Value of the Apps for Democracy results: http://istrategylabs.com/2008/11/
apps-for-democracy-yeilds-4000-roi-in-30-days-for-dcgov/
13. Obama’s Executive Order Open Government: http://www.whitehouse.gov/
the_press_office/TransparencyandOpenGovernment
14. Launch of data.gov: http://en.wikipedia.org/wiki/Vivek_Kundra
15. Open data portals: https://www.data.gov/open-gov/
24 THE EVANS SCHOOL REVIEW
Schrier
16. List of open data portals: https://www.data.gov/media/2013/11/opendata-
sites.xls
17. For definitions and examples of structured and unstructured data, see: http://
en.wikipedia.org/wiki/Unstructured_data
18. Obstacles to the Open Data Movement: http://blog.okfn.org/2013/06/26/
understanding-barriers-to-open-government-data/
19. CJIS, which restricts how criminal and arrest data may be used and disclosed
by state and local governments: http://www.fbi.gov/about-us/cjis/cjis-secu-
rity-policy-resource-center/at_download/file
20. HIPPA which restricts access to healthcare records: http://www.hhs.gov/
ocr/privacy/
21. FERPA limits access to student and educational records: http://www.ed.gov/
policy/gen/guid/fpco/ferpa/index.html
22. Obama’s Executive Order Open Government: http://www.whitehouse.gov/
the_press_office/TransparencyandOpenGovernment
23. New York City Open Data Law 11 of 2012: http://www.nyc.gov/html/
doitt/html/open/local_law_11_2012.shtml
24. New York City’s Open Data Program: http://www.nyc.gov/html/doitt/
html/open/data.shtml
25. Chicago Mayor Rahm Emanuel’s Open Data Order: http://www.cityofchi-
cago.org/city/en/narr/foia/open_data_executiveorder.html
26. More examples of executive support of open data: http://sunlightfoundation.
com/
27. The United States Constitution created three branches of government and en-
shrined the notion of the separation of powers, an example of inherent conser-
vatism and resistance to change.
28. A Stock Exchange for Your Personal Data, Jessica Leber, MIT Technology Re-
view, May 1, 2012
29. This definition of Big Data comes from Wikipedia: http://en.wikipedia.org/
wiki/Big_data
30. Mash-up: http://en.wikipedia.org/wiki/Mashup
31. See, for example, a timeline of Snowden’s revelations here: http://america.al-
jazeera.com/articles/multimedia/timeline-edward-snowden-revelations.html
32. My Neighborhood Map: http://web6.seattle.gov/mnm/policereports.aspx
33. The CitiStat Model: How Data-Driven Government Can Increase Ef-
ficiency and Effectiveness, Teresita Perez and Reece Rushing, April,
2007: http://www.americanprogress.org/issues/open-government/re-
port/2007/04/23/2911/the-citistat-model-how-data-driven-government-
can-increase-efficiency-and-effectiveness/