DATA MANAGEMENT IN GOVERNANCE


(BIG DATA, OPEN DATA, AND ‘ONE DATA’)


AGIE NUGROHO SOEGIONO
EXPECTED LEARNING OUTCOMES
At the end of the course,
➢Students are expected to understand the concept of data governance and its terms.
➢Students are expected to be able to explain the differences between big data, open
data, and one data.
➢Students are expected to be able to mention some examples of data governance
practices.
Data was no longer regarded as static or stale, whose usefulness was finished
once the purpose for which it was collected was achieved.
Data is the new oil: became a raw material of business, a vital economic input,
used to create a new form of economic value.
▪ Big data is the term for a collection of data sets so large and complex that it
becomes difficult to process using on-hand database management tools or
traditional data processing applications.
▪ The challenges include capture, curation, storage, search, sharing, transfer,
analysis, and visualization..
▪ The possibilities of big data might alow us to "spot business trends, determine
quality of research, prevent diseases, combat crime, determine real-time roadway
traffic conditions, etc..”
DOUG LANEY, 2001

Volume
Velocity
Variety

From “collecting large amounts of data” to “doing something with it”.

Collecting: computers, sensors, events, survey, people
Doing something: making decisions, confirming hypotheses, gaining insights, predicting future
VOLUME (SCALE)
Data Volume
! 44x increase from 2009 2020
! From 0.8 zettabytes to 35zb
Data volume is increasing exponentially

Exponential increase in
collected/generated data

6
Source: hjo3.net
VARIETY (COMPLEXITY)
▪Relational Data (Tables/Transaction/Legacy Data)
▪Text Data (Web)
▪Semi-structured Data (XML)
▪Graph Data
▪ Social Network, Semantic Web (RDF), …

▪Streaming Data
▪ You can only scan the data once

▪A single application can be generating/collecting many types of

data
▪Big Public Data (online, weather, finance, etc)

To extract knowledge➔ all these types of data need to linked together

8
VELOCITY (SPEED)

▪Data is begin generated fast and need to be processed fast
▪Online Data Analytics
▪Late decisions ➔ missing opportunities

Mobile devices
(tracking all objects all the time)

Sensor technology and

networks
Social media and networks Scientific instruments (measuring all kinds of data)
(all of us are generating data) (collecting all sorts of data)

9
WHAT’S DRIVING BIG DATA
- Optimizations and predictive analytics
- Complex statistical analysis
- All types of data, and many sources
- Very large datasets
- More of a real-time

- Ad-hoc querying and reporting

- Data mining techniques
- Structured data, typical sources
- Small to mid-size datasets

12
BIG DATA RESEARCH CRITICS ON
SAMPLING
Sampling was a solution to the problem of information
in an earlier age, when the collection and analysis of
data was very hard to do.
Its accuracy depends on ensuring randomness when
collecting the data.
Random sampling does not scale easily to include
subcategories, as breaking the results down into smaller
and smaller subgroups increases the possibility of
erroneous predictions.
Sampling is like an analog photographic print. It looks
good from a distance, but as you stare closer, zooming
in on a particular detail it gets blurry.
INTEROPERABILITY?
RAW DATA
NOW!
IN GROUPS, DISCUSS AND TRY TO FIND
EXAMPLES OF
Data
Information
Knowledge
Wisdom
STATISTIC AS RAW
DATA
Data: angka-angka kasar yang
didapatkan dari halte bus A, B, C, dan
D.
A.

B.
Information: statistik terstruktur
pengunjung halte A, B, C, dan D.
Knowledge: ditemukan pola mobilisasi
pengguna bus pada jam pulang kantor
dari halte A hampir selalu turun di

D.
stasiun halte D yang sebelumnya melalui
halte B dan C terlebih dahulu.
Wisdom: rute bus dari halte A langsung
ke halte D pada jam-jam tertentu.
C
.
ARTICLE AS RAW DATA (MEIJER,
2015)
TRANSCRIPT OF A SPEECH AS RAW
DATA
BIG DATA FOR PUBLIC
ADMINISTRATION
(MACIEJEWSKI, 2017)


Game changer for modern public administration.
Unlocking the full potential of big data for public sector requires a public authority to
develop and knowledge and skills.
3 Stages:
! Input stage – enable new possibilities for gathering, storing, and making easily available huge amounts of
data.
! Transformation stage – automated reasoning in relation to wide information, using new or traditional
methods of processing at high speed.
! Output stage - presenting large quantities of raw data and the results of reasoning.
WHY PUBLIC ADMINISTRATION
NEEDS BIG BATA?
1. significant increase in the accuracy of decision-making
! expansion of the information database for analysing and drawing conclusions
! extensive work involving analysis and reasoning, which has been impossible to do with human resources
alone
! application of new methods of data presentation, allowing a better understanding of phenomena,
changes over time and inter-relations
! creation of algorithms to suggest appropriate solutions
2. acceleration of the performance of internal ‘information tasks’ through computerizing
and automating data analysis and inference
3. reduction of the costs related to the decision-making process
BIG DATA METHODS MAY BE USED IN
THREE APPROACHES
OPEN DATA
DEFINITION
Stagars:
! Data that are publicly available to anyone for free use, reuse, and
redistribution.
! Comes with an open license that allows commercial and noncommercial use
and distribution without limitations.
Veit and Huntgeburth:
! Data that show transparency of government processes and performances.
! Addressing topics not only about availability, but also quality.
! Improve public’s ability to make government responsible
DEFINITION

Mayer-Schönberger and Cukier:

! The best way to extract the value of government data is
to give the private sector and society general access to
try.
! To work, open data must be in a standardized, machine-
readable form so that it can be easily processed.
 DATA
POSITION
Open Data

TEKNIS LEGAL

Open Data/Data Terbuka

adalah data yang dapat Data dirilis dalam format Data dengan lisensi
digunakan secara bebas, dapat digunakan terbuka (i.e.: CC-BY)
dimanfaatkan, dan kembali (reusable) dan
didistribusikan kembali mudah dibaca mesin Data bebas biaya
(machine-readable)
oleh siapa pun tanpa
syarat kecuali dengan Data yang dirilis berada
Data dirilis sesuai
persyaratan memberikan pada kisaran bintang 3 dengan ketentuan
atribusi kepada si pemilik ke atas sesuai standar peraturan per-
data. teknis 5-star rating undang-undangan
It is difficult to find government data
Data problems among institutions

Kementerian - A Kementerian - B

Kementerian – A 27,2 32,6 11,6 Kementerian - B

59,8 juta Ha 44,2 juta Ha
Data Hutan Primer di Papua tahun 2009
Agencies and institutions without interoperability
PERPRES 39 2019
FOUR PRINCIPLES
Satu Kode Referensi

Tanda berisi karakter yang

mengandung atau menggambarkan
makna, maksud, atau norma
tertentu sebagai rujukan
identitas data yang bersifat unik.
Memastikan Interoperabilitas Data Lintas K/L/D

KONDISI SAAT INI KONDISI IDEAL

Portal data.go.id

v v

Data lintas K/L/D dapat

Data tidak interoperabel dipertukarkan dan digunakan oleh
lintas K/L/D aplikasi-aplikasi pemerintah
ONE DATA INDONESIA: 

TOWARDS DATA-DRIVEN AND EVIDENCE-BASED DECISION MAKING

“Satu Data Indonesia Proposition

Initiative for Accurate, Open, s
and Interoperable
Government Data”

For
Governme
data. nt
go.id 100% Data Driven
Decision
CORRECT Making

Improve Improve Improve

Quality of Data Accessibility with Quality of
Gathered One Integrated Data
Data Portal Analysis
For Society
(data.go.id) Data Driven
Society
CASE IN POINT – DATA GOVERNANCE TRANSFORMATION 

AT THE MINISTRY OF EDUCATION AND CULTURE
Then… …Now

School
School
School
School A C
C
A

Ministry School School

Ministry
School D
of
School
of
B
Educatio C(?) Educatio
n and B n and
Culture Culture Impact
Consequences Interoperable data
•Data scattered in • Data are allows every unit to
There is no single gathered in a
each work unit get the data needed
•Data collection is
reference of data. warehouse. without recollect the
done in every • Unified Data
Difficult in data from raw data
different collection in the
government smallest units
sources.
program,
even though they education (schools).
require the same assistance • Data published Ease of transparency
data. distribution. (BOS, in open format and accountability of
•Much of the data is BSM, PKH) to increase government
only available in usability of data. educational
hardcopy assistance
Promoting open data with one-single-reference usage

Dari data.go.id menuju produk-produk pemanfaatan

WHAT’S NEXT? – THANK YOU
OPEN DATA
PROMISES
Economic gains
Administrative efficiency
Transparency & accountability
Social progress
Citizen participation
COMPLEXITY AND CHALLENGE TO
REALISE OPEN DATA
Those with the mandate for efficient use of public data – governments and politicians –
also have the highest stakes in the game when they stand to lose control over the flow of
information.
Data, in some cases, are commodity.
Radical transparency.
BARRIERS AGAINST1.
2.
TECHNOLOGICAL
BEHAVIOURIAL, ORGANIZATIONAL,
OPEN DATA 3.
AND INSTITUTIONAL
LEGAL
Technological barriers for data providers
(governments)
Technological barriers for data users (non-government
sector, citizens)
Behaviourial, organizational, & institutional barriers for
data providers (governments)
Behaviourial, organizational, & institutional barriers for
data users (non-government sector, citizens)
Legal barriers for data providers (governments)
Legal barriers for data users (non-government sector,
citizens)
TECHNOLOGICAL
BARRIERS FOR DATA
PROVIDERS
(GOVERNMENTS)
Incompatible formats between
agencies
Lack of technological data
infrastructure
Lack of financial resources and skill to
process and publish data
Inability to harness crowdsourcing
No processes to work with feedback
from users
 TECHNOLOGICAL BARRIERS FOR DATA USERS
Difficulty in getting access to data (especially the raw materials)
Registration necessary to access data
Data fragmentation
Lack of machine-readable formats
Lack of skills in programming and statistics
Lack of awareness of potential uses of data
Misunderstanding data
Language barriers
Difficulty in discovery and searching for relevant data
Poor data quality (accuracy, timeliness, metadata)
BEHAVIOURIAL, ORGANIZATIONAL, &
INSTITUTIONAL BARRIERS FOR DATA PROVIDERS
Difficulty of inter-organizational knowledge sharing between Existing contracts with commercial data providers
agencies with different missions and priorities
Loss of control over data
Conflicts in management and incentive systems that discourage
transparency Fear of false conclusions and potential negative consequences
Culture of risk avoidance Unclear accountability and responsibility when traditional roles
shift
Culture of partial public information and secrecy
Lack of policies to share data
Opposition to creating information commons
Lack of funding channels for collaborations between several
Ignorance of opportunities of open data agencies
Confusion about what data exist and where they are Missing incentives to let go of cost-recovery model
Vulnerability to public scrutiny
No experience in interacting with data users
Unclear needs of data users
BEHAVIOURIAL, ORGANIZATIONAL, &
INSTITUTIONAL BARRIERS FOR DATA
USERS

Missing incentives for developers to use data

Lack of support by data providers
Too many data initiatives without clear strategy
Lack of time
Lack of interest to solve small-scale, local problems
LEGAL BARRIERS
Data providers Data users

Lack of legal framework to make data Confusing terms of use

available, such as freedom of information
laws or policies for reuse of PSI Lack of open licenses

Legal uncertainty through new laws Threat of lawsuits

Contradictory rules and laws on data Cumbersome process to launch special

sharing and usage rights data requests and obtain usage rights

Privacy concerns Prohibitions against commercial use

Prohibitions against data sharing
REFERENCE
Janssen, M., Charalabidis, Y., & Zuiderwijk, A. (2012). Benefits, Adoption Barriers and Myths of Open Data and Open Government.
Information Systems Management. https://doi.org/10.1080/10580530.2012.716740
Maciejewski, M. (2017). To do more, better, faster and more cheaply: using big data in public administration. International Review of
Administrative Sciences, 83(1_suppl), 120–135. https://doi.org/10.1177/0020852316640058
Mayer-Schönberger, V., & Cukier, K. (2017). Big Data: The Essential Guide to Work, Life and Learning in the Age of Insight. John Murray.
Soegiono, A. N. (2017). Agenda Open Government: Memerangi Korupsi Melalui Inisiatif Open Data. Jurnal Antikorupsi INTEGRITAS, 3(2), 1–
35.
Soegiono, A. N. (2018). Investigating Digital (Dis)engagement of Open Government: Case Study of One Data Indonesia. Jurnal Kebijakan
Dan Administrasi Publik, 22(May), 36–51.
Stagars, M. (2016). Open Data in Southeast Asia: Towards Economic Prosperity, Government Transparency, and Citizen Participation in the
ASEAN. Singapore: Palgrave Macmillan. https://doi.org/10.1007/978-3-319-32170-7
Unit Kerja Presiden Bidang Pengawasan dan Pengendalian Pembangunan, Kemen terian Perencanaan Pembangunan Nasional/Badan
Perencanaan Pembangunan Nasional, Badan Pusat Statistik, & Badan Informasi Geospasial. (2014). Cetak Biru Satu Data untuk Pembangunan
Berkelanjutan. Jakarta: Unit Kerja Presiden Bidang Pengawasan dan Pengen- dalian Pembangunan (UKP-PPP).
Veit, D., & Huntgeburth, J. (2014). Foundations of Digital Government: Leading and Managing in the Digital Era. Heidelberg: Springer. https://
doi.org/10.1007/978-0-387-71611-4_1