Data Science
Data Science
Data science also integrates domain knowledge from the underlying application
domain (e.g., natural sciences, information technology, and medicine).[3] Data
science is multifaceted and can be described as a science, a research paradigm, a
research method, a discipline, a workflow, and a profession.[4]
Data science is "a concept to unify statistics, data analysis, informatics, and their
related methods" to "understand and analyze actual phenomena" with data.[5] It uses
techniques and theories drawn from many fields within the context of mathematics,
statistics, computer science, information science, and domain knowledge.[6] However,
data science is different from computer science and information science. Turing
Award winner Jim Gray imagined data science as a "fourth paradigm" of science
(empirical, theoretical, computational, and now data-driven) and asserted that
"everything about science is changing because of the impact of information
technology" and the data deluge.[7][8]
Foundations
[edit]
Data science is an interdisciplinary field[10] focused on extracting knowledge from
typically large data sets and applying the knowledge from that data to solve
problems in other application domains. The field encompasses preparing data for
analysis, formulating data science problems, analyzing data, and summarizing these
findings. As such, it incorporates skills from computer science, mathematics, data
visualization, graphic design, communication, and business.[11]
Vasant Dhar writes that statistics emphasizes quantitative data and description. In
contrast, data science deals with quantitative and qualitative data (e.g., from images,
text, sensors, transactions, customer information, etc.) and emphasizes prediction
and action.[12] Andrew Gelman of Columbia University has described statistics as a
non-essential part of data science.[13] Stanford professor David Donoho writes that
data science is not distinguished from statistics by the size of datasets or use of
computing and that many graduate programs misleadingly advertise their analytics
and statistics training as the essence of a data-science program. He describes data
science as an applied field growing out of traditional statistics.[14]
Etymology
[edit]
Early usage
[edit]
In 1962, John Tukey described a field he called "data analysis", which resembles
modern data science.[14] In 1985, in a lecture given to the Chinese Academy of
Sciences in Beijing, C. F. Jeff Wu used the term "data science" for the first time as
an alternative name for statistics.[15] Later, attendees at a 1992 statistics symposium
at the University of Montpellier II acknowledged the emergence of a new discipline
focused on data of various origins and forms, combining established concepts and
principles of statistics and data analysis with computing.[16][17]
The term "data science" has been traced back to 1974, when Peter Naur proposed it
as an alternative name to computer science.[6] In 1996, the International Federation
of Classification Societies became the first conference to specifically feature data
science as a topic.[6] However, the definition was still in flux. After the 1985 lecture at
the Chinese Academy of Sciences in Beijing, in 1997 C. F. Jeff Wu again suggested
that statistics should be renamed data science. He reasoned that a new name would
help statistics shed inaccurate stereotypes, such as being synonymous with
accounting or limited to describing data.[18] In 1998, Hayashi Chikio argued for data
science as a new, interdisciplinary concept, with three aspects: data design,
collection, and analysis.[17]
Modern usage
[edit]
In 2012, technologists Thomas H. Davenport and DJ Patil declared "Data Scientist:
The Sexiest Job of the 21st Century",[19] a catchphrase that was picked up even by
major-city newspapers like the New York Times[20] and the Boston Globe.[21] A decade
later, they reaffirmed it, stating that "the job is more in demand than ever with
employers".[22]
The professional title of "data scientist" has been attributed to DJ Patil and Jeff
Hammerbacher in 2008.[25] Though it was used by the National Science Board in their
2005 report "Long-Lived Digital Data Collections: Enabling Research and Education
in the 21st Century", it referred broadly to any key role in managing a digital data
collection.[26]
Data science involves working with larger datasets that often require advanced
computational and statistical methods to analyze. Data scientists often work
with unstructured data such as text or images and use machine learning algorithms
to build predictive models. Data science often uses statistical analysis, data
preprocessing, and supervised learning.[28][29]
Some distributed computing frameworks are designed to handle big data workloads.
These frameworks can enable data scientists to process and analyze large datasets
in parallel, which can reduce processing times.[32]
Machine learning models can amplify existing biases present in training data, leading
to discriminatory or unfair outcomes.[35][36]
See also
[edit]
1. ^ Donoho, David (2017). "50 Years of Data Science". Journal of Computational and
Graphical Statistics. 26 (4): 745–
766. doi:10.1080/10618600.2017.1384734. S2CID 114558008.
2. ^ Dhar, V. (2013). "Data science and prediction". Communications of the
ACM. 56 (12): 64–73. doi:10.1145/2500499. S2CID 6107147. Archived from the
original on 9 November 2014. Retrieved 2 September 2015.
3. ^ Danyluk, A.; Leidig, P. (2021). Computing Competencies for Undergraduate Data
Science Curricula (PDF). ACM Data Science Task Force Final Report (Report).
4. ^ Mike, Koby; Hazzan, Orit (20 January 2023). "What is Data
Science?". Communications of the ACM. 66 (2): 12–
13. doi:10.1145/3575663. ISSN 0001-0782.
5. ^ Hayashi, Chikio (1 January 1998). "What is Data Science ? Fundamental
Concepts and a Heuristic Example". In Hayashi, Chikio; Yajima, Keiji; Bock, Hans-
Hermann; Ohsumi, Noboru; Tanaka, Yutaka; Baba, Yasumasa (eds.). Data Science,
Classification, and Related Methods. Studies in Classification, Data Analysis, and
Knowledge Organization. Springer Japan. pp. 40–51. doi:10.1007/978-4-431-
65950-1_3. ISBN 9784431702085.
6. ^ Jump up to:a b c Cao, Longbing (29 June 2017). "Data Science: A Comprehensive
Overview". ACM Computing Surveys. 50 (3): 43:1–
43:42. arXiv:2007.03606. doi:10.1145/3076253. ISSN 0360-0300. S2CID 2075959
44.
7. ^ Tony Hey; Stewart Tansley; Kristin Michele Tolle (2009). The Fourth Paradigm:
Data-intensive Scientific Discovery. Microsoft Research. ISBN 978-0-9825442-0-
4. Archived from the original on 20 March 2017.
8. ^ Bell, G.; Hey, T.; Szalay, A. (2009). "Computer Science: Beyond the Data
Deluge". Science. 323 (5919): 1297–1298. doi:10.1126/science.1170411. ISSN 00
36-8075. PMID 19265007. S2CID 9743327.
9. ^ Davenport, Thomas H.; Patil, D. J. (October 2012). "Data Scientist: The Sexiest
Job of the 21st Century". Harvard Business Review. 90 (10): 70–76,
128. PMID 23074866. Retrieved 18 January 2016.
10. ^ Emmert-Streib, Frank; Dehmer, Matthias (2018). "Defining data science by a data-
driven quantification of the community". Machine Learning and Knowledge
Extraction. 1: 235–251. doi:10.3390/make1010015.
11. ^ "1. Introduction: What Is Data Science?". Doing Data Science [Book]. O’Reilly.
Retrieved 3 April 2020.
12. ^ Vasant Dhar (1 December 2013). "Data science and prediction". Communications
of the ACM. 56 (12): 64–73. doi:10.1145/2500499. S2CID 6107147.
13. ^ "Statistics is the least important part of data science « Statistical Modeling, Causal
Inference, and Social Science". statmodeling.stat.columbia.edu. Retrieved 3
April 2020.
14. ^ Jump up to:a b Donoho, David (18 September 2015). "50 years of Data
Science" (PDF). Retrieved 2 April 2020.
15. ^ Wu, C. F. Jeff (1986). "Future directions of statistical research in China: a
historical perspective" (PDF). Application of Statistics and Management. 1: 1–7.
Retrieved 29 November 2020.
16. ^ Escoufier, Yves; Hayashi, Chikio; Fichet, Bernard, eds. (1995). Data science and
its applications. Tokyo: Academic Press/Harcourt Brace. ISBN 0-12-241770-
4. OCLC 489990740.
17. ^ Jump up to:a b Murtagh, Fionn; Devlin, Keith (2018). "The Development of Data
Science: Implications for Education, Employment, Research, and the Data
Revolution for Sustainable Development". Big Data and Cognitive Computing. 2 (2):
14. doi:10.3390/bdcc2020014.
18. ^ Wu, C. F. Jeff. "Statistics=Data Science?" (PDF). Retrieved 2 April 2020.
19. ^ Davenport, Thomas (1 October 2012). "Data Scientist: The Sexiest Job of the 21st
Century". Harvard Business Review. Retrieved 10 October 2022.
20. ^ Miller, Claire (4 April 2013). "Data Science: The Numbers of Our Lives". New York
Times. New York City. Retrieved 10 October 2022.
21. ^ Borchers, Callum (11 November 2015). "Behind the scenes of the 'sexiest job of
the 21st century'". Boston Globe. Boston. Retrieved 10 October 2022.
22. ^ Davenport, Thomas (15 July 2022). "Is Data Scientist Still the Sexiest Job of the
21st Century?". Harvard Business Review. Retrieved 10 October 2022.
23. ^ William S. Cleveland (April 2001). "Data Science: an Action Plan for Expanding
the Technical Areas of the Field of Statistics". International Statistical
Review. 69 (1): 21–26. doi:10.1111/J.1751-5823.2001.TB00477.X. ISSN 0306-
7734. JSTOR 1403527. S2CID 39680861. Zbl 1213.62003. Wikidata Q134576907
.
24. ^ Talley, Jill (1 June 2016). "ASA Expands Scope, Outreach to Foster Growth,
Collaboration in Data Science". Amstat News. American Statistical Association.. In
2013 the first European Conference on Data Analysis (ECDA2013) started in
Luxembourg the process which founded the European Association for Data Science
(EuADS) www.euads.org in Luxembourg in 2015.
25. ^ Davenport, Thomas H.; Patil, D. J. (1 October 2012). "Data Scientist: The Sexiest
Job of the 21st Century". Harvard Business Review. No. October 2012. ISSN 0017-
8012. Retrieved 3 April 2020.
26. ^ "US NSF – NSB-05-40, Long-Lived Digital Data Collections Enabling Research
and Education in the 21st Century". www.nsf.gov. Retrieved 3 April 2020.
27. ^ James, Gareth; Witten, Daniela; Hastie, Trevor; Tibshirani, Robert (29 September
2017). An Introduction to Statistical Learning: with Applications in R. Springer.
28. ^ Provost, Foster; Tom Fawcett (1 August 2013). "Data Science for Business: What
You Need to Know about Data Mining and Data-Analytic Thinking". O'Reilly Media,
Inc.
29. ^ Han, Kamber; Pei (2011). Data Mining: Concepts and
Techniques. ISBN 9780123814791.
30. ^ Hashem, Ibrahim Abaker Targio; Yaqoob, Ibrar; Anuar, Nor Badrul; Mokhtar,
Salimah; Gani, Abdullah; Ullah Khan, Samee (2015). "The rise of "big data" on cloud
computing: Review and open research issues". Information Systems. 47: 98–
115. doi:10.1016/j.is.2014.07.006.
31. ^ Qiu, Junfei; Wu, Qihui; Ding, Guoru; Xu, Yuhua; Feng, Shuo (2016). "A survey of
machine learning for big data processing". EURASIP Journal on Advances in Signal
Processing. 2016 (1). doi:10.1186/s13634-016-0355-x. ISSN 1687-6180.
32. ^ Armbrust, Michael; Xin, Reynold S.; Lian, Cheng; Huai, Yin; Liu, Davies; Bradley,
Joseph K.; Meng, Xiangrui; Kaftan, Tomer; Franklin, Michael J.; Ghodsi, Ali; Zaharia,
Matei (27 May 2015). "Spark SQL: Relational Data Processing in
Spark". Proceedings of the 2015 ACM SIGMOD International Conference on
Management of Data. ACM. pp. 1383–
1394. doi:10.1145/2723372.2742797. ISBN 978-1-4503-2758-9.
33. ^ Floridi, Luciano; Taddeo, Mariarosaria (28 December 2016). "What is data
ethics?". Philosophical Transactions of the Royal Society A: Mathematical, Physical
and Engineering Sciences. 374 (2083):
20160360. Bibcode:2016RSPTA.37460360F. doi:10.1098/rsta.2016.0360. ISSN 13
64-503X. PMC 5124072. PMID 28336805.
34. ^ Mittelstadt, Brent Daniel; Floridi, Luciano (2016). "The Ethics of Big Data: Current
and Foreseeable Issues in Biomedical Contexts". Science and Engineering
Ethics. 22 (2): 303–341. doi:10.1007/s11948-015-9652-2. ISSN 1353-3452. PMID
26002496.
35. ^ Barocas, Solon; Selbst, Andrew D (2016). "Big Data's Disparate
Impact". California Law Review. doi:10.15779/Z38BG31 – via Berkeley Law Library
Catalog.
36. ^ Caliskan, Aylin; Bryson, Joanna J.; Narayanan, Arvind (14 April
2017). "Semantics derived automatically from language corpora contain human-like
biases". Science. 356 (6334): 183–186. arXiv:1608.07187. Bibcod
e:2017Sci...356..183C. doi:10.1126/science.aal4230. ISSN 0036-8075.
hide
v
t
e
Data
Acquisition
Augmentation
Analysis
Anonymization
Archaeology
Big
Cleansing
Collection
Compression
Corruption
Curation
Deduplication
Degradation
De-identification
Ecosystem
Editing
Engineering
Erasure
ETL/ELT
Extract
Transform
Load
Ethics
Exhaust
Exploration
Farming
Format management
Fusion
Governance
Cooperatives
Infrastructure
Integration
Integrity
Library
Lineage
Loss
Management
Meta
Migration
Mining
Philanthropy
Pre-processing
Preservation
Processing
Protection (privacy)
Publishing
Open data
Recovery
Reduction
Redundancy
Re-identification
Remanence
Rescue
Retention
Quality
Science
Scraping
Scrubbing
Security
Sharing
Stewardship
Storage
Structure
Synchronization
Topological data analysis
Type
Validation
Warehouse
Wrangling/munging
Categories:
Information science
Computer occupations
Computational fields of study
Data analysis
Data science