Lecture 1.0 AI Technologies and ML
Lecture 1.0 AI Technologies and ML
AI Technologies
• Drawing on big data analytics the use of AI technologies can benefit society on big data analytics the use of AI
technologies can benefit public policy in many ways:
provide more accurate information, forecasts and predictions leading to better outcomes
produce a positive social impact by using AI to provide solutions for some of the most challenging social
problems
simulate complex systems that allow to experiment with different policy options and spot unintended
consequences before committing to a measure
provide personalised public services
automate repetitive and time-consuming tasks which free up
• valuable time for frontline staff
AI Technologies
Natural Language
Machine Learning Computer Vision Robotics Deep Learning
Processing
AI Technology – Machine Learning
• Machine Learning (ML) algorithms …
• are the “methods that can automatically detect patterns in data, and then … use the uncovered patterns to predict
future data or other outcomes of interest” (Murphy, 2012)
• is the most widely-used form of AI, and has contributed to innovations like self driving cars, speech
recognition and machine translation etc.
- Murphy, K. P., Machine Learning: A Probabilistic Perspective, MIT Press, 2012. https://www.amazon.com/Machine-Learning-Probabilistic-Perspective-Computation/dp/0262018020
- https://www.gov.uk/government/collections/a-guide-to-using-artificial-intelligence-in-the-public-sector
Machine learning algorithms
• Rashidi, H. H., Tran, N. K., Abb, H., Betts, E. V., Howell, L. P., & Green, R. (2019). Artificial Intelligence and Machine Learning in Pathology : The
Present Landscape of Supervised Methods. 6. https://doi.org/10.1177/2374289519873088
Machine learning algorithms: Supervised learning
• Supervised learning - employ “labeled” datasets for model training and then classify unlabeled input data or
predict outcomes based on its prior training parameters (testing).
• Regression
• Decision Trees model for predicting and preventing customer churn
- Rashidi, H. H., Tran, N. K., Abb, H., Betts, E. V., Howell, L. P., & Green, R. (2019). Artificial Intelligence and Machine Learning in Pathology : The Present Landscape of Supervised Methods. 6.
https://doi.org/10.1177/2374289519873088
- Models for machine learning https://developer.ibm.com/articles/cc-models-machine-learning/
- https://www.projectpro.io/article/neural-network-projects/440
- Baduge, S. K., Thilakarathna, S., Perera, J. S., Arashpour, M., Sharafi, P., Teodosio, B., Shringi, A., & Mendis, P., Artificial intelligence and smart vision for building and construction 4.0: Machine and deep learning methods
and applications, Automation in Construction, Volume 141, 2022, 104440, https://doi.org/10.1016/j.autcon.2022.104440
Machine learning algorithms: Unsupervised
learning
• Unsupervised learning - identifying hidden structures within unlabeled datasets based on the features
similarity and resulting in groups or clusters.
• Labels of clusters (groups) are not provided; hence, the right output is not known
• It becomes difficult to determine the results accuracy
• Used mostly in an exploratory way, e.g., for better comprehension of data
• Dimensionally reduction
• Principle Component Analysis for identify push and pull factors affecting migration
- Rashidi, H. H., Tran, N. K., Abb, H., Betts, E. V., Howell, L. P., & Green, R. (2019). Artificial Intelligence and Machine Learning in Pathology : The Present Landscape of Supervised Methods. 6.
https://doi.org/10.1177/2374289519873088
- Models for machine learning https://developer.ibm.com/articles/cc-models-machine-learning/
- Baduge, S. K., Thilakarathna, S., Perera, J. S., Arashpour, M., Sharafi, P., Teodosio, B., Shringi, A., & Mendis, P., Artificial intelligence and smart vision for building and construction 4.0: Machine and deep learning methods
and applications, Automation in Construction, Volume 141, 2022, 104440, https://doi.org/10.1016/j.autcon.2022.104440
Machine learning algorithms: Reinforcement
Learning
• Reinforcement Learning - finds optimal solutions to sequential decision problems
through trial and error.
- Murphy M. Google’s AI Just Cracked the Game that Supposedly No Computer Could Beat. Quartz; 2016. https://qz.com/603313/googles-ai-just-cracked-the-game-that-supposedly-no-computercould-beat
- Greenmeier L. 20 Years After Deep Blue: How AI has Advanced Since Conquering Chess. Scientific American; 2017. https://www. scientificamerican.com/article/20-years-after-deep-blue-how-ai- has-advanced-since-conquering-chess
- Rashidi, H. H., Tran, N. K., Abb, H., Betts, E. V., Howell, L. P., & Green, R. (2019). Artificial Intelligence and Machine Learning in Pathology : The Present Landscape of Supervised Methods. 6. https://doi.org/10.1177/2374289519873088
- Baduge, S. K., Thilakarathna, S., Perera, J. S., Arashpour, M., Sharafi, P., Teodosio, B., Shringi, A., & Mendis, P., Artificial intelligence and smart vision for building and construction 4.0: Machine and deep learning methods and applications,
Automation in Construction, Volume 141, 2022, 104440, https://doi.org/10.1016/j.autcon.2022.104440
AI Technology – Machine Learning Applications
• What is “Understanding”?
• Human understands, what about computers?
• Natural language is vague, context driven
• True understanding requires extensive knowledge of a topic
• Can/will computers ever understand natural language the same/accurate way we do?
Natural Language Processing Task Categories (1)
• Automatic summarization - condensing a piece of text to a shorter version preserving key
informational elements and the meaning of content
• extractive - picks up sentences directly from the document based on a scoring function to form a
coherent summary
• abstractive - aim to create a summary by interpreting text and sentence paraphrasing using advanced NLP
techniques to create new shorter text
• Interactive Question answering - retrieving valid and accurate answers to user question asked in
natural language instead of query
• the answer can be extracted from a portion of a document or generated by condensing/summarizing
fragments
• Automatic speech recognition - converts spoken words into computer texts (Siri,Apple, Alexa, etc)
• could be used by chatbots to provide alternative ways to interact with end-users
- https://www.analyticsvidhya.com/blog/2021/01/introduction-to-automatic-speech-recognition-and-natural-language-processing/
- Natural Language Processing for Public Services DIGIT Directorate-General for Informatics. https://joinup.ec.europa.eu/collection/catalogue-services/document/study-natural-language-processing-public-services
- https://joinup.ec.europa.eu/interoperable-europe
- https://medium.com/luisfredgs/automatic-text-summarization-with-machine-learning-an-overview-68ded5717a25
Natural Language Processing Task Categories (1I)
• Machine translation
• is applied in the creation of online translation apps, B2B domain-specific translation, speech-to-speech
translation, and other areas
• Natural language generation & understanding
• e.g., automated journalism, where a computer searches the Internet for real-time news, extracts data from
various sources, and writes a text summary
• Speech-to-text applications
• can be used instead of handwritten dictation, for example, to transcribe minutes of meetings
• Text-to-speech apps
• can be used to read books, articles, or other text aloud, or to add narration to videos
• Optical character recognition – extracts characters from images (for example, scan a form or a receipt)
and turn them into machine- and human-readable text
- ttps://medium.com/luisfredgs/automatic-text-summarization-with-machine-learning-an-overview-68ded5717a25
- https://joinup.ec.europa.eu/interoperable-europe
- https://www.digital-adoption.com/optical-character-recognition/
Natural Language Processing Applications
Marketing applications
Enables better CRM
Medicine and biology
Literature-based discovery
Academic applications
Research stream analysis
Healthcare
Prioritising improvement issues
Justice
Preparing judicial opinions
Hiring and Recruitment
Identifying the fit and not-fit candidates
Digital businesses
Target Advertising and gain potential customers
https://appinventiv.com/blog/natural-language-processing-applications-for-business/
https://www.mygreatlearning.com/blog/trending-natural-language-processing-applications/
Interactive Question Answering Application –
ChatGPT Video Clip
22 Jan. 2019
Source - Titel of the presentation Page 14
https://www.youtube.com/watch?v=qqxdsooKggE
Computer Vision
• Computer Vision …
Berryhill, J., & Clogher, R. (2019). Hello, World : Artificial intelligence and its use in the public sector (Issue 36).
Computer Vision Applications
• Medicine
detection of diseases such as cancer
• Education
image or video description and captioning (with NLP )
• Transport
scanning license plates enabling cashless road tolls
• Facial recognition
person identification, recruitment and hiring, policing (with ML)
• Trading
trademark search enables users to upload a logo and return results based on visual similarity (with
ML)
• Public safety
surveillance systems to detect possible threats to public safety and order in real-time (with ML)
Berryhill, J., & Clogher, R. (2019). Hello, World : Artificial intelligence and its use in the public sector (Issue 36).
Robotics
• Robotics is ….
a separate entity in AI that helps study the creation of intelligent robots or machines
combines electrical engineering, mechanical engineering, and computer science & engineering as they have
mechanical parts, electrical components and are programmed with programming language
• What is a robot?
A robot is a machine that (looks like a human and) can perform out-of-box actions and replicate certain human
movements automatically by means of commands given to it using programming
Source:
https://www.youtube.com/watch?v=S5t6K9iwcd
Deep Learning
• Deep Learning is ….
is inspired by the biology of human brains
is a subset of ML that's based on Artificial Neural Networks (ANN)
require computers with powerful processing, computational capabilities and Biologics vs Artificial Neural network
scientists estimate that there are up to 100 billion neurons in the human brain
neurons are connected to each other by synapses that pass on information by
sending electrical impulses back and forth, in the process “exciting” or
“activating” the neurons
Artificial Neural Networks try to replicate these mechanisms and behaviours
using math
Berryhill, J., & Clogher, R. (2019). Hello, World : Artificial intelligence and its use in the public sector (Issue 36)
https://towardsdatascience.com/intro-to-deep-learning-c025efd92535
https://builtin.com/artificial-intelligence/ai-vs-machine-learning
https://sites.google.com/site/mrstevensonstechclassroom/hl-topics-only/4a-robotics-ai/neural-networks-computational-intelligence?overridemobile=true
Deep Learning Application
• Autonomous vehicles
• robotaxi vehicles learn from some of the most challenging driving situation (with Computer Vision)
• Agriculture
• lettuce bot that knows how to single out weeds for chemical spraying
• CRM systems
• predictive lead scoring to identify customers with best chances to close
• Fraud detection
• detect anomalies in user transactions
• Vocal AI
• to identify and suppress background noise in audio files
• Healthcare
• to detect skin cancer through images