Emerging Trends in Computer Engineering & Information Technology 120421
Emerging Trends in Computer Engineering & Information Technology 120421
Emerging Trends in Computer Engineering & Information Technology 120421
Content
1.1 Introduction of AI o
Concept o Scope of AI o
Components of AI o
Types of AI o Application
of AI
1.2 Concept of machine learning and deep learning.
1.1 Introduction of AI
A branch of Computer Science named Artificial Intelligence (AI)pursues creating the computers /
machines as intelligent as human beings. John McCarthy the father of Artificial
Intelligence described AI as, “The science and engineering of making intelligent machines,
especially intelligent computer programs”. Artificial Intelligence (AI) is a branch of Science
which deals with helping machines find solutions to complex problems in a more human-like
fashion.
Artificial is defined in different approaches by various researchers during its evolution, such as
“Artificial Intelligence is the study of how to make computers do things which at the moment, people
do better.”
There are other possible definitions “like AI is a collection of hard problems which can be solved by
humans and other living things, but for which we don’t have good algorithms for solving.” e. g.,
understanding spoken natural language, medical diagnosis, circuit design, learning, self-adaptation,
reasoning, chess playing, proving math theories, etc.
• Data: Data is defined as symbols that represent properties of objects events and their
environment.
• Information: Information is a message that contains relevant meaning, implication, or input
for decision and/or action.
• Knowledge: It is the (1) cognition or recognition (know-what), (2) capacity to act(know-
how), and(3)understanding (know-why)that resides or is contained within the mind or in the
brain.
• Intelligence: It requires ability to sense the environment, to make decisions, and to control
action.
1.1.1 Concept:
Artificial Intelligence is one of the emerging technologies that try to simulate human reasoning in
AI systems The art and science of bringing learning, adaptation and selforganization to the machine
is the art of Artificial Intelligence. Artificial Intelligence is the ability of a computer program to learn
and think.Artificial intelligence (AI) is an area of computer science that emphasizes the creation of
intelligent machines that work and reacts like humans. AI is built on these three important concepts
Machine learning: When you command your smartphone to call someone, or when you chat with
a customer service chatbot, you are interacting with software that runs on AI. But this type of
software actually is limited to what it has been programmed to do. However, we expect to soon have
systems that can learn new tasks without humans having to guide them. The idea is to give them a
large amount of examples for any given chore, and they should be able to process each one and learn
how to do it by the end of the activity.
Deep learning: The machine learning example I provided above is limited by the fact that humans
still need to direct the AI’s development. In deep learning, the goal is for the software to use what it
has learned in one area to solve problems in other areas. For example, a program that has learned
how to distinguish images in a photograph might be able to use this learning to seek out patterns in
complex graphs.
Neural networks: These consist of computer programs that mimic the way the human brain
processes information. They specialize in clustering information and recognizing complex patterns,
giving computers the ability to use more sophisticated processes to analyze data.
AI Approach:
The difference between machine and human intelligence is that the human think / act rationally
compare to machine. Historically, all four approaches to AI have been followed, each by different
people with different methods.
Think Well:
Develop formal models of knowledge representation, reasoning, learning, memory, problem solving
thatcan be rendered in algorithms. There is often an emphasis on a systems that are provably correct,
and guarantee finding an optimal solution.
Act Well:
For a given set of inputs, generate an appropriate output that is not necessarily correct but gets the
job done.
• A heuristic (heuristic rule, heuristic method) is a rule of thumb, strategy, trick, simplification,
or any other kind of device which drastically limits search for solutions in large problem
spaces.
• Heuristics do not guarantee optimal solutions; in fact, they do not guarantee any solution at
all:
• all that can be said for a useful heuristic is that it offers solutions which are good enough
most of the time
The Computational model should reflect “how” results were obtained. Provide a new language
forexpressing cognitive theories and new mechanisms for evaluating them.
GPS (General Problem Solver): Goal not just to produce humanlike behavior (like ELIZA), but to
produce a sequence of steps of the reasoning process that was similar to the steps followed by a
person in solving the same task.
Example: ELIZA: A program that simulated a psychotherapist interacting with a patient and
successfully passed the Turing Test. It was coded at MIT during 1964-1966 by Joel Weizenbaum.
First script was DOCTOR. The script was a simple collection of syntactic patterns not unlike regular
expressions. Each pattern had an associated reply which might include bits of the input (after simple
transformations (my →your) Weizenbaum was shocked at reactions: Psychiatrists thought it had
potential. People unequivocally anthropomorphized.
1.1.3 Components of AI
The core components and constituents of AI are derived from the concept of logic, cognition and
computation; and the compound components, built-up through core components are knowledge,
reasoning, search, natural language processing, vision etc.
The core entities are inseparable constituents of AI in that these concepts are fused at atomic level.
The concepts derived from logic are propositional logic, tautology, predicate calculus, model and
temporal logic. The concepts of cognitive science are of two types: one is functional which includes
learning, adaptation and self-organization, and the other is memory and perception which are
physical entities. The physical entities generate some functions to make the compound components
The compound components are made of some combination of the logic and cognition stream. These
are knowledge, reasoning and control generated from constituents of logic such as predicate
calculus, induction and tautology and some from cognition (such as learning and adaptation).
Similarly, belief, desire and intention are models of mental states that are predominantly based on
cognitive components but less on logic. Vision, utterance (vocal) and expression (written) are
combined effect of memory and perceiving organs or body sensors such as ear, eyes and vocal. The
gross level contains the constituents at the third level which are knowledge-based systems (KBS),
heuristic search, automatic theorem proving, multiagent systems, Al languages such as PROLOG
and LISP, Natural language processing (NLP). Speech processing and vision are based mainly on
the principle of pattern recognition. AI Dimension: The philosophy of Al in three-dimensional
representations consists in logic, cognition and computation in the x-direction, knowledge, reasoning
and interface in the ydirection. The x-y plane is the foundation of AI. The z-direction consists of
correlated systems of physical origin such as language, vision and perception as shown in Figure.1.1
Cognition:
Computers has became so popular in a short span of time due to the simple reason that they adapted
and projected the information processing paradigm (IPP) of human beings: sensing organs as input,
mechanical movement organs as output and the central nervous system (CNS) in brain as control
and computing devices, short-term and long-term memory were not distinguished by computer
scientists but, as a whole, it was in conjunction, termed memory.
In further deepening level, the interaction of stimuli with the stored information to produce new
information requires the process of learning, adaptation and self-organization. These functionalities
in the information processing at a certain level of abstraction of brain activities demonstrate a state
of mind which exhibits certain specific behaviour to qualify as intelligence. Computational models
were developed and incorporated in machines which mimicked the functionalities of human origin.
The creation of such traits of human beings in the computing devices and processes originated the
concept of intelligence in machine as virtual mechanism. These virtual machines were termed in due
course of time artificial intelligent machines.
Computation
The third dimension is basically the application domain. Here, if the entities are near the origin, more
and more concepts are required from the x-y plane. For example, consider information and
automation, these are far away from entities on z-direction, but contain some of the concepts of
cognition and computation model respectively on x-direction and concepts of knowledge (data),
reasoning and interface on the y-direction.
In general, any quantity in any dimension is correlated with some entities on the other dimension.
The implementation of the logical formalism was accelerated by the rapid growth in electronic
technology, in general and multiprocessing parallelism in particular.
1.1.4 Types of AI
Artificial Intelligence can be divided in various types, there are mainly two types of main
categorization which are based on capabilities and based on functionally of AI. Following is flow
diagram which explain the types of AI.
2. General AI:
• General AI is a type of intelligence which could perform any intellectual task with efficiency
like a human.
• The idea behind the general AI to make such a system which could be smarter and think like
a human by its own.
• Currently, there is no such system exist which could come under general AI and can perform
any task as perfect as a human.
• The worldwide researchers are now focused on developing machines with General AI.
• As systems with general AI are still under research, and it will take lots of efforts and time
to develop such systems.
3. Super AI:
• Super AI is a level of Intelligence of Systems at which machines could surpass human
intelligence, and can perform any task better than human with cognitive properties. It is an
outcome of general AI.
• Some key characteristics of strong AI include capability include the ability to think, to reason,
solve the puzzle, make judgments, plan, learn, and communicate by its own.
• Super AI is still a hypothetical concept of Artificial Intelligence. Development of such
systems in real is still world changing task.
2. Limited Memory
• Limited memory machines can store past experiences or some data for a short period of time.
• These machines can use stored data for a limited time period only.
• Self-driving cars are one of the best examples of Limited Memory systems. These cars can
store recent speed of nearby cars, the distance of other cars, speed limit, and other information
to navigate the road.
3. Theory of Mind
• Theory of Mind AI should understand the human emotions, people, beliefs, and be able to
interact socially like humans.
• This type of AI machines are still not developed, but researchers are making lots of efforts
and improvement for developing such AI machines.
4. Self-Awareness
• Self-awareness AI is the future of Artificial Intelligence. These machines will be super
intelligent, and will have their own consciousness, sentiments, and self-awareness.
• These machines will be smarter than human mind.
• Self-Awareness AI does not exist in reality still and it is a hypothetical concept.
1.1.5 Application of AI
AI has been dominant in various fields such as −
• Gaming: AI plays crucial role in strategic games such as chess, poker, tic-tac-toe, etc., where
machine can think of large number of possible positions based on heuristic knowledge.
• Natural Language Processing: It is possible to interact with the computer that understands
natural language spoken by humans.
• Expert Systems: There are some applications which integrate machine, software, and special
information to impart reasoning and advising. They provide explanation and advice to the
users.
• Vision Systems: These systems understand, interpret, and comprehend visual input on the
computer. For example, o A spying aeroplane takes photographs, which are used to figure
out spatial information or map of the areas.
o Doctors use clinical expert system to diagnose the patient. o Police use computer
software that can recognize the face of criminal with the stored portrait made by forensic
artist.
• Speech Recognition: Some intelligent systems are capable of hearing and comprehending
the language in terms of sentences and their meanings while a human talks to it. It can handle
different accents, slang words, noise in the background, change in human’s noise due to cold,
etc.
• Handwriting Recognition: The handwriting recognition software reads the text written on
paper by a pen or on screen by a stylus. It can recognize the shapes of the letters and convert
it into editable text.
• Intelligent Robots: Robots are able to perform the tasks given by a human. They have
sensors to detect physical data from the real world such as light, heat, temperature,
movement, sound, bump, and pressure. They have efficient processors, multiple sensors and
huge memory, to exhibit intelligence. In addition, they are capable of learning from their
mistakes and they can adapt to the new environment.
Supervised Learning: Supervised learning deals with learning a function from available training
data. A supervised learning algorithm analyzes the training data and produces an inferred function,
which can be used for mapping new examples. Common examples of supervised learning include:
• classifying e-mails as spam,
• labeling webpages based on their content, and
• voice recognition.
There are many supervised learning algorithms such as neural networks, Support Vector Machines
(SVMs), and Naive Bayes classifiers. Mahout implements Naive Bayes classifier.
Unsupervised Learning: Unsupervised learning makes sense of unlabeled data without having any
predefined dataset for its training. Unsupervised learning is an extremely powerful tool for analyzing
available data and look for patterns and trends. It is most commonly used for clustering similar input
into logical groups. Common approaches to unsupervised learning include:
• k-means
• self-organizing maps, and
• hierarchical clustering
Deep learning has evolved hand-in-hand with the digital era, which has brought about an explosion
of data in all forms and from every region of the world. This data, known simply as big data, is
drawn from sources like social media, internet search engines, e-commerce platforms, and online
cinemas, among others. This enormous amount of data is readily accessible and can be shared
through fintech applications like cloud computing.
However, the data, which normally is unstructured, is so vast that it could take decades for humans
to comprehend it and extract relevant information. Companies realize the incredible potential that
can result from unraveling this wealth of information and are increasingly adapting to AI systems
for automated support.
References:
• https://www.tutorialspoint.com/artificial_intelligence/artificial_intelligence_overview.
htm
• https://www.javatpoint.com/introduction-to-artificial-intelligence
• https://www.tutorialspoint.com/tensorflow/tensorflow_machine_learning_deep_learni
ng.htm