Scribd
Upload
5K views6 pages

Synopsis of ML Project

This document discusses a project that aims to detect defects in a network using machine learning algorithms implemented in Python. The objective is to develop models that can accurately detect issues over time as the input data changes. It proposes a framework that uses unsupervised learning to analyze data before generating supervised models, and creates an automated system using containers and messaging to dynamically select and evaluate machine learning algorithms. If evaluated on cloud network security data, this approach could help identify problems more effectively than conventional methods.

Uploaded by

sudhakar kethana
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
5K views6 pages

Synopsis of ML Project

This document discusses a project that aims to detect defects in a network using machine learning algorithms implemented in Python. The objective is to develop models that can accurately detect issues over time as the input data changes. It proposes a framework that uses unsupervised learning to analyze data before generating supervised models, and creates an automated system using containers and messaging to dynamically select and evaluate machine learning algorithms. If evaluated on cloud network security data, this approach could help identify problems more effectively than conventional methods.

Uploaded by

sudhakar kethana
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 6

DEFECT DETECTION IN NETWORK USING MACHINE

LEARNING ALGORITHMS USING PYTHON

TOPIC OF THE PROJECT:

A PROJECT OF “DEFECT DETECTION IN NETWORK USING MACHINE LEARNING

ALGORITHMS USING PYTHON”.

OBJECTIVE OF THE PROJECT:

Cloud network monitoring data is dynamic and distributed. Signals to monitor the cloud can

appear, disappear or change their importance and clarity over time. Machine learning (ML)

models tuned to a given data set can therefore quickly become inadequate. A model might be

highly accurate at one point in time but may lose its accuracy at a later time due to changes in

input data and their features. Distributed learning with dynamic model selection is therefore

often required. Under such selection, poorly performing models (although aggressively tuned for

the prior data) are retired or put on standby while new or standby models are brought in.

GOAL OF THE PROJECT:

The well-known method of Ensemble ML (EML) may potentially be applied to improve the

overall accuracy of a family of ML models. Unfortunately, EML has several disadvantages,

including the need for continuous training, excessive computational resources, and requirement

for large training datasets, high risks of over fitting, and a time-consuming model-building

process. In this paper, we propose a novel cloud methodology for automatic ML model selection

1
and tuning that automates model building and selection and is competitive with existing

methods. We use unsupervised learning to better explore the data space before the generation of

targeted supervised learning models in an automated fashion. In particular, we create Cloud

DevOps architecture for auto tuning and selection based on container orchestration and

messaging between containers, and take advantage of a new auto scaling method to dynamically

create and evaluate instantiations of ML algorithms. The proposed methodology and tool are

demonstrated on cloud network security datasets.

EXISTING SYSTEM:

To allay users’ concerns, it is essential to provide an effective mechanism for users to

monitor the usage of their data in the cloud. For example, users need to be able to ensure that

their data are handled according to the service level agreements made at the time they sign on for

services in the cloud. Conventional access control approaches developed for closed domains

such as databases and operating systems, or approaches using a centralized server in distributed

environments, are not suitable, due to the following features characterizing cloud environments.

PROBLEMS ON EXISTING SYSTEM:

First, data handling can be outsourced by the direct cloud service provider (CSP) to other

entities in the cloud and theses entities can also delegate the tasks to others, and so on.

Second, entities are allowed to join and leave the cloud in a flexible manner. As a result,

data handling in the cloud goes through a complex and dynamic hierarchical service chain which

does not exist in conventional environments.

2
PROPOSED SYSTEM:

We propose a novel approach, namely Cloud Information Accountability (AutoSelection

and AutoTuning) framework, based on the notion of information accountability. Unlike privacy

protection technologies which are built on the hide-it-or-lose-it perspective, information

accountability focuses on keeping the data usage transparent and trackable. Our proposed ML

framework provides end-to-end accountability in a highly distributed fashion. One of the main

innovative features of the ML framework lies in its ability of maintaining lightweight and

powerful accountability that combines aspects of access control, usage control and

authentication. By means of the ML, data owners can track not only whether or not the service-

level agreements are being honored, but also enforce access and usage control rules as needed.

Associated with the accountability feature, we also develop two distinct modes for auditing: push

mode and pull mode. The push mode refers to logs being periodically sent to the data owner or

stakeholder while the pull mode refers to an alternative approach whereby the user (or another

authorized party) can retrieve the logs as needed.

DFD (DATA FLOW DIAGRAM):

3
4
DFD WORK FLOWS PROCESSING:

 We propose a novel automatic and enforceable logging mechanism in the cloud.

 Our proposed architecture is platform independent and highly decentralized, in

that it does not require any dedicated authentication or storage system in place.

 We go beyond traditional access control in that we provide a certain degree of

usage control for the protected data after these are delivered to the receiver.

 We conduct experiments on a real cloud test bed. The results demonstrate the

efficiency, scalability, and granularity of our approach. We also provide a

detailed security analysis and discuss the reliability and strength of our

architecture.

RESOURCE OF THE PROJECT:

H/W SYSTEM CONFIGURATION:-

Processor - Pentium –IV


RAM - 512 MB

Hard Disk - 80 GB

S/W SYSTEM CONFIGURATION:-

 Operating System : Windows8/10

 Application Server : Glassfish

 Front End : HTML5/CSS

5
 Scripts : JavaScript and JQuery.

 Server side Script : Java, Python with ML.

 Database : MySQL 5.0


 Database Connectivity : JDBC.

LIMITATION OF THE PROJECT

 Lack of time to cover ML Algorithms


 Lack of resources to maintain programming structure.
 Lack of knowledge on project domain
 Lack of documentation

CONCLUSIONS AND FUTURE WORK:

In this paper, several supervised and unsupervised ML models have been combined and applied

on a cloud security dataset. To achieve higher accuracy, multiple models are created for

predicting each type of security attack. The need of unsupervised models in addition to the

supervised ones is demonstrated and shown to result in improved prediction accuracy. We also

plan to exercise the expanded toolset on a variety of cloud computing datasets.

You might also like