System Analysis
System Analysis
BACHELOR OF TECHNOLOGY
In
COMPUTER SCIENCE AND ENGINEERING
By
2018-2022
(Approved by AICTE & Affiliated to JNTUH)
Survey No. 179, Chilkur (V), Moinabad (M), Ranga Reddy Dist. TS.
Date:
CERTIFICATE
This is to certify that the project work entitled “DISCOVERY OF RANKING FRAUD FOR MOBILE APPS”,
is a bonafide work of SHAROON PAUL (16U61A0528), AHMED HUSSAIN KHAN (16D55A0501),
MD.HASEEBUDDIN (17U61A0522), B.NIKHIL(17U61A0507) submitted in partial fulfillment of the
requirement for the award of Bachelor of Technology in Computer Science and Engineering during the
Academic year 2020-21. This is further certified that the work done under my guidance, and the results
of this work have not been submitted elsewhere for the award of any other degree or diploma.
Associate Professor
External Examiner
DECLARATION
We hereby declare that the project work entitled DISCOVERY OF RANKING FRAUD FOR MOBILE
APPS, submitted to Department of Computer Science and Engineering, Global Institute
We are thankful to our guide Mr.SYED MAZHARUDDIN, Associate Professor of CSE Department for
his valuable guidance for successful completion of this project.
We express our sincere thanks to Ms. SHIRISHA, Project Coordinator for giving us an opportunity to
undertake the project “DISCOVERY OF RANKING FRAUD FOR MOBILE APPS” and for enlightening us on
various aspects of our project work and assistance in the evaluation of material and facts. She not only
encouraged us to take up this topic but also given her valuable guidancein assessing facts and arriving
at conclusions.
We are also most obliged and grateful to Mr. SYED MAZHARUDDIN, Associate Professor and Head,
Department of CSE for giving us guidance in completing this project successfully.
We express our heart-felt gratitude to our Vice-Principal Mr.G AHMED ZEESHAN, Co-Ordinator
Internal Quality Assurance Cell (IQAC) for his constant guidance, cooperation, motivation and support
which have always kept us going ahead. We owe a lot of gratitude to him for always being there for us.
We are also most obliged and grateful to our Principal Prof. DR.K.SHIVALINGAMfor giving us
guidance in completing this project successfully.
We also thank our parents for their constant encourage and support without which the project
would have not come to an end.
Last but not the least, we would also like to thank all our class mates who have extended their
cooperation during our project work.
MD HASEEBUDDIN 17U61A0522
B.NIKHIL 17U61A0507
VISION
The vision of the department is to produce professional computer science engineers who can meet the
expectations of the globe and contribute to the advancement of engineering and technology which
involves creativity and innovations by providing an excellent learning environment with the best
quality facilities.
MISSION
1.To provide the students with a practical and qualitative education in a modern technical
environment that will help to improve their abilities and skills in solving programming problems
effectively with different ideas and knowledge.
2.To infuse the scientific temper in the students towards the research and development in
Computer Science and Engineering trends.
3.To mold the graduates to assume leadership roles by possessing good communication skills,
an appreciation for their social and ethical responsibility in a global setting, and the ability to work
effectively as team members.
PEO1: To provide graduates with a good foundation in mathematics, sciences and engineering
fundamentals required to solve engineering problems that will facilitate them to find employment in
MNC’s and / or to pursue post graduate studies with an appreciationfor lifelong learning.
PEO2: To provide graduates with analytical and problem-solving skills to design algorithms, other
hardware / software systems, and inculcate professional ethics, inter- personal skills to work in a multi-
cultural team.
PEO3: To facilitate graduates to get familiarized with the art software / hardware tools, imbibing
creativity and innovation that would enable them to develop cutting edge technologies of multi-
disciplinary nature for societal development.
PROGRAM OUTCOMES
PO 5: Modern tool usage: create, select and apply appropriate techniques, resources and modern
engineering and IT tools including prediction and modeling to complex engineering activities with an
understanding of the limitations.
PO 6: The engineer and society: apply reasoning informed by the contextual knowledgeto assess
societal, health, safety, legal and cultural issues and the consequentresponsibilities relevant to the
professional engineering practice.
PO 7: Environment sustainability: understand the impact of the professional engineeringsolutions in
the societal and environmental contexts, and demonstrate the knowledge of, and need for sustainable
development.
PO 8: Ethics: apply ethical principles and commit to professional ethics and responsibilities and
norms of the engineering practice.
PO 9: Individual and team work: function effectively as an individual and as a memberor leader in
diverse teams, and in multidisciplinary settings.
PO 12: Lifelong learning: recognize the need for, and have the preparation and ability
to engage in independent and lifelong learning in the broader context of technological
change.
ABSTRACT
In today's world online education is the new challenge and to make teaching much easier
and effective there must be some handy tools for the work to go by ease. Air canvas is one such
tool which can be used to make e-learning effective. It is a hands-free digital drawing canvas that
utilizes a Camera and OpenCV to recognize and map hand gestures onto a screen. The user’s
brush can be modified in size and color by using built-in buttons. The direction of the brush is
controlled completely using open source OpenCV software and modified to map the pointer finger
onto the screen following a calibration screen to measure and record the color of the user’s hand.
The idea for Air Canvas is a result of developing handy tools in digital drawing and smart
photo recognition software. To create a simple prototype for a drawing tool that uses hand gesture
recognition software to paint on a screen. Core objectives include: Using OpenCV to recognize
the pointer finger. Mapping coordinates extracted from hand recognition software to produce a
drawing. Implementing additional features such as color change, size change on-screen.
SYSTEM ANALYSIS
EXISTING SYSTEM:
❖ In the literature, while there are some related work, such as web ranking spam
detection, online review spam detection and mobile App recommendation, the
problem of detecting ranking fraud for mobile Apps is still under-explored.
❖ Generally speaking, the related works of this study can be grouped into three
categories.
❖ The first category is about web ranking spam detection.
❖ The second category is focused on detecting online review spam.
❖ Finally, the third category includes the studies on mobile App
recommendation
❖ Although some of the existing approaches can be used for anomaly detection
from historical rating and review records, they are not able to extract fraud
evidences for a given time period (i.e., leading session).
❖ Cannot able to detect ranking fraud happened in Apps’ historical leading
sessions
❖ There is no existing benchmark to decide which leading sessions or Apps
really contain ranking fraud.
PROPOSED SYSTEM:
❖ The proposed framework is scalable and can be extended with other domain
generated evidences for ranking fraud detection.
❖ Experimental results show the effectiveness of the proposed system, the
scalability of the detection algorithm as well as some regularity of ranking
fraud activities.
❖ To the best of our knowledge, there is no existing benchmark to decide which
leading sessions or Apps really contain ranking fraud. Thus, we develop four
intuitive baselines and invite five human evaluators to validate the
effectiveness of our approach Evidence Aggregation based Ranking Fraud
Detection (EA-RFD).
SYSTEM DESIGN
SYSTEM ARCHITECTURE:
DATA FLOW DIAGRAM:
1. The DFD is also called as bubble chart. It is a simple graphical formalism that
can be used to represent a system in terms of input data to the system, various
processing carried out on this data, and the output data is generated by this
system.
2. The data flow diagram (DFD) is one of the most important modeling tools. It
is used to model the system components. These components are the system
process, the data used by the process, an external entity that interacts with the
system and the information flows in the system.
3. DFD shows how the information moves through the system and how it is
modified by a series of transformations. It is a graphical technique that depicts
information flow and the transformations that are applied as data moves from
input to output.
4. DFD is also known as bubble chart. A DFD may be used to represent a system
at any level of abstraction. DFD may be partitioned into levels that represent
increasing information flow and functional detail.
ADMIN
Local Anomaly
End
User:
Classification of
Apk
Evidence Aggregation
End
Global Anomaly:
Global Anomaly
Comparion table
End
UML DIAGRAMS
GOALS:
The Primary goals in the design of the UML are as follows:
1. Provide users a ready-to-use, expressive visual modeling Language so that
they can develop and exchange meaningful models.
2. Provide extendibility and specialization mechanisms to extend the core
concepts.
3. Be independent of particular programming languages and development
process.
4. Provide a formal basis for understanding the modeling language.
5. Encourage the growth of OO tools market.
6. Support higher level development concepts such as collaborations,
frameworks, patterns and components.
7. Integrate best practices.
Store HistroricalData
USER
Ranking,Rating Based Evidences
Compare ratings
USER
Local Anomaly Global Anomaly
Select Apk
Apk ID Apk ID view apk details
Apk Name Apk Name Give Rank and Rating
Category Category
Apk Details Apk Details Select()
ViewSelected Results()
View Ranking()
Login() Login() Compare Apk Details()
Add Fraud Features() StoreData() Download Apk()
StoreData()
SEQUENCE DIAGRAM:
Upload APK
Classification Of APK
Select APK
Store Original
Classification APK View APK Details Rating and Reviews
HARDWARE REQUIREMENTS:
SOFTWARE REQUIREMENTS:
FEASIBILITY STUDY
ECONOMICAL FEASIBILITY
TECHNICAL FEASIBILITY
SOCIAL FEASIBILITY
ECONOMICAL FEASIBILITY
This study is carried out to check the economic impact that the system
will have on the organization. The amount of fund that the company can pour
into the research and development of the system is limited. The expenditures
must be justified. Thus the developed system as well within the budget and
this was achieved because most of the technologies used are freely available.
Only the customized products had to be purchased.
TECHNICAL FEASIBILITY
This study is carried out to check the technical feasibility, that is,
the technical requirements of the system. Any system developed must not
have a high demand on the available technical resources. This will lead to high
demands on the available technical resources. This will lead to high demands
being placed on the client. The developed system must have a modest
requirement, as only minimal or null changes are required for implementing
this system.
SOCIAL FEASIBILITY
Software system meets its requirements and user expectations and does not
fail in an unacceptable manner. There are various types of test. Each test
type addresses a specific testing requirement.
TYPES OF TESTS
Unit testing
Unit testing involves the design of test cases that validate that the
internal program logic is functioning properly, and that program inputs
produce valid outputs. All decision branches and internal code flow should
be validated. It is the testing of individual software units of the application
.it is done after the completion of an individual unit before integration. This
is a structural testing, that relies on knowledge of its construction and is
invasive. Unit tests perform basic tests at component level and test a
specific business process, application, and/or system configuration. Unit
tests ensure that each unique path of a business process performs accurately
to the documented specifications and contains clearly defined inputs and
expected results.
31
Integration testing
Functional test
32
Organization and preparation of functional tests is focused on
requirements, key functions, or special test cases. In addition, systematic
coverage pertaining to identify Business process flows; data fields,
predefined processes, and successive processes must be considered for
testing. Before functional testing is complete, additional tests are identified
and the effective value of current tests is determined.
System Test
System testing ensures that the entire integrated software system meets
requirements. It tests a configuration to ensure known and predictable
results. An example of system testing is the configuration oriented system
integration test. System testing is based on process descriptions and flows,
emphasizing pre-driven process links and integration points.
33
software under test is treated, as a black box .you cannot “see” into it. The
test provides inputs and responds to outputs without considering how the
software works.
Test objectives
• All field entries must work properly.
• Pages must be activated from the identified link.
• The entry screen, messages and responses must not be delayed.
Features to be tested
• Verify that the entries are of the correct format
• No duplicate entries should be allowed
• All links should take the user to the correct page.
34
6.2 Integration Testing
Test Results: All the test cases mentioned above passed successfully. No
defects encountered.
Test Results: All the test cases mentioned above passed successfully. No
defects encountered.
35
ABSTRACT
Ranking fraud in the mobile App market refers to fraudulent or deceptive activities
which have a purpose of bumping up the Apps in the popularity list. Indeed, it
becomes more and more frequent for App developers to use shady means, such as
inflating their Apps’ sales or posting phony App ratings, to commit ranking fraud.
While the importance of preventing ranking fraud has been widely recognized, there
is limited understanding and research in this area. To this end, in this paper, we
provide a holistic view of ranking fraud and propose a ranking fraud detection
system for mobile Apps. Specifically, we first propose to accurately locate the
ranking fraud by mining the active periods, namely leading sessions, of mobile
Apps. Such leading sessions can be leveraged for detecting the local anomaly instead
of global anomaly of App rankings. Furthermore, we investigate three types of
evidences, i.e., ranking based evidences, rating based evidences and review based
evidences, by modeling Apps’ ranking, rating and review behaviors through
statistical hypotheses tests. In addition, we propose an optimization based
aggregation method to integrate all the evidences for fraud detection. Finally, we
evaluate the proposed system with real-world App data collected from the iOS App
Store for a long time period. In the experiments, we validate the effectiveness of the
proposed system, and show the scalability of the detection algorithm as well as some
regularity of ranking fraud activities.
36
REFERENCES
37
[10] Y. Ge, H. Xiong, C. Liu, and Z.-H. Zhou, “A taxi driving fraud detection
system,” in Proc. IEEE 11th Int. Conf. Data Mining, 2011, pp. 181–190.
[11] D. F. Gleich and L.-h. Lim, “Rank aggregation via nuclear norm minimization,”
in Proc. 17th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2011, pp.
60–68.
[12] T. L. Griffiths and M. Steyvers, “Finding scientific topics,” Proc. Nat. Acad.
Sci. USA, vol. 101, pp. 5228–5235, 2004.
[13] G. Heinrich, Parameter estimation for text analysis, “ Univ. Leipzig, Leipzig,
Germany, Tech. Rep., http://faculty.cs.byu.edu/~ringger/ CS601R/papers/Heinrich-
GibbsLDA.pdf, 2008.
[14] N. Jindal and B. Liu, “Opinion spam and analysis,” in Proc. Int. Conf. Web
Search Data Mining, 2008, pp. 219–230.
38
[18] A. Klementiev, D. Roth, K. Small, and I. Titov, “Unsupervised rank aggregation
with domain-specific expertise,” in Proc. 21st Int. Joint Conf. Artif. Intell., 2009, pp.
1101–1106.
[19] E.-P. Lim, V.-A. Nguyen, N. Jindal, B. Liu, and H. W. Lauw, “Detecting
product review spammers using rating behaviors,” in Proc. 19thACMInt. Conf.
Inform. Knowl. Manage., 2010, pp. 939–948.
[20] Y.-T. Liu, T.-Y. Liu, T. Qin, Z.-M. Ma, and H. Li, “Supervised rank
aggregation,” in Proc. 16th Int. Conf. World Wide Web, 2007, pp. 481–490.
[24] K. Shi and K. Ali, “Getjar mobile application recommendations with very
sparse datasets,” in Proc. 18th ACM SIGKDD Int. Conf. Knowl. Discovery Data
Mining, 2012, pp. 204–212.
39
[25] N. Spirin and J. Han, “Survey on web spam detection: Principles and
algorithms,” SIGKDD Explor. Newslett., vol. 13, no. 2, pp. 50– 64, May 2012.
[27] Z. Wu, J. Wu, J. Cao, and D. Tao, “HySAD: A semi-supervised hybrid shilling
attack detector for trustworthy product recommendation,” in Proc. 18th ACM
SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2012, pp. 985–993.
[28] S. Xie, G. Wang, S. Lin, and P. S. Yu, “Review spam detection via temporal
pattern discovery,” in Proc. 18th ACM SIGKDD Int. Conf. Knowl. Discovery Data
Mining, 2012, pp. 823–831.
[30] B. Zhou, J. Pei, and Z. Tang, “A spamicity approach to web spam detection,”
in Proc. SIAM Int. Conf. Data Mining, 2008, pp. 277–288.
[31] H. Zhu, H. Cao, E. Chen, H. Xiong, and J. Tian, “Exploiting enriched contextual
information for mobile app classification,” in Proc. 21st ACMInt. Conf. Inform.
Knowl. Manage., 2012, pp. 1617–1621.
[32] H. Zhu, E. Chen, K. Yu, H. Cao, H. Xiong, and J. Tian, “Mining personal
context-aware preferences for mobile users,” in Proc. IEEE 12th Int. Conf. Data
Mining, 2012, pp. 1212–1217.
40
[33] H. Zhu, H. Xiong, Y. Ge, and E. Chen, “Ranking fraud detection for mobile
apps: A holistic view,” in Proc. 22nd ACM Int. Conf. Inform. Knowl. Manage.,
2013, pp. 619–628.
41
CONCLUSION
In this paper, we developed a ranking fraud detection system for mobile Apps.
Specifically, we first showed that ranking fraud happened in leading sessions and
provided a method for mining leading sessions for each App from its historical
ranking records. Then, we identified ranking based evidences, rating based
evidences and review based evidences for detecting ranking fraud. Moreover, we
proposed an optimization based aggregation method to integrate all the evidences
for evaluating the credibility of leading sessions from mobile Apps. An unique
perspective of this approach is that all the evidences can be modeled by statistical
hypothesis tests, thus it is easy to be extended with other evidences from domain
knowledge to detect ranking fraud. Finally, we validate the proposed system with
extensive experiments on real-world App data collected from the Apple’s App store.
Experimental results showed the effectiveness of the proposed approach. In the
future, we plan to study more effective fraud evidences and analyze the latent
relationship among rating, review and rankings. Moreover, we will extend our
ranking fraud detection approach with other mobile App related services, such as
mobile Apps recommendation, for enhancing user experience.
42
IMPLEMENTATION
MODULES:
MODULES DESCRIPTION
43
different ranking phases, namely, rising phase, maintaining phase and recession
phase. Specifically, in each leading event, an App’s ranking first increases to a peak
position in the leaderboard (i.e., rising phase), then keeps such peak position for a
period (i.e., maintaining phase), and finally decreases till the end of the event (i.e.,
recession phase).
In this module we add the Review based Evidences module in our system. Besides
ratings, most of the App stores also allow users to write some textual comments as
App reviews. Such reviews can reflect the personal perceptions and usage
experiences of existing users for particular mobile Apps. Indeed, review
manipulation is one of the most important perspective of App ranking fraud.
Specifically, before downloading or purchasing a new mobile App, users often first
read its historical reviews to ease their decision making, and a mobile App contains
more positive reviews may attract more users to download. Therefore, imposters
44
often post fake reviews in the leading sessions of a specific App in order to inflate
the App downloads, and thus propel the App’s ranking position in the leader board.
Evidence Aggregation
In this module we develop the Evidence Aggregation module to our system. After
extracting three types of fraud evidences, the next challenge is how to combine them
for ranking fraud detection. Indeed, there are many ranking and evidence
aggregation methods in the literature, such as permutation based models
score based models and Dempster-Shafer rules . However, some of these methods
focus on learning a global ranking for all candidates. This is not proper for detecting
ranking fraud for new Apps. Other methods are based on supervised learning
techniques, which depend on the labeled training data and are hard to be exploited.
Instead, we propose an unsupervised approach based on fraud similarity to combine
these evidences.
45
INPUT DESIGN
The input design is the link between the information system and the user. It
comprises the developing specification and procedures for data preparation
and those steps are necessary to put transaction data in to a usable form for
processing can be achieved by inspecting the computer to read data from a
written or printed document or it can occur by having people keying the data
directly into the system. The design of input focuses on controlling the amount
of input required, controlling the errors, avoiding delay, avoiding extra steps
and keeping the process simple. The input is designed in such a way so that it
provides security and ease of use with retaining the privacy. Input Design
considered the following things:
46
2. It is achieved by creating user-friendly screens for the data entry to handle
large volume of data. The goal of designing input is to make data entry easier
and to be free from errors. The data entry screen is designed in such a way
that all the data manipulates can be performed. It also provides record viewing
facilities.
3.When the data is entered it will check for its validity. Data can be entered
with the help of screens. Appropriate messages are provided as when needed
so that the user
will not be in maize of instant. Thus the objective of input design is to create
an input layout that is easy to follow
OUTPUT DESIGN
A quality output is one, which meets the requirements of the end user and
presents the information clearly. In any system results of processing are
communicated to the users and to other system through outputs. In output
design it is determined how the information is to be displaced for immediate
need and also the hard copy output. It is the most important and direct source
information to the user. Efficient and intelligent output design improves the
system’s relationship to help user decision-making.
47
and effectively. When analysis design computer output, they should Identify
the specific output that is needed to meet the requirements.
48
INTRODUCTION
What is Data Mining?
49
statistical, machine learning, and neural networks. Generally, any of four types of
relationships are sought:
1) Extract, transform, and load transaction data onto the data warehouse
system.
2) Store and manage the data in a multidimensional database system.
3) Provide data access to business analysts and information technology
professionals.
4) Analyze the data by application software.
5) Present the data in a useful format, such as a graph or table.
50
Different levels of analysis are available:
• Rule induction: The extraction of useful if-then rules from data based on
statistical significance.
51
Characteristics of Data Mining:
1) It’s one of the most effective services that are available today. With the help
of data mining, one can discover precious information about the customers
and their behavior for a specific set of products and evaluate and analyze,
store, mine and load data related to them
2) An analytical CRM model and strategic business related decisions can be
made with the help of data mining as it helps in providing a complete synopsis
of customers
3) An endless number of organizations have installed data mining projects and it
has helped them see their own companies make an unprecedented
improvement in their marketing strategies (Campaigns)
4) Data mining is generally used by organizations with a solid customer focus.
For its flexible nature as far as applicability is concerned is being used
vehemently in applications to foresee crucial data including industry analysis
and consumer buying behaviors
5) Fast paced and prompt access to data along with economic processing
techniques have made data mining one of the most suitable services that a
company seek
52
Advantages of Data Mining:
1. Marketing / Retail:
Data mining helps marketing companies build models based on historical data to
predict who will respond to the new marketing campaigns such as direct mail, online
marketing campaign…etc. Through the results, marketers will have appropriate
approach to sell profitable products to targeted customers.
Data mining brings a lot of benefits to retail companies in the same way as
marketing. Through market basket analysis, a store can have an appropriate
production arrangement in a way that customers can buy frequent buying products
together with pleasant. In addition, it also helps the retail companies offer certain
discounts for particular products that will attract more customers.
2. Finance / Banking
Data mining gives financial institutions information about loan information and
credit reporting. By building a model from historical customer’s data, the bank and
financial institution can determine good and bad loans. In addition, data mining helps
banks detect fraudulent credit card transactions to protect credit card’s owner.
3. Manufacturing
53
quality of wafer are lot the same and some for unknown reasons even has defects.
Data mining has been applying to determine the ranges of control parameters that
lead to the production of golden wafer. Then those optimal control parameters are
used to manufacture wafers with desired quality.
4. Governments
5. Law enforcement:
Data mining can aid law enforcers in identifying criminal suspects as well as
apprehending these criminals by examining trends in location, crime type, habit,
and other patterns of behaviors.
6. Researchers:
Data mining can assist researchers by speeding up their data analyzing process;
thus, allowing those more time to work on other projects.
54
LITERATURE SURVEY
Many areas of study, such as information retrieval, collaborative filtering, and social
choice face the preference aggregation problem, in which multiple preferences over
objects must be combined into a consensus ranking. Preferences over items can be
expressed in a variety of forms, which makes the aggregation problem difficult. In
this work we formulate a flexible probabilistic model over pairwise comparisons that
can accommodate all these forms. Inference in the model is very fast, making it
applicable to problems with hundreds of thousands of preferences. Experiments on
benchmark datasets demonstrate superior performance to existing methods .
55
2) Getjar mobile application recommendations with very sparse datasets
The Netflix competition of 2006 [2] has spurred significant activity in the
commendations field, particularly in approaches using latent factor models
[3,5,8,12] However, the near ubiquity of the Netflix and the similar MovieLens
datasets1 may be narrowing the generality of lessons learned in this field. At GetJar,
our goal is to make appealing recommendations of mobile applications (apps). For
app usage, we observe a distribution that has higher kurtosis (heavier head and
longer tail) than that for the aforementioned movie datasets. This happens primarily
because of the large disparity in resources available to app developers and the low
cost of app publication relative to movies.
In this paper we compare a latent factor (PureSVD) and a memory-based model with
our novel PCA-based model, which we call Eigenapp. We use both accuracy and
variety as evaluation metrics. PureSVD did not perform well due to its reliance on
explicit feedback such as ratings, which we do not have. Memory-based approaches
that perform vector operations in the original high dimensional space over-predict
popular apps because they fail to capture the neighborhood of less popular apps.
They have high accuracy due to the concentration of mass in the head, but did poorly
in terms of variety of apps exposed. Eigenapp, which exploits neighborhood
information in low dimensional spaces, did well both on precision and variety,
underscoring the importance of dimensionality reduction to form quality
neighborhoods in high kurtosis distributions.
56
3) Detecting spam web pages through content analysis
AUTHORS: A. Ntoulas, M. Najork, M. Manasse, and D. Fetterly
57
4) Spotting opinion spammers using behavioral footprints
AUTHORS: A. Mukherjee, A. Kumar, B. Liu, J. Wang, M. Hsu, M. Castellanos,
and R. Ghosh
Opinionated social media such as product reviews are now widely used by
individuals and organizations for their decision making. However, due to the reason
of profit or fame, people try to game the system by opinion spamming (e.g., writing
fake reviews) to promote or to demote some target products. In recent years, fake
review detection has attracted significant attention from both the business and
research communities. However, due to the difficulty of human labeling needed for
supervised learning and evaluation, the problem remains to be highly challenging.
This work proposes a novel angle to the problem by modeling spamicity as latent.
An unsupervised model, called Author Spamicity Model (ASM), is proposed. It
works in the Bayesian setting, which facilitates modeling spamicity of authors as
latent and allows us to exploit various observed behavioral footprints of reviewers.
The intuition is that opinion spammers have different behavioral distributions than
non-spammers. This creates a distributional divergence between the latent
population distributions of two clusters: spammers and non-spammers. Model
inference results in learning the population distributions of the two clusters. Several
extensions of ASM are also considered leveraging from different priors.
Experiments on a real-life Amazon review dataset demonstrate the effectiveness of
the proposed models which significantly outperform the state-of-the-art competitors.
58
AUTHORS: A. Klementiev, D. Roth, K. Small, and I. Titov
Consider the setting where a panel of judges is repeatedly asked to (partially) rank
sets of objects according to given criteria, and assume that the judges' expertise
depends on the objects' domain. Learning to aggregate their rankings with the goal
of producing a better joint ranking is a fundamental problem in many areas of
Information Retrieval and Natural Language Processing, amongst others. However,
supervised ranking data is generally difficult to obtain, especially if coming from
multiple domains. Therefore, we propose a framework for learning to aggregate
votes of constituent rankers with domain specific expertise without supervision. We
apply the learning framework to the settings of aggregating full rankings and
aggregating top-k lists, demonstrating significant improvements over a domain-
agnostic baseline in both cases.
59
ORGANIZATION PROFILE
COMPANY PROFILE:
60
The indispensable factors, which give the competitive advantages over others in
the market, may be slated as:
• Performance
• Pioneering efforts
• Client satisfaction
• Innovative concepts
• Constant Evaluations
• Improvisation
• Cost Effectiveness
As a team we have the clear vision and realize it too. As a statistical evaluation,
the team has more than 40,000 hours of expertise in providing real-time solutions
in the fields of Android Mobile Apps Development, Networking, Web
Designing, Secure Computing, Mobile Computing, Cloud Computing, Image
Processing And Implementation, Networking With OMNET++ Simulator,
client Server Technologies in Java,(J2EE\J2ME\EJB), ANDROID, DOTNET
(ASP.NET, VB.NET, C#.NET), MATLAB, NS2, SIMULINK, EMBEDDED,
POWER ELECTRONICS, VB & VC++, Oracle and operating system concepts
with LINUX.
OUR VISION:
61
SCREEN SHOTS
62
63
64
65
66
67
68
Software Environment
Java Technology
▪ Simple
▪ Architecture neutral
▪ Object oriented
▪ Portable
▪ Distributed
▪ High performance
▪ Interpreted
▪ Multithreaded
▪ Robust
▪ Dynamic
▪ Secure
69
With most programming languages, you either compile or interpret a program
so that you can run it on your computer. The Java programming language is unusual
in that a program is both compiled and interpreted. With the compiler, first you
translate a program into an intermediate language called Java byte codes —the
platform-independent codes interpreted by the interpreter on the Java platform. The
interpreter parses and runs each Java byte code instruction on the computer.
Compilation happens just once; interpretation occurs each time the program is
executed. The following figure illustrates how this works.
You can think of Java byte codes as the machine code instructions for the Java
Virtual Machine (Java VM). Every Java interpreter, whether it’s a development tool
or a Web browser that can run applets, is an implementation of the Java VM. Java
byte codes help make “write once, run anywhere” possible. You can compile your
program into byte codes on any platform that has a Java compiler. The byte codes
can then be run on any implementation of the Java VM. That means that as long as
a computer has a Java VM, the same program written in the Java programming
language can run on Windows 2000, a Solaris workstation, or on an iMac.
70
The Java Platform
A platform is the hardware or software environment in which a program
runs. We’ve already mentioned some of the most popular platforms like
Windows 2000, Linux, Solaris, and MacOS. Most platforms can be described
as a combination of the operating system and hardware. The Java platform
differs from most other platforms in that it’s a software-only platform that
runs on top of other hardware-based platforms.
71
Java Technology Do? Highlights what functionality some of the packages in
the Java API provide.
The following figure depicts a program that’s running on the Java
platform. As the figure shows, the Java API and the virtual machine insulate
the program from the hardware.
Native code is code that after you compile it, the compiled code runs
on a specific hardware platform. As a platform-independent environment, the
Java platform can be a bit slower than native code. However, smart compilers,
well-tuned interpreters, and just-in-time byte code compilers can bring
performance close to that of native code without threatening portability.
What Can Java Technology Do?
The most common types of programs written in the Java programming
language are applets and applications. If you’ve surfed the Web, you’re
probably already familiar with applets. An applet is a program that adheres to
certain conventions that allow it to run within a Java-enabled browser.
However, the Java programming language is not just for writing cute,
entertaining applets for the Web. The general-purpose, high-level Java
programming language is also a powerful software platform. Using the
generous API, you can write many types of programs.
72
An application is a standalone program that runs directly on the Java
platform. A special kind of application known as a server serves and supports
clients on a network. Examples of servers are Web servers, proxy servers,
mail servers, and print servers. Another specialized program is a servlet. A
servlet can almost be thought of as an applet that runs on the server side. Java
Servlets are a popular choice for building interactive web applications,
replacing the use of CGI scripts. Servlets are similar to applets in that they
are runtime extensions of applications. Instead of working in browsers,
though, servlets run within Java Web servers, configuring or tailoring the
server.
How does the API support all these kinds of programs? It does so with
packages of software components that provides a wide range of functionality.
Every full implementation of the Java platform gives you the following
features:
• The essentials: Objects, strings, threads, numbers, input and output,
data structures, system properties, date and time, and so on.
• Applets: The set of conventions used by applets.
• Networking: URLs, TCP (Transmission Control Protocol), UDP (User
Data gram Protocol) sockets, and IP (Internet Protocol) addresses.
• Internationalization: Help for writing programs that can be localized
for users worldwide. Programs can automatically adapt to specific
locales and be displayed in the appropriate language.
• Security: Both low level and high level, including electronic
signatures, public and private key management, access control, and
certificates.
73
• Software components: Known as JavaBeansTM, can plug into existing
component architectures.
• Object serialization: Allows lightweight persistence and
communication via Remote Method Invocation (RMI).
• Java Database Connectivity (JDBCTM): Provides uniform access to a
wide range of relational databases.
The Java platform also has APIs for 2D and 3D graphics, accessibility,
servers, collaboration, telephony, speech, animation, and more. The following
figure depicts what is included in the Java 2 SDK.
74
• Get started quickly: Although the Java programming language is a
powerful object-oriented language, it’s easy to learn, especially for
programmers already familiar with C or C++.
• Write less code: Comparisons of program metrics (class counts,
method counts, and so on) suggest that a program written in the Java
programming language can be four times smaller than the same
program in C++.
• Write better code: The Java programming language encourages good
coding practices, and its garbage collection helps you avoid memory
leaks. Its object orientation, its JavaBeans component architecture, and
its wide-ranging, easily extendible API let you reuse other people’s
tested code and introduce fewer bugs.
• Develop programs more quickly: Your development time may be as
much as twice as fast versus writing the same program in C++. Why?
You write fewer lines of code and it is a simpler programming language
than C++.
• Avoid platform dependencies with 100% Pure Java: You can keep
your program portable by avoiding the use of libraries written in other
languages. The 100% Pure JavaTM Product Certification Program has a
repository of historical process manuals, white papers, brochures, and
similar materials online.
• Write once, run anywhere: Because 100% Pure Java programs are
compiled into machine-independent byte codes, they run consistently
on any Java platform.
75
• Distribute software more easily: You can upgrade applets easily from
a central server. Applets take advantage of the feature of allowing new
classes to be loaded “on the fly,” without recompiling the entire
program.
ODBC
Microsoft Open Database Connectivity (ODBC) is a standard programming
interface for application developers and database systems providers. Before ODBC
became a de facto standard for Windows programs to interface with database
systems, programmers had to use proprietary languages for each database they
wanted to connect to. Now, ODBC has made the choice of the database system
almost irrelevant from a coding perspective, which is as it should be. Application
developers have much more important things to worry about than the syntax that is
needed to port their program from one database to another when business needs
suddenly change.
Through the ODBC Administrator in Control Panel, you can specify the
particular database that is associated with a data source that an ODBC application
program is written to use. Think of an ODBC data source as a door with a name on
it. Each door will lead you to a particular database. For example, the data source
named Sales Figures might be a SQL Server database, whereas the Accounts
Payable data source could refer to an Access database. The physical database
referred to by a data source can reside anywhere on the LAN.
The ODBC system files are not installed on your system by Windows 95.
Rather, they are installed when you setup a separate database application, such as
SQL Server Client or Visual Basic 4.0. When the ODBC icon is installed in Control
Panel, it uses a file called ODBCINST.DLL. It is also possible to administer your
76
ODBC data sources through a stand-alone program called ODBCADM.EXE. There
is a 16-bit and a 32-bit version of this program and each maintains a separate list of
ODBC data sources.
77
opportunity to write cleaner programs, which means you finish sooner. Meanwhile,
computers get faster every year.
JDBC
In an effort to set an independent database standard API for Java; Sun
Microsystems developed Java Database Connectivity, or JDBC. JDBC offers a
generic SQL database access mechanism that provides a consistent interface to a
variety of RDBMSs. This consistent interface is achieved through the use of “plug-
in” database connectivity modules, or drivers. If a database vendor wishes to have
JDBC support, he or she must provide the driver for each platform that the database
and Java run on.
To gain a wider acceptance of JDBC, Sun based JDBC’s framework on
ODBC. As you discovered earlier in this chapter, ODBC has widespread support on
a variety of platforms. Basing JDBC on ODBC will allow vendors to bring JDBC
drivers to market much faster than developing a completely new connectivity
solution.
JDBC was announced in March of 1996. It was released for a 90 day public
review that ended June 8, 1996. Because of user input, the final JDBC v1.0
specification was released soon after.
The remainder of this section will cover enough information about JDBC for you to
know what it is about and how to use it effectively. This is by no means a complete
overview of JDBC. That would fill an entire book.
78
JDBC Goals
Few software packages are designed without goals in mind. JDBC is one that,
because of its many goals, drove the development of the API. These goals, in
conjunction with early reviewer feedback, have finalized the JDBC class library into
a solid framework for building database applications in Java.
The goals that were set for JDBC are important. They will give you some insight
as to why certain classes and functionalities behave the way they do. The eight
design goals for JDBC are as follows:
2. SQL Conformance
SQL syntax varies as you move from database vendor to database vendor. In
an effort to support a wide variety of vendors, JDBC will allow any query
statement to be passed through it to the underlying database driver. This allows
the connectivity module to handle non-standard functionality in a manner that is
suitable for its users.
79
3. JDBC must be implemental on top of common database interfaces
The JDBC SQL API must “sit” on top of other common SQL level APIs.
This goal allows JDBC to use existing ODBC level drivers by the use of a
software interface. This interface would translate JDBC calls to ODBC and
vice versa.
4. Provide a Java interface that is consistent with the rest of the Java system
Because of Java’s acceptance in the user community thus far, the designers
feel that they should not stray from the current design of the core Java system.
5. Keep it simple
This goal probably appears in all software design goal listings. JDBC is no
exception. Sun felt that the design of JDBC should be very simple, allowing for
only one method of completing a task per mechanism. Allowing duplicate
functionality only serves to confuse the users of the API.
80
Finally we decided to proceed the implementation using Java Networking.
Simple Architecture-neutral
Object-oriented Portable
Distributed High-performance
Interpreted multithreaded
Robust Dynamic
Secure
Java is also unusual in that each Java program is both compiled and
interpreted. With a compile you translate a Java program into an
intermediate language called Java byte codes the platform-independent
code instruction is passed and run on the computer.
81
Java Program Interpreter
Compilers My Program
You can think of Java byte codes as the machine code instructions for
the Java Virtual Machine (Java VM). Every Java interpreter, whether it’s a
Java development tool or a Web browser that can run Java applets, is an
implementation of the Java VM. The Java VM can also be implemented in
hardware.
Java byte codes help make “write once, run anywhere” possible. You
can compile your Java program into byte codes on my platform that has a
Java compiler. The byte codes can then be run any implementation of the
Java VM. For example, the same Java program can run Windows NT,
Solaris, and Macintosh.
82
Networking
TCP/IP stack
83
TCP is a connection-oriented protocol; UDP (User Datagram
Protocol) is a connectionless protocol.
IP datagram’s
UDP
84
TCP
Internet addresses
In order to use a service, you must be able to find it. The Internet uses
an address scheme for machines so that they can be located. The address
is a 32 bit integer which gives the IP address. This encodes a network ID
and more addressing. The network ID falls into various classes according
to the size of the network address.
Network address
Class A uses 8 bits for the network address with 24 bits left over for
other addressing. Class B uses 16 bit network addressing. Class C uses 24
bit network addressing and class D uses all 32.
Subnet address
85
Host address
8 bits are finally used for host addresses within our subnet. This places
a limit of 256 machines that can be on the subnet.
Total address
Port addresses
86
Sockets
#include <sys/types.h>
#include <sys/socket.h>
int socket(int family, int type, int protocol);
JFree Chart
JFreeChart is a free 100% Java chart library that makes it easy for
developers to display professional quality charts in their applications.
JFreeChart's extensive feature set includes:
A flexible design that is easy to extend, and targets both server-side and
client-side applications;
87
Support for many output types, including Swing components, image
files (including PNG and JPEG), and vector graphics file formats (including
PDF, EPS and SVG);
1. Map Visualizations
Charts showing values that relate to geographical areas. Some examples
include: (a) population density in each state of the United States, (b) income
per capita for each country in Europe, (c) life expectancy in each country of
the world. The tasks in this project include:
Implement a new (to JFreeChart) feature for interactive time series charts --- to
display a separate control that shows a small version of ALL the time series data,
with a sliding "view" rectangle that allows you to select the subset of the time
series data to display in the main chart.
88
3. Dashboards
4. Property Editors
Sun Microsystems defines J2ME as "a highly optimized Java run-time environment
targeting a wide range of consumer products, including pagers, cellular phones,
89
screen-phones, digital set-top boxes and car navigation systems." Announced in June
1999 at the JavaOne Developer Conference, J2ME brings the cross-platform
functionality of the Java language to smaller devices, allowing mobile wireless
devices to share applications. With J2ME, Sun has adapted the Java platform for
consumer products that incorporate or are based on small computing devices.
90
J2ME uses configurations and profiles to customize the Java Runtime Environment
(JRE). As a complete JRE, J2ME is comprised of a configuration, which determines
the JVM used, and a profile, which defines the application by adding domain-
specific classes. The configuration defines the basic run-time environment as a set
of core classes and a specific JVM that run on specific types of devices. We'll discuss
configurations in detail in the The profile defines the application; specifically, it adds
domain-specific classes to the J2ME configuration to define certain uses for devices.
We'll cover profiles in depth in the The following graphic depicts the relationship
between the different virtual machines, configurations, and profiles. It also draws a
parallel with the J2SE API and its Java virtual machine. While the J2SE virtual
machine is generally referred to as a JVM, the J2ME virtual machines, KVM and
91
CVM, are subsets of JVM. Both KVM and CVM can be thought of as a kind of Java
virtual machine -- it's just that they are shrunken versions of the J2SE JVM and are
specific to J2ME.
Introduction In this section, we will go over some considerations you need to keep
in mind when developing applications for smaller devices. We'll take a look at the
way the compiler is invoked when using J2SE to compile J2ME applications.
Finally, we'll explore packaging and deployment and the role preverification plays
in this process.
Developing applications for small devices requires you to keep certain strategies in
mind during the design phase. It is best to strategically design an application for a
small device before you begin coding. Correcting the code because you failed to
consider all of the "gotchas" before developing the application can be a painful
process. Here are some design strategies to consider:
92
* Keep it simple. Remove unnecessary features, possibly making those features a
separate, secondary application.
* Smaller is better. This consideration should be a "no brainer" for all developers.
Smaller applications use less memory on the device and require shorter installation
times. Consider packaging your Java applications as compressed Java Archive (jar)
files.
* Minimize run-time memory use. To minimize the amount of memory used at run
time, use scalar types in place of object types. Also, do not depend on the garbage
collector. You should manage the memory efficiently yourself by setting object
references to null when you are finished with them. Another way to reduce run-time
memory is to use lazy instantiation, only allocating objects on an as-needed basis.
Other ways of reducing overall and peak memory use on small devices are to release
resources quickly, reuse objects, and avoid exceptions.
4.Configurations overview
93
The configuration defines the basic run-time environment as a set of core classes and
a specific JVM that run on specific types of devices. Currently, two configurations
exist for J2ME, though others may be defined in the future:
5.J2ME profiles
94
As we mentioned earlier in this tutorial, a profile defines the type of device
supported. The Mobile Information Device Profile (MIDP), for example, defines
classes for cellular phones. It adds domain-specific classes to the J2ME
configuration to define uses for similar devices. Two profiles have been defined for
J2ME and are built upon CLDC: KJava and MIDP. Both KJava and MIDP are
associated with CLDC and smaller devices. Profiles are built on top of
configurations. Because profiles are specific to the size of the device (amount of
memory) on which an application runs, certain profiles are associated with certain
configurations.
A skeleton profile upon which you can create your own profile, the Foundation
Profile, is available for CDC.
Profile 1: KJava
KJava is Sun's proprietary profile and contains the KJava API. The KJava profile is
built on top of the CLDC configuration. The KJava virtual machine, KVM, accepts
the same byte codes and class file format as the classic J2SE virtual machine. KJava
contains a Sun-specific API that runs on the Palm OS. The KJava API has a great
deal in common with the J2SE Abstract Windowing Toolkit (AWT). However,
because it is not a standard J2ME package, its main package is com.sun.kjava. We'll
learn more about the KJava API later in this tutorial when we develop some sample
applications.
Profile 2: MIDP
MIDP is geared toward mobile devices such as cellular phones and pagers. The
MIDP, like KJava, is built upon CLDC and provides a standard run-time
95
environment that allows new applications and services to be deployed dynamically
on end user devices. MIDP is a common, industry-standard profile for mobile
devices that is not dependent on a specific vendor. It is a complete and supported
foundation for mobile application
development. MIDP contains the following packages, the first three of which are
core CLDC packages, plus three MIDP-specific packages.
* java.lang
* java.io
* java.util
* javax.microedition.io
* javax.microedition.lcdui
* javax.microedition.midlet
* javax.microedition.rms
96
97