Network Embedding with Deep Metric Learning

Xiaotao CHENG
Lixin JI
Ruiyang HUANG
Ruifei CUI

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E102-D    No.3    pp.568-578
Publication Date: 2019/03/01
Publicized: 2018/12/26
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2018EDP7233
Type of Manuscript: PAPER
Category: Artificial Intelligence, Data Mining
Keyword: 
deep metric learning,  network representation learning,  likelihood label,  anchor initialization,  semi-supervised learning,  

Full Text: PDF(1.7MB)>>
Buy this Article


Summary: 
Network embedding has attracted an increasing amount of attention in recent years due to its wide-ranging applications in graph mining tasks such as vertex classification, community detection, and network visualization. Network embedding is an important method to learn low-dimensional representations of vertices in networks, aiming to capture and preserve the network structure. Almost all the existing network embedding methods adopt the so-called Skip-gram model in Word2vec. However, as a bag-of-words model, the skip-gram model mainly utilized the local structure information. The lack of information metrics for vertices in global network leads to the mix of vertices with different labels in the new embedding space. To solve this problem, in this paper we propose a Network Representation Learning method with Deep Metric Learning, namely DML-NRL. By setting the initialized anchor vertices and adding the similarity measure in the training progress, the distance information between different labels of vertices in the network is integrated into the vertex representation, which improves the accuracy of network embedding algorithm effectively. We compare our method with baselines by applying them to the tasks of multi-label classification and data visualization of vertices. The experimental results show that our method outperforms the baselines in all three datasets, and the method has proved to be effective and robust.

open access publishing via