LightGCN: Simplifying and Powering Graph Convolution ...

1 lightgcn : Simplifying and Powering Graph ConvolutionNetwork for RecommendationXiangnan HeUniversity of Science and Technologyof DengUniversity of Science and Technologyof WangNational University of LiBeijing Kuaishou TechnologyCo., ZhangUniversity of Science and Technologyof Wang Hefei University of Convolution Network (GCN) has become new state-of-the-art for collaborative filtering. Nevertheless, the reasons ofits effectiveness for recommendation are not well work that adapts GCN to recommendation lacks thoroughablation analyses on GCN, which is originally designed for graphclassification tasks and equipped with many neural networkoperations.

2 However, we empirically find that the two mostcommon designs in GCNs feature transformation and nonlinearactivation contribute little to the performance of collaborativefiltering. Even worse, including them adds to the difficulty oftraining and degrades recommendation this work, we aim to simplify the design of GCN tomake it more concise and appropriate for recommendation. Wepropose a new model named lightgcn , including only the mostessential component in GCN neighborhood aggregation forcollaborative filtering.

3 Specifically, lightgcn learns user anditem embeddings by linearly propagating them on the user-iteminteraction Graph , and uses the weighted sum of the embeddingslearned at all layers as the final embedding. Such simple, linear,and neat model is much easier to implement and train, exhibitingsubstantial improvements (about relative improvement onaverage) over Neural Graph Collaborative Filtering (NGCF) astate-of-the-art GCN-based recommender model under exactlythe same experimental setting. Further analyses are providedtowards the rationality of the simple lightgcn from both analyticaland empirical perspectives.

4 Our implementations are available inboth TensorFlow1and PyTorch2. Meng Wang is the corresponding to make digital or hard copies of all or part of this work for personal orclassroom use is granted without fee provided that copies are not made or distributedfor profit or commercial advantage and that copies bear this notice and the full citationon the first page. Copyrights for components of this work owned by others than theauthor(s) must be honored. Abstracting with credit is permitted. To copy otherwise, orrepublish, to post on servers or to redistribute to lists, requires prior specific permissionand/or a fee.

5 Request permissions from 20, July 25 30, 2020, Virtual Event, China 2020 Copyright held by the owner/author(s). Publication rights licensed to ISBN 978-1-4503-8016-4/20/07.. $ CONCEPTS Information systems Recommender Filtering, Recommendation, Embedding Propagation, Graph Neural NetworkACM Reference Format:Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yongdong Zhang, and MengWang. 2020. lightgcn : Simplifying and Powering Graph ConvolutionNetwork for Recommendation. InProceedings of the 43rd International ACMSIGIR Conference on Research and Development in Information Retrieval(SIGIR 20), July 25 30, 2020, Virtual Event, , New York, NY, USA,10 pages.

6 INTRODUCTIONTo alleviate information overload on the web, recommender systemhas been widely deployed to perform personalized informationfiltering [7,45,46]. The core of recommender system is to predictwhether a user will interact with an item, , click, rate, purchase,among other forms of interactions. As such, collaborative filtering(CF), which focuses on exploiting the past user-item interactions toachieve the prediction, remains to be a fundamental task towardseffective personalized recommendation [10, 19, 28, 39].The most common paradigm for CF is to learn latent features( embedding) to represent a user and an item, and performprediction based on the embedding vectors [6,19].

7 Matrixfactorization is an early such model, which directly projects thesingle ID of a user to her embedding [26]. Later on, several researchfind that augmenting user ID with the her interaction history asthe input can improve the quality of embedding. For example,SVD++ [25] demonstrates the benefits of user interaction historyin predicting user numerical ratings, and Neural Attentive ItemSimilarity (NAIS) [18] differentiates the importance of items inthe interaction history and shows improvements in predictingitem ranking.

8 In view of user-item interaction Graph , theseimprovements can be seen as coming from using the subgraphstructure of a user more specifically, her one-hop neighbors toimprove the embedding deepen the use of subgraph structure with high-hopneighbors, Wang et al. [39] recently proposes NGCF and achievesstate-of-the-art performance for CF. It takes inspiration from theGraph Convolution Network (GCN) [14,23], following the samepropagation rule to refine embeddings: feature transformation,neighborhood aggregation, and nonlinear activation.

9 AlthoughNGCF has shown promising results, we argue that its designsare rather heavy and burdensome many operations are directlyinherited from GCN without justification. As a result, they are notnecessarily useful for the CF task. To be specific, GCN is originallyproposed for node classification on attributed Graph , where eachnode has rich attributes as input features; whereas in user-iteminteraction Graph for CF, each node (user or item) is only describedby a one-hot ID, which has no concrete semantics besides beingan identifier.

10 In such a case, given the ID embedding as the input,performing multiple layers of nonlinear feature transformation which is the key to the success of modern neural networks [16] will bring no benefits, but negatively increases the difficulty formodel validate our thoughts, we perform extensive ablation studieson NGCF. With rigorous controlled experiments (on the same datasplits and evaluation protocol), we draw the conclusion that thetwo operations inherited from GCN feature transformation andnonlinear activation has no contribution on NGCF s more surprising, removing them leads to significant accuracyimprovements.