IEEE COMMUNICATIONS SURVEYS & TUTORIALS 1 Deep …

1 IEEE COMMUNICATIONS SURVEYS & TUTORIALS 1. Deep Learning in Mobile and Wireless Networking: A Survey Chaoyun Zhang, Paul Patras, and Hamed Haddadi Abstract The rapid uptake of mobile devices and the rising The growing diversity and complexity of mobile network popularity of mobile applications and services pose unprece- architectures has made monitoring and managing the multi- dented demands on mobile and wireless networking infrastruc- tude of network elements intractable. Therefore, embedding ture. Upcoming 5G systems are evolving to support exploding mobile traffic volumes, real-time extraction of fine-grained an- versatile machine intelligence into future mobile networks is [ ] 30 Jan 2019.

2 Alytics, and agile management of network resources, so as to drawing unparalleled research interest [6], [7]. This trend is maximize user experience. Fulfilling these tasks is challenging, reflected in machine learning (ML) based solutions to prob- as mobile environments are increasingly complex, heterogeneous, lems ranging from radio access technology (RAT) selection [8]. and evolving. One potential solution is to resort to advanced to malware detection [9], as well as the development of machine learning techniques, in order to help manage the rise in data volumes and algorithm-driven applications. The recent networked systems that support machine learning practices success of deep learning underpins new and powerful tools that ( [10], [11]).

3 ML enables systematic mining of valuable tackle problems in this space. information from traffic data and automatically uncover corre- In this paper we bridge the gap between deep learning lations that would otherwise have been too complex to extract and mobile and wireless networking research, by presenting a by human experts [12]. As the flagship of machine learning, comprehensive survey of the crossovers between the two areas. We first briefly introduce essential background and state-of-the- deep learning has achieved remarkable performance in areas art in deep learning techniques with potential applications to such as computer vision [13] and natural language processing networking.

4 We then discuss several techniques and platforms (NLP) [14]. Networking researchers are also beginning to that facilitate the efficient deployment of deep learning onto recognize the power and importance of deep learning, and are mobile systems. Subsequently, we provide an encyclopedic review exploring its potential to solve problems specific to the mobile of mobile and wireless networking research based on deep learning, which we categorize by different domains. Drawing networking domain [15], [16]. from our experience, we discuss how to tailor deep learning to Embedding deep learning into the 5G mobile and wireless mobile environments.

5 We complete this survey by pinpointing networks is well justified. In particular, data generated by current challenges and open future directions for research. mobile environments are increasingly heterogeneous, as these Index Terms Deep Learning, Machine Learning, Mobile Net- are usually collected from various sources, have different working, Wireless Networking, Mobile Big Data, 5G Systems, formats, and exhibit complex correlations [17]. As a conse- Network Management. quence, a range of specific problems become too difficult or impractical for traditional machine learning tools ( , shallow I. I NTRODUCTION neural networks). This is because (i) their performance does NTERNET connected mobile devices are penetrating every not improve if provided with more data [18] and (ii) they I aspect of individuals' life, work, and entertainment.

6 The increasing number of smartphones and the emergence of ever- cannot handle highly dimensional state/action spaces in control problems [19]. In contrast, big data fuels the performance more diverse applications trigger a surge in mobile data traffic. of deep learning, as it eliminates domain expertise and in- Indeed, the latest industry forecasts indicate that the annual stead employs hierarchical feature extraction. In essence this worldwide IP traffic consumption will reach zettabytes means information can be distilled efficiently and increasingly (1015 MB) by 2021, with smartphone traffic exceeding PC abstract correlations can be obtained from the data, while traffic by the same year [1].

7 Given the shift in user preference reducing the pre-processing effort. Graphics Processing Unit towards wireless connectivity, current mobile infrastructure (GPU)-based parallel computing further enables deep learn- faces great capacity demands. In response to this increasing de- ing to make inferences within milliseconds. This facilitates mand, early efforts propose to agilely provision resources [2] network analysis and management with high accuracy and and tackle mobility management distributively [3]. In the in a timely manner, overcoming the run-time limitations of long run, however, Internet Service Providers (ISPs) must de- traditional mathematical techniques ( convex optimization, velop intelligent heterogeneous architectures and tools that can game theory, meta heuristics).

8 Spawn the 5th generation of mobile systems (5G) and gradually Despite growing interest in deep learning in the mobile meet more stringent end-user application requirements [4], [5]. networking domain, existing contributions are scattered across different research areas and a comprehensive survey is lacking. C. Zhang and P. Patras are with the Institute for Computing Systems Archi- This article fills this gap between deep learning and mobile tecture (ICSA), School of Informatics, University of Edinburgh, Edinburgh, and wireless networking, by presenting an up-to-date survey of UK. Emails: { , H. Haddadi is with the Dyson School of Design Engineering at Imperial research that lies at the intersection between these two fields.}

9 College London. Email: Beyond reviewing the most relevant literature, we discuss IEEE COMMUNICATIONS SURVEYS & TUTORIALS 2. the key pros and cons of various deep learning architec- TABLE I: List of abbreviations in alphabetical order. tures, and outline deep learning model selection strategies, Acronym Explanation in view of solving mobile networking problems. We further 5G 5th Generation mobile networks investigate methods that tailor deep learning to individual A3C Asynchronous Advantage Actor-Critic mobile networking tasks, to achieve the best performance in AdaNet Adaptive learning of neural Network AE Auto-Encoder complex environments.

10 We wrap up this paper by pinpointing AI Artificial Intelligence future research directions and important problems that remain AMP Approximate Message Passing unsolved and are worth pursing with deep neural networks. ANN Artificial Neural Network Our ultimate goal is to provide a definite guide for networking ASR Automatic Speech Recognition BSC Base Station Controller researchers and practitioners, who intend to employ deep BP Back-Propagation learning to solve problems of interest. CDR Call Detail Record Survey Organization: We structure this article in a top-down CNN or ConvNet Convolutional Neural Network ConvLSTM Convolutional Long Short-Term Memory manner, as shown in Figure 1.