GNN-RLパイプライン

GNN-RL pipeline - GNN-RL Pipeline Docs » GNN-RL pipeline GNN-RL pipeline Overview GNN-RL pipleline is a toolkit to help users extract topology information through reinforcement learning task (e.g., topology-aware neural network compression and job scheduling). GNN-RL contains two major part -- graph neural network (GNN) and reinforcement learning (RL). It requires your research object is a graph or been modeled as a graph, the reinforcement learning take the graph as environment states and produces actions by using a GNN-based policy network. We have successfully tested the GNN-RL on model compression task, where we model a deep neural network (DNN) as a graph, and search compression policy using reinforcement learning. GNN-RL on Model Compression We have tested our GNN-RL on fine-grained pruning and structured pruning on CNNs. We first model the trage DNN as a computational graph, and GNN-RL to search pruning policy directly through DNN's topology. In the reinforcement learning task definition, we use the computational graph as environment states, the action spaces are defined as pruning ratios, and the rewards are the compressed DNN's accuracy. Once the compressed model size satisfied the resource requirements, GNN-RL end the search episode. The network pruning task can be visualize as the diagram below. Apply GNN-RL Pipeline on Other Discipline The GNN-RL is not limited to model compression, it aims to extract topology information through reinforcement learning task. We provide APIs to help you define your customized job! It only requires your research object is a graph or been modeled as a graph, you can define your customized RL task (e.g., action space, environment states, rewards). Currently, our collegues are testing GNN-RL on job scheduling taks. Page Index Here is the index for you to quick locate the GNN-RL: Installation Introduction by example Model DNN as graph GNN-RL in model compression Related Papers If you find our useful or use our work in your job, please cite the paper: [1] Sixing Yu, Phuong Nguyen, Waqwoya Abebe, Ali Anwar, Ali Jannesari: SPATL: Salient Parameter Aggregation and Transfer Learning for Heterogeneous Federated Learning. In Proc. of the International Conference for High Performance Computing, Networking, Storage, and Analysis (SC), Dallas, TX, USA, pages 1–13, November 2022. [2] Sixing Yu, Arya Mazaheri, Ali Jannesari: Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learning. In Proc. of the 39th International Conference on Machine Learning (ICML), Baltimore, Maryland, USA, p. 25656–25667, July 2022. (Long presentation acceptance rate: 2% [3] Sixing Yu, Arya Mazaheri, Ali Jannesari: Auto Graph Encoder-Decoder for Neural Network Pruning. In Proc. of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 6362-6372, IEEE, October 2021. @InProceedings {yu2021spatl, title = {SPATL: Salient Parameter Aggregation and Transfer Learning for Heterogeneous Federated Learning}, author = {S. Yu and P. Nguyen and W. Abebe and W. Qian and A. Anwar and A. Jannesari}, booktitle = {2022 SC22: International Conference for High Performance Computing, Networking, Storage and Analysis (SC) (SC)}, year = {2022}, issn = {2167-4337}, pages = {495-508}, keywords = {federated learning;heterogeneous system;machine learning;ml;fl}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, month = {nov} } @InProceedings{yu2022gnnrl, title = {Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learning}, author = {Yu, Sixing and Mazaheri, Arya and Jannesari, Ali}, booktitle = {Proceedings of the 39th International Conference on Machine Learning}, pages = {25656--25667}, year = {2022}, volume = {162}, series = {Proceedings of Machine Learning Research}, month = {17--23 Jul}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v162/yu22e/yu22e.pdf}, url = {https://proceedings.mlr.press/v162/yu22e.html}, } @InProceedings{yu2021agmc, author = {Yu, Sixing and Mazaheri, Arya and Jannesari, Ali}, title = {Auto Graph Encoder-Decoder for Neural Network Pruning}, booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)}, month = {October}, year = {2021}, pages = {6362-6372} }