Publications

Publications by categories in reversed chronological order. * indicates co-first author or co-corresponding author.

2024

  1. NeurIPS
    DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models
    Shangqian Gao, Chi-Heng Lin, Ting Hua, and 4 more authors
    In Advances in Neural Information Processing Systems (NeurIPS) (to appear), 2024
  2. EMNLP
    Unlocking Memorization in Large Language Models with Dynamic Soft Prompting
    Zhepeng Wang, Runxue Bao, Yawen Wu, and 6 more authors
    In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP) (to appear), 2024
  3. NAACL
    Adaptive Rank Selections for Low-Rank Approximation of Language Models
    Shangqian Gao, Ting Hua, Yen-Chang Hsu, and 2 more authors
    In Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), 2024
  4. CVPR
    Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch
    Xidong Wu*, Shangqian Gao*, Zeyu Zhang, and 5 more authors
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
  5. CVPR
    Device-Wise Federated Network Pruning
    Shangqian Gao*, Junyi Li*, Zeyu Zhang*, and 3 more authors
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
  6. CVPR
    Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment
    Alireza Ganjdanesh*, Shangqian Gao*, and Heng Huang
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
  7. CVPR
    BilevelPruning: Unified Dynamic and Static Channel Pruning for Convolutional Neural Networks
    Shangqian Gao, Yanfu Zhang, Feihu Huang, and 1 more author
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
  8. AAAI
    Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold
    Alireza Ganjdanesh*, Shangqian Gao*, and Heng Huang
    In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2024
  9. WACV
    Token Fusion: Bridging the Gap between Token Pruning and Token Merging
    Minchul Kim, Shangqian Gao, Yen-Chang Hsu, and 2 more authors
    In Winter Conference on Computer Vision (WACV), 2024

2023

  1. ICLR
    Learning to Jointly Share and Prune Weights for Grounding Based Vision and Language Models
    Shangqian Gao, Burak Uzkent, Yilin Shen, and 2 more authors
    In International Conference on Learning Representations (ICLR), 2023
  2. AAAI
    EffConv: Efficient Learning of Kernel Sizes for Convolution Layers of CNNs
    Alireza Ganjdanesh, Shangqian Gao, and Heng Huang
    In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2023
  3. ICCV
    Structural alignment for network pruning through partial regularization
    Shangqian Gao, Zeyu Zhang, Yanfu Zhang, and 2 more authors
    Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023
  4. TPAMI
    Gradient Descent Ascent for Minimax Problems on Riemannian Manifolds
    Feihu Huang, and Shangqian Gao
    IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2023
  5. EMNLP
    Dynamic Low-rank Estimation for Transformer-based Language Models
    Ting Hua*, Xiao Li*, Shangqian Gao, and 3 more authors
    In Proceedings of the Conference on Empirical Methods in Natural Language Processing Findings (EMNLP findings), 2023

2022

  1. ICLR
    Bregman Gradient Policy Optimization
    Feihu Huang*, Shangqian Gao*, and Heng Huang
    In International Conference on Learning Representations (ICLR), 2022
  2. ECCV
    Disentangled differentiable network pruning
    Shangqian Gao, Feihu Huang, Yanfu Zhang, and 1 more author
    In European Conference on Computer Vision (ECCV), 2022
  3. ECCV
    Interpretations steered network pruning via amortized inferred saliency maps
    Alireza Ganjdanesh*, Shangqian Gao*, and Heng Huang
    In European Conference on Computer Vision (ECCV), 2022
  4. ECCV
    Recover fair deep classification models via altering pre-trained structure
    Yanfu Zhang, Shangqian Gao, and Heng Huang
    In European Conference on Computer Vision (ECCV), 2022
  5. NN
    Riemannian gradient methods for stochastic composition problems
    Feihu Huang, and Shangqian Gao
    Neural Networks, 2022
  6. JMLR
    Accelerated zeroth-order and first-order momentum methods from mini to minimax optimization
    Feihu Huang, Shangqian Gao, Jian Pei, and 1 more author
    The Journal of Machine Learning Research (JMLR), 2022
  7. KDD
    Improving social network embedding via new second-order continuous graph neural networks
    Yanfu Zhang, Shangqian Gao, Jian Pei, and 1 more author
    In Proceedings of the 28th ACM SIGKDD conference on knowledge discovery and data mining (KDD), 2022
  8. NeurIPS
    Enhanced bilevel optimization via bregman distance
    Feihu Huang, Junyi Li, Shangqian Gao, and 1 more author
    Advances in Neural Information Processing Systems, 2022

2021

  1. CVPR
    Network pruning via performance maximization
    Shangqian Gao, Feihu Huang, Weidong Cai, and 1 more author
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021
  2. ICCV
    Exploration and estimation for model compression
    Yanfu Zhang*, Shangqian Gao*, and Heng Huang
    In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021
  3. ICCV
    Adversarial attack on deep cross-modal hamming retrieval
    Chao Li*, Shangqian Gao*, Cheng Deng, and 2 more authors
    In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021
  4. JMLR
    Black-box reductions for zeroth-order gradient algorithms to achieve lower query complexity
    Bin Gu, Xiyuan Wei, Shangqian Gao, and 3 more authors
    The Journal of Machine Learning Research (JMLR), 2021

2020

  1. CVPR
    Discrete model compression with resource constraint for deep neural networks
    Shangqian Gao, Feihu Huang, Jian Pei, and 1 more author
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020
  2. ICML
    Momentum-based policy gradient methods
    Feihu Huang, Shangqian Gao, Jian Pei, and 1 more author
    In International conference on machine learning (ICML), 2020

2019

  1. CVPR
    Cross Domain Model Compression by Structurally Weight Sharing
    Shangqian Gao, Cheng Deng, and Heng Huang
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Jun 2019
  2. NeurIPS
    Cross-modal learning with adversarial samples
    Chao Li, Shangqian Gao, Cheng Deng, and 2 more authors
    Advances in neural information processing systems (NeurIPS), Jun 2019
  3. IJCAI
    Zeroth-order stochastic alternating direction method of multipliers for nonconvex nonsmooth optimization
    Feihu Huang, Shangqian Gao, Songcan Chen, and 1 more author
    International Joint Conferences on Artificial Intelligence (IJCAI), Jun 2019

2018

  1. AAAI
    Action prediction from videos via memorizing hard-to-predict samples
    Shangqian Gao*, Yu Kong*, Bin Sun, and 1 more author
    In Proceedings of the AAAI conference on artificial intelligence (AAAI), Jun 2018

2017

  1. AAAI
    Video recovery via learning variation and consistency of images
    Zhouyuan Huo, Shangqian Gao, Weidong Cai, and 1 more author
    In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), Jun 2017

2016

  1. TMM
    Discriminative multi-instance multitask learning for 3D action recognition
    Yanhua Yang, Cheng Deng, Shangqian Gao, and 3 more authors
    IEEE Transactions on Multimedia, Jun 2016