Junke Wang 「王君可」

I'm a third-year Ph.D. student in school of computer science at Fudan University, supervised by Prof. Zuxuan Wu and Prof. Yu-Gang Jiang. Before that, I received my Bachelor's degree of Computer Science at Fudan University in 2021.

My research interests lie in computer vision and deep learning, with the emphasis on video understanding and generation, e.g., video-language pretraining, video object tracking, and video content forensics.

Email: wangjk21 [at] m.fudan.edu.cn

Google Scholar   /   CV   /   Github     

profile photo

(* denotes equal contribution)
Publication
OmniVid: A Generative Framework for Universal Video Understanding.
Junke Wang, Dongdong Chen, Chong Luo, Bo He, Lu Yuan, Zuxuan Wu, Yu-Gang Jiang.
CVPR, 2024.
Look Before You Match: Instance Understanding Matters in Video Object Segmentation.
Junke Wang, Dongdong Chen, Zuxuan Wu, Chong Luo, Chuanxin Tang, Xiyang Dai, Yucheng Zhao,
Yujia Xie, Lu Yuan, Yu-Gang Jiang.
CVPR, 2023.
OmniVL: One Foundation Model for Image-Language and Video-Language Tasks.
Junke Wang, Dongdong Chen, Zuxuan Wu, Chong Luo, Luowei Zhou, Yucheng Zhao,
Yujia Xie, Ce Liu, Yu-Gang Jiang, Lu Yuan.
NeurIPS, 2022.
Efficient Video Transformers with Spatial-Temporal Token Selection.
Junke Wang*, Xitong Yang*, Hengduo Li, Zuxuan Wu, Yu-Gang Jiang.
ECCV, 2022.
M2TR: Multi-modal Multi-scale Transformer for Deepfake Detection.
Junke Wang, Zuxuan Wu, Wenhao Ouyang, Xintong Han, Jingjing Chen, Ser-Nam Lim, Yu-Gang Jiang
ICMR, 2022.
ObjectFormer for Image Manipulation Detection and Localization.
Junke Wang, Zuxuan Wu, Jingjing Chen, Xintong Han, Abhinav Shrivastava, Yu-Gang Jiang, Ser-Nam Li.
CVPR, 2022.
FT-TDR: Frequency-guided Transformer and Top-Down Refinement Network for Blind Face Inpainting.
Junke Wang, Shaoxiang Chen, Zuxuan Wu, Yu-Gang Jiang.
TMM, 2022.
Depth Guided Adaptive Meta-Fusion Network for Few-shot Video Recognition.
Yuqian Fu, Li Zhang, Junke Wang, Yanwei Fu, Yu-Gang Jiang.
ACM MM, 2020.

Preprints
MouSi: Poly-Visual-Expert Vision-Language Models.
Xiaoran Fan*, Tao Ji*, Changhao Jiang*, Shuo Li*, Senjie Jin*, Sirui Song, Junke Wang, etc.
Arxiv, 2024.
OmniTracker: Unifying Object Tracking by Tracking-with-Detection.
Junke Wang, Dongdong Chen, Zuxuan Wu, Chong Luo, Xiyang Dai, Lu Yuan, Yu-Gang Jiang.
Arxiv, 2023.
Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detection.
Junke Wang, Zhenxin Li, Chao Zhang, Jingjing Chen, Zuxuan Wu, Larry S. Davis, Yu-Gang Jiang.
Arxiv, 2022.

Projects
To See is to Believe: Prompting GPT-4V for Better Visual Instruction Tuning. [Dataset] [Project page]
Junke Wang*, Lingchen Meng*, Zejia Weng, Bo He, Zuxuan Wu, Yu-Gang Jiang.

  • We introduce a fine-grained visual instruction dataset, LVIS-INSTRUCT4V, which contains 220K visually aligned and context-aware instructions produced by prompting the powerful GPT-4V with images from LVIS.

    		•
    ChatVideo: A Tracklet-centric Multimodal and Versatile Video Understanding System. [Project page]
    Junke Wang, Dongdong Chen, Chong Luo, Xiyang Dai, Lu Yuan, Zuxuan Wu, Yu-Gang Jiang.

  • We present our vision for multimodal and versatile video understanding and propose a prototype system, ChatVideo.


    • Academic Services

    Conference Reviewer for ICLR 2024, NeurIPS 2023, CVPR 2022-2023, ICCV 2023, ECCV 2022, etal.

    Journal Reviewer for TPAMI, TIP, IJCV, TMM, etal.


    Awards

    Intel Scholarship (5 graudates in Fudan University). 2023.

    National Scholarship (Top 1%). 2022.

    Outstanding graduates in Shanghai (undergrads). 2021.

    First-class Scholarship (Top 5%). 2019, 2021.

    Uniqlo Scholarship (33 undergrads from China). 2019.



    Updated at Jan. 2024.