Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

About me

Publications

Research publications in multimodal AI, computer vision, and model evaluation.

Posts

The 10th AI City Challenge concludes at ECCV 2026

less than 1 minute read

Published:

The ECCV 2026 workshop marked ten editions of AI City Challenge, connecting six benchmark tracks with research in visual understanding, reasoning, and forecasting.

The 10th AI City Challenge at ECCV 2026

less than 1 minute read

Published:

The 10th AI City Challenge was accepted as an ECCV 2026 workshop, with six tracks spanning perception, reasoning, retrieval, forecasting, and geographic generalization.

Video analytics AI agents at GTC 2026

less than 1 minute read

Published:

I contributed video embedding search models, evaluation data, and deployment integration to NVIDIA’s GTC 2026 Video Search and Summarization demonstration.

Releasing Physical AI Smart Spaces at GTC 2025

less than 1 minute read

Published:

Physical AI Smart Spaces provides synchronized multi-camera data and evaluation resources for 3D perception, supporting the 2024 and 2025 AI City Challenge.

Releasing the NVIDIA multi-camera tracking workflow

less than 1 minute read

Published:

The NVIDIA multi-camera tracking workflow connects synthetic data generation, model training, and video analytics to help developers track people and activity across large spaces.

Amazon One: Palm recognition for payment and access

less than 1 minute read

Published:

My work on Amazon One included biometric identity verification and adaptive identity updates, with two U.S. patent applications supporting the palm recognition service.

portfolio

publications

Melody Extraction from Polyphonic Audio of Western Opera: A Method Based on Detection of the Singer’s Formant

Published in 2014 International Society for Music Information Retrieval Conference, 2014

This method extracts melodies from polyphonic Western opera recordings using the singer’s formant, a spectral feature near 3 kHz.

Recommended citation: Zheng Tang and Dawn AA Black. "Melody Extraction from Polyphonic Audio of Western Opera: A Method Based on Detection of the Singer’s Formant". 2014 International Society for Music Information Retrieval Conference (ISMIR 2014). pp. 161-166. 2014. http://www.terasoft.com.tw/conf/ismir2014/proceedings/T029_329_Paper.pdf

Multiple-Kernel Adaptive Segmentation and Tracking (MAST) for Robust Object Tracking

Published in 2016 IEEE International Conference on Acoustics, Speech and Signal Processing, 2016

MAST improves object segmentation and tracking when foreground objects resemble the background or move through shadows.

Recommended citation: Zheng Tang, Jenq-Neng Hwang, Yen-Shuo Lin and Jen-Hui Chuang. "Multiple-Kernel Adaptive Segmentation and Tracking (MAST) for Robust Object Tracking". Proceedings of 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2016). pp. 3064-3068. 2016. https://ieeexplore.ieee.org/document/7471849

Camera Self-Calibration from Tracking of Moving Persons

Published in 2016 International Conference on Pattern Recognition, 2016

This method estimates static-camera parameters from the tracked head and foot positions of walking people.

Recommended citation: Zheng Tang, Yen-Shuo Lin, Kuan-Hui Lee, Jenq-Neng Hwang, Jen-Hui Chuang and Zhijun Fang. "Camera Self-Calibration from Tracking of Moving Persons". Proceedings of 2016 International Conference on Pattern Recognition (ICPR 2016). pp. 260-265. 2016. https://ieeexplore.ieee.org/document/7899644

Online-Learning-Based Human Tracking Across Non-Overlapping Cameras

Published in IEEE Transactions on Circuits and Systems for Video Technology, 2017

This framework tracks people within and across non-overlapping cameras without supervised camera-link training.

Recommended citation: Young-Gun Lee, Zheng Tang and Jenq-Neng Hwang. "Online-Learning-Based Human Tracking Across Non-Overlapping Cameras". IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT). vol. 28, no. 10, pp. 2870-2883. 2018. https://ieeexplore.ieee.org/document/7932896

Multiple-Kernel Based Vehicle Tracking Using 3D Deformable Model and Camera Self-Calibration

Published in 2017 IEEE Smart World Congress - 1st AI City Challenge Workshop, 2017

This vehicle-tracking system combines 3D deformable vehicle models, constrained multiple-kernel tracking, and camera self-calibration.

Recommended citation: Zheng Tang, Gaoang Wang, Tao Liu, Young-Gun Lee, Adwin Jahn, Xu Liu, Xiaodong He and Jenq-Neng Hwang. "Multiple-Kernel Based Vehicle Tracking Using 3D Deformable Model and Camera Self-Calibration". arXiv:1708.06831. 2017. https://arxiv.org/abs/1708.06831

Inter-Camera Tracking Based on Fully Unsupervised Online Learning

Published in 2017 IEEE International Conference on Image Processing, 2017

This method associates people across non-overlapping cameras through fully unsupervised online learning.

Recommended citation: Young-Gun Lee, Zheng Tang, Jenq-Neng Hwang and Zhijun Fang. "Inter-Camera Tracking Based on Fully Unsupervised Online Learning". Proceedings of 2017 IEEE International Conference on Image Processing (ICIP 2017). pp. 2607-2611. 2017. https://ieeexplore.ieee.org/document/8296754

Adaptive Ground Plane Estimation for Moving Camera-Based 3D Object Tracking

Published in 2017 International Workshop on Multimedia Signal Processing, 2017

This method estimates the ground plane for 3D object tracking from a moving monocular camera.

Recommended citation: Tao Liu, Yong Liu, Zheng Tang and Jenq-Neng Hwang. "Adaptive Ground Plane Estimation for Moving Camera-Based 3D Object Tracking". Proceedings of 2017 International Workshop on Multimedia Signal Processing (MMSP 2017). 2017. https://ieeexplore.ieee.org/document/8122256

Single-Camera and Inter-Camera Vehicle Tracking and 3D Speed Estimation Based on Fusion of Visual and Semantic Features

Published in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition - 2nd AI City Challenge Workshop, 2018

This work combines visual and semantic features for vehicle tracking within and across non-overlapping cameras.

Recommended citation: Zheng Tang, Gaoang Wang, Hao Xiao, Aotian Zheng and Jenq-Neng Hwang. "Single-Camera and Inter-Camera Vehicle Tracking and 3D Speed Estimation Based on Fusion of Visual and Semantic Features". Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2018). pp. 108-115. 2018. https://openaccess.thecvf.com/content_cvpr_2018_workshops/w3/html/Tang_Single-Camera_and_Inter-Camera_CVPR_2018_paper.html

Joint Multi-View People Tracking and Pose Estimation for 3D Scene Reconstruction

Published in 2018 IEEE International Conference on Multimedia and Expo, 2018

This framework jointly tracks people and estimates their 3D poses across overlapping camera views.

Recommended citation: Zheng Tang, Renshu Gu and Jenq-Neng Hwang. "Joint Multi-View People Tracking and Pose Estimation for 3D Scene Reconstruction". 2018 IEEE International Conference on Multimedia and Expo (ICME 2018). 2018. https://ieeexplore.ieee.org/document/8486576

Self-Calibration of Traffic Surveillance Cameras Based on Moving Vehicle Appearance and 3-D Vehicle Modeling

Published in 2018 IEEE International Conference on Image Processing, 2018

This method calibrates traffic-surveillance cameras using vehicle appearance and 3D vehicle models.

Recommended citation: Na Wang, Haiqing Du, Yong Liu, Zheng Tang and Jenq-Neng Hwang. "Self-Calibration of Traffic Surveillance Cameras Based on Moving Vehicle Appearance and 3-D Vehicle Modeling". Proceedings of 2018 IEEE International Conference on Image Processing (ICIP 2018). pp. 3064-3068. 2018. https://ieeexplore.ieee.org/document/8451478

ESTHER: Joint Camera Self-Calibration and Automatic Radial Distortion Correction from Tracking of Walking Humans

Published in IEEE Access, 2019

ESTHER jointly estimates camera parameters and radial distortion from tracked walking people.

Recommended citation: Zheng Tang, Yen-Shuo Lin, Kuan-Hui Lee, Jenq-Neng Hwang and Jen-Hui Chuang. "ESTHER: Joint Camera Self-Calibration and Automatic Radial Distortion Correction from Tracking of Walking Humans". IEEE Access. vol. 7, pp. 10754-10766. 2019. https://ieeexplore.ieee.org/document/8605504

The 2019 AI City Challenge

Published in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition - 3rd AI City Challenge Workshop, 2019

The third AI City Challenge evaluated city-scale vehicle tracking, vehicle re-identification, and traffic anomaly detection using real traffic-camera data.

Recommended citation: Milind Naphade, Zheng Tang, Ming-Ching Chang, David C Anastasiu, Anuj Sharma, Rama Chellappa, Shuo Wang, Pranamesh Chakraborty, Tingting Huang, Jenq-Neng Hwang and Siwei Lyu. "The 2019 AI City Challenge". Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2019). pp. 452-460. 2019. https://openaccess.thecvf.com/content_CVPRW_2019/html/AI_City/Naphade_The_2019_AI_City_Challenge_CVPRW_2019_paper.html

CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification

Published in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019

CityFlow is a city-scale benchmark for multi-camera vehicle tracking and re-identification.

Recommended citation: Zheng Tang, Milind Naphade, Ming-Yu Liu, Xiaodong Yang, Stan Birchfield, Shuo Wang, Ratnesh Kumar, David Anastasiu and Jenq-Neng Hwang. "CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification". Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2019). pp. 8797-8806. 2019. https://arxiv.org/abs/1903.09254

PAMTRI: Pose-Aware Multi-Task Learning for Vehicle Re-Identification Using Highly Randomized Synthetic Data

Published in 2019 International Conference on Computer Vision, 2019

PAMTRI combines vehicle re-identification with pose estimation and attribute learning.

Recommended citation: Zheng Tang, Milind Naphade, Stan Birchfield, Jonathan Tremblay, William Hodge, Ratnesh Kumar, Shuo Wang and Xiaodong Yang. "PAMTRI: Pose-Aware Multi-Task Learning for Vehicle Re-Identification Using Highly Randomized Synthetic Data". Proceedings of 2019 International Conference on Computer Vision (ICCV 2019). pp. 211-220. 2019. https://arxiv.org/abs/2005.00673

The 4th AI City Challenge

Published in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition - 4th AI City Challenge Workshop, 2020

The fourth AI City Challenge brought together 315 teams from 37 countries to study vehicle counting, vehicle re-identification, multi-camera vehicle tracking, and traffic anomaly detection.

Recommended citation: Milind Naphade, Shuo Wang, David Anastasiu, Zheng Tang, Ming-Ching Chang, Xiaodong Yang, Liang Zheng, Anuj Sharma, Rama Chellappa and Pranamesh Chakraborty. "The 4th AI City Challenge". Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2020). 2020. https://arxiv.org/abs/2004.14619

The 5th AI City Challenge

Published in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition - 5th AI City Challenge Workshop, 2021

The fifth AI City Challenge evaluated vehicle counting, re-identification, multi-camera tracking, anomaly detection, and vehicle retrieval from natural-language descriptions.

Recommended citation: Milind Naphade, Shuo Wang, David C. Anastasiu, Zheng Tang, Ming-Ching Chang, Xiaodong Yang, Yue Yao, Liang Zheng, Pranamesh Chakraborty, Christian E. Lopez, Anuj Sharma, Qi Feng, Vitaly Ablavsky and Stan Sclaroff. "The 5th AI City Challenge". Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2021). 2021. https://arxiv.org/abs/2104.12233

The 6th AI City Challenge

Published in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition - 6th AI City Challenge Workshop, 2022

The sixth AI City Challenge covered transportation and retail through four tracks: multi-camera vehicle tracking, natural-language vehicle retrieval, driver-action recognition, and single-camera automated checkout.

Recommended citation: Milind Naphade, Shuo Wang, David C. Anastasiu, Zheng Tang, Ming-Ching Chang, Yue Yao, Liang Zheng, Mohammed Shaiqur Rahman, Archana Venkatachalapathy, Anuj Sharma, Qi Feng, Vitaly Ablavsky, Stan Sclaroff, Pranamesh Chakraborty, Alice Li, Shangru Li and Rama Chellappa. "The 6th AI City Challenge". Proceedings of 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2022). 2022. https://arxiv.org/abs/2204.10380

The 7th AI City Challenge

Published in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition - 7th AI City Challenge Workshop, 2023

The seventh AI City Challenge introduced multi-camera people tracking and motorcycle helmet-rule violation detection alongside vehicle retrieval, driver-action recognition, and automated checkout.

Recommended citation: Milind Naphade, Shuo Wang, David C. Anastasiu, Zheng Tang, Ming-Ching Chang, Yue Yao, Liang Zheng, Mohammed Shaiqur Rahman, Meenakshi S. Arya, Anuj Sharma, Qi Feng, Vitaly Ablavsky, Stan Sclaroff, Pranamesh Chakraborty, Sanjita Prajapati, Alice Li, Shangru Li, Krishna Kunadharaju, Shenxin Jiang and Rama Chellappa. "The 7th AI City Challenge". Proceedings of 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2023). 2023. https://arxiv.org/abs/2304.07500

The Staged Knowledge Distillation in Video Classification: Harmonizing Student Progress by a Complementary Weakly Supervised Framework

Published in IEEE Transactions on Circuits and Systems for Video Technology, 2023

This framework studies knowledge distillation for video classification under limited supervision.

Recommended citation: Chao Wang and Zheng Tang. "The Staged Knowledge Distillation in Video Classification: Harmonizing Student Progress by a Complementary Weakly Supervised Framework". IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT). 2024. https://ieeexplore.ieee.org/document/10182291

The 8th AI City Challenge

Published in 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition - 8th AI City Challenge Workshop, 2024

The eighth AI City Challenge attracted 726 teams from 47 countries and regions across five tracks: multi-camera people tracking, traffic-safety video captioning, driver-action recognition, fisheye-camera analytics, and motorcycle helmet-rule violation detection.

Recommended citation: Shuo Wang, David C. Anastasiu, Zheng Tang, Ming-Ching Chang, Yue Yao, Liang Zheng, Mohammed Shaiqur Rahman, Meenakshi S. Arya, Anuj Sharma, Pranamesh Chakraborty, Sanjita Prajapati, Quan Kong, Norimasa Kobori, Munkhjargal Gochoo, Munkh-Erdene Otgonbold, Ganzorig Batnasan, Fady Alnajjar, Ping-Yang Chen, Jun-Wei Hsieh, Xunlei Wu, Sameer Satish Pusegaonkar, Yizhou Wang, Sujit Biswas and Rama Chellappa. "The 8th AI City Challenge". Proceedings of 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2024). 2024. https://arxiv.org/abs/2404.09432

Radiance Field Learners As UAV First-Person Viewers

Published in 2024 European Conference on Computer Vision, 2024

FPV-NeRF addresses novel-view synthesis from UAV video, where limited viewpoints and changing scene scales challenge conventional radiance fields.

Recommended citation: Liqi Yan, Qifan Wang, Junhan Zhao, Qiang Guan, Zheng Tang, Jianhui Zhang and Dongfang Liu. "Radiance Field Learners As UAV First-Person Viewers". Proceedings of 2024 European Conference on Computer Vision (ECCV 2024). 2024. https://arxiv.org/abs/2408.05533

The 9th AI City Challenge

Published in 2025 IEEE/CVF International Conference on Computer Vision - 9th AI City Challenge Workshop, 2025

The ninth AI City Challenge evaluated multi-class 3D multi-camera tracking, traffic-safety video question answering, spatial reasoning in warehouse environments, and efficient fisheye road-object detection.

Recommended citation: Zheng Tang, Shuo Wang, David C. Anastasiu, Ming-Ching Chang, Anuj Sharma, Quan Kong, Norimasa Kobori, Munkhjargal Gochoo, Ganzorig Batnasan, Munkh-Erdene Otgonbold, Fady Alnajjar, Jun-Wei Hsieh, Tomasz Kornuta, Xiaolong Li, Yilin Zhao, Han Zhang, Subhashree Radhakrishnan, Arihant Jain, Ratnesh Kumar, Vidya N. Murali, Yuxing Wang, Sameer Satish Pusegaonkar, Yizhou Wang, Sujit Biswas, Xunlei Wu, Zhedong Zheng, Pranamesh Chakraborty and Rama Chellappa. "The 9th AI City Challenge". Proceedings of 2025 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW 2025). pp. 5526-5535. 2025. https://arxiv.org/abs/2508.13564

The 10th AI City Challenge

Published in 2026 European Conference on Computer Vision - 10th AI City Challenge Workshop, 2026

The tenth AI City Challenge, held with ECCV 2026, attracted 325 registered teams from 26 countries and regions.

Recommended citation: Zheng Tang, Shuo Wang, David C. Anastasiu, Ming-Ching Chang, Anuj Sharma, Quan Kong, Munkhjargal Gochoo, Jun-Wei Hsieh, Tomasz Kornuta, Zhedong Zheng, Renran Tian, Judah Goldfeder, Fulgencio Navarro, Yuxing Wang, Yizhou Wang, Sameer Satish Pusegaonkar, Anqi Li, Nalin Dadhich, Ridham Kachhadiya, Dhanishtha Patil, Haoquan Liang, Jiajun Li, Han Zhang, Yilin Zhao, Zaid Pervaiz Bhat, Shuyu Yang, Ashutosh Kumar, Rong Wang, Rafael Martin Nieto, Peter Christiansen, Ahmed Abduljawad, Mohanrasu Shanmugam, Nadeem Shaik, Sujit Biswas, Xunlei Wu, Vidya Murali and Rama Chellappa. "The 10th AI City Challenge". Proceedings of European Conference on Computer Vision Workshops (ECCVW 2026). 2026. https://arxiv.org/abs/2608.17044v1

PSI-VQA: Evaluating Multimodal LLM Social Reasoning under Ambiguous Pedestrian Intent in Automated Driving

Published in 2026 European Conference on Computer Vision - 10th AI City Challenge Workshop, 2026

PSI-VQA evaluates multimodal language models on ambiguous pedestrian intent in automated driving.

Recommended citation: Shaozhi Wang, Yin-Chun Lu, Zheng Tang, Han Zhang, David C. Anastasiu and Renran Tian. "PSI-VQA: Evaluating Multimodal LLM Social Reasoning under Ambiguous Pedestrian Intent in Automated Driving". Proceedings of European Conference on Computer Vision Workshops (ECCVW 2026). 2026. https://openreview.net/forum?id=icgcFuZ88R

SynWTS: Multi-View Digital-Twin Dataset for Synthetic-to-Real Traffic Safety Understanding

Published in 2026 European Conference on Computer Vision - 10th AI City Challenge Workshop, 2026

SynWTS pairs synthetic digital-twin videos with real recordings from the Woven Traffic Safety dataset.

Recommended citation: Dhanishtha Patil, Ridham Kachhadiya, Andrew Vattuone, Haoquan Liang, Jiajun Li, Yuxing Wang, Zheng Tang, Ashutosh Kumar, Quan Kong and David C. Anastasiu. "SynWTS: Multi-View Digital-Twin Dataset for Synthetic-to-Real Traffic Safety Understanding". Proceedings of European Conference on Computer Vision Workshops (ECCVW 2026). 2026. https://openreview.net/forum?id=BbaZpvqrel

Physical AI Smart Spaces: A Large-Scale Benchmark for Multi-Camera 3D Perception in Smart Spaces

Published in 2026 Conference on Neural Information Processing Systems, 2026

PhysicalAI-SmartSpaces is a benchmark for multi-class, multi-camera 3D perception in indoor environments.

Recommended citation: Yuxing Wang, Yizhou Wang, Anqi Li, Shuo Wang, Sameer Satish Pusegaonkar, Haoquan Liang, Jiajun Li, Shenxin Jiang, Jianhe Yuan, Shangru Li, Tongwei Dai, Zihao Chen, David C. Anastasiu, Sujit Biswas, Xunlei Wu and Zheng Tang. "Physical AI Smart Spaces: A Large-Scale Benchmark for Multi-Camera 3D Perception in Smart Spaces". Proceedings of Conference on Neural Information Processing Systems (NeurIPS 2026). 2026.

From Detection to Understanding – A Multi-Task Dataset for Traffic Anomaly Reasoning

Published in 2026 Conference on Neural Information Processing Systems, 2026

Traffic Anomaly Reasoning is a multi-task dataset for vision-language model training and evaluation.

Recommended citation: Han Zhang, Yilin Zhao, Zaid Pervaiz Bhat, Zheng Tang, Varun Praveen, Vidya Nariyambut Murali, David C. Anastasiu and Tomasz Kornuta. "From Detection to Understanding -- A Multi-Task Dataset for Traffic Anomaly Reasoning". Proceedings of Conference on Neural Information Processing Systems (NeurIPS 2026). 2026. https://arxiv.org/abs/2608.10317

talks

teaching

Teaching experience 1

Undergraduate course, University 1, Department, 2014

This is a description of a teaching experience. You can use markdown like any other post.

Teaching experience 2

Workshop, University 1, Department, 2015

This is a description of a teaching experience. You can use markdown like any other post.