Welcome to GrUVi @ CS.SFU!

We are an inter-disciplinary team of researchers working in visual computing, in particular, computer graphics and computer vision. Current areas of focus include 3D and robotic vision, 3D printing and content creation, animation, AR/VR, geometric and image-based modelling, machine learning, natural phenomenon, and shape analysis. Our research works frequently appear in top venues such as SIGGRAPH, CVPR, and ICCV (we rank #11 in the world in terms of top publications in visual computing, as of 7/2020) and we collaborate widely with the industry and academia (e.g., Adobe Research, Google, MSRA, Princeton, Stanford, and Washington). Our faculty and students have won numerous honours and awards, including FRSC, Alain Fournier Best Thesis Award, Google Faculty Award, TR35@Singapore, NSERC Discovery Accelerator, and several best paper awards from ECCV, SCA, SGP, etc. Gruvi alumni went on to take up faculty positions in Canada, the US, and Asia, while others now work at companies including Apple, EA, Facebook, Google, IBM, and Microsoft.

×

Gruviers Won the 2020 Symposium of Geometry Processing (SGP) Dataset Award

July 8, 2020

Congratulations to Angel Xuan Chang and Manolis Savva, whose work ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes won the 2020 SGP dataset award. ScanNet is an RGB-D video dataset containing 2.5 million views in more than 1500 scans, annotated with 3D camera poses, surface reconstructions, and instance-level semantic segmentations. More information can be found in the paper here.

Gruviers Won the 2020 Symposium of Geometry Processing (SGP) Dataset Award

July 8, 2020

Congratulations to Angel Xuan Chang and Manolis Savva, whose work ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes won the 2020 SGP dataset award. ScanNet is an RGB-D video dataset containing 2.5 million views in more than 1500 scans, annotated with 3D camera poses, surface reconstructions, and instance-level semantic segmentations. More information can be found in the paper here.

×

Gruviers Receive CVPR Awards

Jun 23, 2020

Visual computing researchers from SFU received multiple awards at the annual Conference on Computer Vision and Pattern Recognition (CVPR) this past week. CVPR is the premier conference in computer vision with the highest impact factor among all conferences in computer science and was held virtually for the first time this year from June 14-19. Computing science professor Greg Mori served as one of four program chairs at the conference.

Zhiqin Chen and Richard Zhang, together with GrUVi alumnus Andrea Tagliasacchi, won the Best Student Paper Award with “BSP-Net: Generating Compact Meshes via Binary Space Partitioning” introduces a deep neural network which applies a classical graphics technique to learn compact shape representations.

Yasutaka Furukawa won the PAMI Longuet-Higgins Prize for his CVPR 2007 milestone paper on “multi-view stereo reconstruction”, which has been cited more than 3,000 times!

Also, Akshay Gadi Patil won the Best Paper Award at the CVPR Workshop on Text and Documents in the Deep Learning Era for his work “READ: Recursive Autoencoders for Document Layout Generation”.

Read more here. Well done, gruviers!

Gruviers Receive CVPR Awards

Jun 23, 2020

Visual computing researchers from SFU received multiple awards at the annual Conference on Computer Vision and Pattern Recognition (CVPR) this past week. CVPR is the premier conference in computer vision with the highest impact factor among all conferences in computer science and was held virtually for the first time this year from June 14-19. Computing science professor Greg Mori served as one of four program chairs at the conference. Zhiqin Chen and Richard Zhang, together with GrUVi alumnus Andrea Tagliasacchi, won the Best Student Paper Award with “BSP-Net: Generating Compact Meshes via Binary Space Partitioning” introduces a deep neural network which applies a classical graphics technique to learn compact shape representations. Yasutaka Furukawa won the PAMI Longuet-Higgins Prize for his CVPR 2007 milestone paper on “multi-view stereo reconstruction”, which has been cited more than 3,000 times! Also, Akshay Gadi Patil won the Best Paper Award at the CVPR Workshop on Text and Documents in the Deep Learning Era for his work “READ: Recursive Autoencoders for Document Layout Generation”. Read more here. Well done, gruviers!

×

GrUVi making waves at CVPR 2020

Jun 09, 2020

CVPR, the premier conference on computer vision, will be held virtually next week (June 16-20). SFU Computing Science professor Greg Mori is front-n-center as a Program Chair of the major event! GrUVi lab will have an incredible showing at CVPR, with 11 technical papers (5 orals), 3 invited talks, and 4 co-organized workshops!



Workshop co-organization

 

GrUViers will co-organize 4 workshops featuring state-of-the-art research:

 



Invited workshop talks

 

Yasutaka Furukawa will give a talk at the aforementioned “ScanNet Indoor Scene Understanding Challenge” as well as the “3D Scene Understanding for Vision, Graphics, and Robotics” workshop , while Manolis Savva will participate as an invited speaker at the “Fair, Data, Efficient and Trusted Computer Vision” workshop.



Technical Papers and GrUVi authors

 

Congratulations to all authors, especially to Dr. Ping Tan, who got five accepted papers! The full list of papers featured on CVPR 2020 can be accessed here. In particular, GrUVi papers covered different topics:

 

  • 3D From a Single Image and Shape-From-X
    • BSP-Net: Generating Compact Meshes via Binary Space Partitioning (Zhiqin Chen, Andrea Tagliasacchi, Hao Zhang - oral)
    • Bundle Pooling for Polygonal Architecture Segmentation Problem (Huayi Zeng, Kevin Joseph, Adam Vest, Yasutaka Furukawa)
    • Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matching (Xiaodong Gu, Zhiwen Fan, Siyu Zhu, Zuozhuo Dai, Feitong Tan, Ping Tan - oral)
    • Conv-MPN: Convolutional Message Passing Neural Network for Structured Outdoor Architecture Reconstruction (Nelson Nauata, Fuyang Zhang, Yasutaka Furukawa)
    • PQ-NET: A Generative Part Seq2Seq Network for 3D Shapes (Rundi Wu, Yixin Zhuang, Kai Xu, Hao Zhang, Baoquan Chen)
    • Self-Supervised Human Depth Estimation From Monocular Videos (Feitong Tan, Hao Zhu, Zhaopeng Cui, Siyu Zhu, Marc Pollefeys, Ping Tan)
  • 3D From Multiview and Sensors; Computational Photography; Efficient Training and Inference Methods for Networks
    • End-to-End Learning Local Multi-View Descriptors for 3D Point Clouds (Lei Li, Siyu Zhu, Hongbo Fu, Ping Tan, Chiew-Lan Tai)
  • 3D From Multiview and Sensors; Face, Gesture, and Body Pose; Image and Video Synthesis
    • Deep Facial Non-Rigid Multi-View Stereo (Ziqian Bai, Zhaopeng Cui, Jamal Ahmed Rahim, Xiaoming Liu, Ping Tan)
  • Motion and Tracking
    • LSM: Learning Subspace Minimization for Low-Level Vision (Chengzhou Tang, Lu Yuan, Ping Tan - oral)
  • Segmentation, Grouping, and Shape
    • AdaCoSeg: Adaptive Shape Co-Segmentation With Group Consistency Loss (Chenyang Zhu, Kai Xu, Siddhartha Chaudhuri, Li Yi, Leonidas J. Guibas, Hao Zhang - oral)
  • Vision for Robotics and Autonomous Vehicles
    • SAPIEN: A SimulAted Part-Based Interactive ENvironment (Fanbo Xiang, Yuzhe Qin, Kaichun Mo, Yikuan Xia, Hao Zhu, Fangchen Liu, Minghua Liu, Hanxiao Jiang, Yifu Yuan, He Wang, Li Yi, Angel X. Chang, Leonidas J. Guibas, Hao Su - oral)

GrUVi making waves at CVPR 2020

Jun 09, 2020

CVPR, the premier conference on computer vision, will be held virtually next week (June 16-20). SFU Computing Science professor Greg Mori is front-n-center as a Program Chair of the major event! GrUVi lab will have an incredible showing at CVPR, with 11 technical papers (5 orals), 3 invited talks, and 4 co-organized workshops! Workshop co-organization   GrUViers will co-organize 4 workshops featuring state-of-the-art research:   Learning 3D Generative Models ScanNet Indoor Scene Understanding Challenge Embodied-AI Workshop Deep Learning Foundations of Geometric Shape Modeling and Reconstruction Invited workshop talks   Yasutaka Furukawa will give a talk at the aforementioned “ScanNet Indoor Scene Understanding Challenge” as well as the “3D Scene Understanding for Vision, Graphics, and Robotics” workshop , while Manolis Savva will participate as an invited speaker at the “Fair, Data, Efficient and Trusted Computer Vision” workshop. Technical Papers and GrUVi authors   Congratulations to all authors, especially to Dr. Ping Tan, who got five accepted papers! The full list of papers featured on CVPR 2020 can be accessed here. In particular, GrUVi papers covered different topics:   3D From a Single Image and Shape-From-X BSP-Net: Generating Compact Meshes via Binary Space Partitioning (Zhiqin Chen, Andrea Tagliasacchi, Hao Zhang - oral) Bundle Pooling for Polygonal Architecture Segmentation Problem (Huayi Zeng, Kevin Joseph, Adam Vest, Yasutaka Furukawa) Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matching (Xiaodong Gu, Zhiwen Fan, Siyu Zhu, Zuozhuo Dai, Feitong Tan, Ping Tan - oral) Conv-MPN: Convolutional Message Passing Neural Network for Structured Outdoor Architecture Reconstruction (Nelson Nauata, Fuyang Zhang, Yasutaka Furukawa) PQ-NET: A Generative Part Seq2Seq Network for 3D Shapes (Rundi Wu, Yixin Zhuang, Kai Xu, Hao Zhang, Baoquan Chen) Self-Supervised Human Depth Estimation From Monocular Videos (Feitong Tan, Hao Zhu, Zhaopeng Cui, Siyu Zhu, Marc Pollefeys, Ping Tan) 3D From Multiview and Sensors; Computational Photography; Efficient Training and Inference Methods for Networks End-to-End Learning Local Multi-View Descriptors for 3D Point Clouds (Lei Li, Siyu Zhu, Hongbo Fu, Ping Tan, Chiew-Lan Tai) 3D From Multiview and Sensors; Face, Gesture, and Body Pose; Image and Video Synthesis Deep Facial Non-Rigid Multi-View Stereo (Ziqian Bai, Zhaopeng Cui, Jamal Ahmed Rahim, Xiaoming Liu, Ping Tan) Motion and Tracking LSM: Learning Subspace Minimization for Low-Level Vision (Chengzhou Tang, Lu Yuan, Ping Tan - oral) Segmentation, Grouping, and Shape AdaCoSeg: Adaptive Shape Co-Segmentation With Group Consistency Loss (Chenyang Zhu, Kai Xu, Siddhartha Chaudhuri, Li Yi, Leonidas J. Guibas, Hao Zhang - oral) Vision for Robotics and Autonomous Vehicles SAPIEN: A SimulAted Part-Based Interactive ENvironment (Fanbo Xiang, Yuzhe Qin, Kaichun Mo, Yikuan Xia, Hao Zhu, Fangchen Liu, Minghua Liu, Hanxiao Jiang, Yifu Yuan, He Wang, Li Yi, Angel X. Chang, Leonidas J. Guibas, Hao Su - oral)

×

GrUVi tackles COVID-19 using AI

Jun 07, 2020

SFU researchers helped to develop an AI system capable of assisting resident and less experienced doctors look over a data set and make a quick diagnosis before a senior doctor can step in. This is accoding to Yağız Aksoy, a gruvier and also a member of the team that proposed the diagnosis tool, which is currently in the validation phase at St. Paul’s Hospital in Vancouver, Canada. Read more about it here. Thank you for your hard work, Dr. Aksoy!

GrUVi tackles COVID-19 using AI

Jun 07, 2020

SFU researchers helped to develop an AI system capable of assisting resident and less experienced doctors look over a data set and make a quick diagnosis before a senior doctor can step in. This is accoding to Yağız Aksoy, a gruvier and also a member of the team that proposed the diagnosis tool, which is currently in the validation phase at St. Paul’s Hospital in Vancouver, Canada. Read more about it here. Thank you for your hard work, Dr. Aksoy!

More News

× LOGAN - SIG Asia Press Release

Oct 24, 2019

Congratulations to Kangxue, whose work LOGAN: Unpaired Shape Transform in Latent Overcomplete Space will be featured for press release at SIGGRAPH Asia 2019!

LOGAN is able to learn what shape features to preserve during shape translation, either local or non-local, whether content or style, depending solely on the input domains for training, which was an improvement over the state of the art.

LOGAN is an abbreviation for Latent Overcomplete GAN. Richard Zhang, who is also the last author, created the fun acronym.

Oct 24, 2019
LOGAN - SIG Asia Press Release

× IGS'19 Organized by GrUVi

Jul 23, 2019

The International Geometry Summit (IGS) 2019, organized by Richard Zhang and Ali Mahdavi-Amiri, took place from 17th June to the 21th June 2019 at SFU Harbour Center in Vancouver, Canada. IGS 2019 included four conferences: the Symposium on Solid and Physical Modelling, Shape Modeling International, SIAM Conference on Computational Geometric Design, and International Conference on Geometric Modelling and Processing. IGS 2019 featured state of the art researches in its technical paper sessions along with 12 keynote speeches from prominent researchers in the area of geometry.

Congratulations to Richard Zhang and Ali Mahdavi-Amiri for the successful organization and thanks to all GrUVi students that volunteered to make IGS'19 a success!

Jul 23, 2019
IGS'19 Organized by GrUVi

× Richard's SGP Keynote Speech

Jul 22, 2019

Richard Zhang was featured in the Eurographics Symposium on Geometry Processing (SGP) as a keynote speaker! His speech was titled “Can Machines Learn to Generate 3D Shapes?”.

In his talk, Richard highlighted the representation, data, and output challenges that researchers must tackle and how his research has shaped itself to address these challenges.

One of the key issues in this domain is not generate shapes that look right; instead, they need to serve their intended function while displaying the right part connections, arrangements, and geometry.

Jul 22, 2019
Richard's SGP Keynote Speech

× Xiaoming Liu Visits SFU

Jul 9, 2019

Dr. Xiaoming Liu visited SFU today following an invitation from Dr. Yasutaka Furukawa! His talk titled "Inverse Graphics for 3D Modeling and Reconstruction: from Face to Generic Objects" has the following abstract:

"Reconstructing the detailed and complete 3D surface of an object from a single 2D image is a long standing computer vision problem. In this talk, we present an inverse graphics-based framework to learn a 3D face model from a large set of in-the-wild 2D face images, without the need of capturing 3D scans. We also extend this framework to high-fidelity face modeling, as well as generic object modeling and 3D reconstruction. In the end, we will briefly overview other research efforts in the Computer Vision Lab at Michigan State University, including face anti-spoofing, explainable recognition, early sensor fusion of LiDAR and RGB, 2D/3D object detection from urban driving videos, etc."

Jul 9, 2019
Xiaoming Liu Visits SFU

× Yağız Aksoy Joins GrUVi

Jul 3, 2019

GrUVi is glad to announce that Yagiz Aksoy will join our team this August. He is a PhD student of Marc Pollefeys at ETH Zurich. During his PhD, he spent a year at MIT CSAIL working with Wojciech Matusik and three years at Disney Research Zurich.
His research is at the intersection of computer vision and computer graphics, focusing on analyzing images to allow for realistic manipulation of photographs. His research has resulted in publications at venues such as SIGGRAPH, CVPR, and ACM Transactions on Graphics.
Welcome to the GrUVi team, Yagiz!

Jul 3, 2019
Yağız Aksoy Joins GrUVi

× Zhiqin's and Jon's Thesis Defense

Jun 3, 2019

The GrUVi team congratulates both Zhiqin and Jon for their sucessful MSc theses defense!
Jon's thesis is on A Qualitative and Localized Evaluation for 3D Indoor Scene Synthesis
Zhiqin's thesis is on IM-NET: Learning Implicit Fields for Generative Shape Modeling
Zhiqin's thesis defence also received the honor of "pass as is" today. Both of them will start as PhDs at GrUVi this September.

Jun 3, 2019
Zhiqin's and Jon's Thesis Defense

× Kangxue Yin wins an Award!

May 23, 2019

The GrUVi team congratulates Kangxue Yin, whom received the prestigious Chinese Government Award for Outstanding Self-financed Students Abroad!

This award was established in 2003 by the China Scholarship Council. The worldwide recipients are chosen annually based on a record of outstanding accomplishments in any discipline.

This award is considered the highest award given by Chinese government for Chinese graduate students studying abroad who do not receive regular financial support from Chinese government.

Currently, this award is granted to only 500 students every year. Since there are around half a million Chinese students to study abroad per year, this a highly competitive award. For the academic year 2018, only 6 awardees were based in British Columbia, Canada. Among them, Kangxue was the only student majoring in Computer Science.

May 23, 2019
Kangxue Yin wins an Award!

× Accepted Paper on CVPR

May 1, 2019

A paper by Zhiqin Chen and Hao Zhang on learning implicit fields for generative modeling of 3D shapes will be presented at CVPR 2019!
It has also been invited to be presented at the Workshop on 3D Scene Generation at CVPR; see paper on arXiv.
Congratulations to both Zhiqin and Richard!

May 1, 2019
Accepted Paper on CVPR

× New and Returning GRuVIers!

April 14, 2019

The GrUVi team would like to welcome three SFU undergrad students who are joining the lab for summer/visiting research:

  • Leo Li - to start in the summer as a VPA USRA working on representation learning;
  • Atticus Shi - who is working on a geometric optimization problem related to fixture design for CNC machining;
  • Azmarie Wang - to start in the summer as a special project student working on creative design problems.

In addition, Xiaogang Wang is joining us as a visiting PhD from Beihang University, the same university as Jiongchao. He comes with an already impressive research record (one SIG Asia and one CVPR), working with Kevin, a GrUVi alumni himself.

Fenggen (Fogg) Yu, will be a new PhD starting this fall. Fenggen is from Nanjing University and he had already collaborated with GrUVi members on a ACM TOG paper. He also has a CVPR paper this year.

We are also pleased to announce that two current members of the lab, Zhiqin and Jon, will continue as PhD students this fall.

Finally, Akshay is returning from his internship at Amazon (Israel) and Manyi, as a newly minted PhD, will be back as a postdoc this Summer.

April 14, 2019
New and Returning GRuVIers!

... see all News