1. Seeing the world in 3D perspective

1-1. Why is 3D important?

• AI agents operate in the real world, which is a 3D space
• Applications
  • AR/VR
  • 3D printing
  • Medical applications

1-2. The way we observe 3D

• An image ios a projection of the 3D world onto a 2D space

1-3. 3D data representation

• 2D image is represented by RGB values of each pixel in 2D matrix

  

• 3D data representation is not unique

  • point cloud
  • Mesh
  • Implicit shape
  • Multi-view images
  • Volumetric
  • part assembly

1-4. 3D datasets

ShapeNet

• Large scale synthetic objects (51300 3D models with 55 categories)

PartNet

• Fine-grained dataset, useful for segmentation (573,585 part instances in 26,671 3D models)

SceneNet

ScanNet