3d
**3D AI: Meshes, NeRFs, and Point Clouds**
**3D Representations**
| Type | Description | Use Case |
|------|-------------|----------|
| Mesh | Vertices, edges, faces | Games, CAD |
| Point Cloud | 3D points | LiDAR, scanning |
| NeRF | Neural radiance field | Novel view synthesis |
| SDF | Signed distance function | Smooth surfaces |
| 3D Gaussian | Gaussian splatting | Real-time rendering |
**Text-to-3D**
Generate 3D models from text descriptions:
```python
# Conceptual API (e.g., Meshy, Tripo3D)
model_3d = generate_3d(
prompt="a detailed medieval sword with gold handle",
format="glb",
resolution="high"
)
```
**Image-to-3D**
```python
# Generate 3D from single image
from zero123pp import Zero123PP
model = Zero123PP.load()
mesh = model.generate_mesh(
image="input.png",
num_views=16
)
mesh.export("output.glb")
```
**NeRF (Neural Radiance Fields)**
Train a neural network to represent a 3D scene:
```python
# nerfstudio example
# 1. Capture images from multiple angles
# 2. Run COLMAP for camera poses
# 3. Train NeRF
ns-train nerfacto
--data ./images
--output-dir ./output
```
**3D Gaussian Splatting**
Faster alternative to NeRF:
```python
# Requires camera poses + images
# Train in minutes, render in real-time
python train.py
-s ./scene
--iterations 30000
```
**Tools and Platforms**
| Tool | Capability |
|------|------------|
| Meshy | Text/image to 3D |
| Tripo3D | Fast 3D generation |
| Luma AI | NeRF capture app |
| Polycam | 3D scanning |
| nerfstudio | NeRF training |
**Point Cloud Processing**
```python
import open3d as o3d
# Load point cloud
pcd = o3d.io.read_point_cloud("scan.ply")
# Downsample
pcd_down = pcd.voxel_down_sample(voxel_size=0.05)
# Normal estimation
pcd.estimate_normals()
# Surface reconstruction
mesh, densities = o3d.geometry.TriangleMesh.create_from_point_cloud_poisson(pcd)
```
**Use Cases**
| Use Case | Technology |
|----------|------------|
| Game assets | Text-to-3D mesh |
| Architecture | NeRF/Gaussian for visualization |
| E-commerce | Product 3D from photos |
| VR/AR content | Rapid asset creation |
| Industrial | Point cloud processing |
**Challenges**
- Quality still behind manual modeling
- Limited control over output
- Texture/material quality
- Animation support limited