Direct3D-S2
Direct3D-S2 is DreamTech's image-to-3D model. It generates a signed distance field on sparse voxels, first at 512^3 and then at 1024^3, and returns the object as a mesh. Upstream needs CUDA-only extensions; LibreYOLO runs the same weights in plain PyTorch through the LibreGen factory.
- 작업
- 3d generation
- 크기
- v11 at 518 px
- 설치
pip install "libreyolo[gen]"- 지원 티어
- 별도 티어, v1.8.0부터 지원. 자체 팩토리와 계약을 갖춘 별도의 제품 영역입니다.
- 라이선스
- 코드 MIT and Apache-2.0, 가중치 MIT. 상업적 사용
Install
pip install "libreyolo[gen]"The extra brings diffusers, transformers (DINOv2 encoder) and
scikit-image (marching cubes).
Predict
Nothing is gated and no login is needed. Weights download on first use at pinned revisions.
from libreyolo import LibreGen, SAMPLE_IMAGE model = LibreGen("direct3d-s2") # weights download on first useresult = model(SAMPLE_IMAGE, seed=0) result.save("object.obj")m = result.meshesprint(m.vertices[0].shape, m.faces[0].shape)# Saves the object as .obj under runs/generate/predict.libreyolo generate source=https://raw.githubusercontent.com/LibreYOLO/libreyolo/release/libreyolo/assets/guggenheim-bilbao.jpg model=direct3d-s2 seed=0from libreyolo import LibreGen, SAMPLE_IMAGE model = LibreGen("direct3d-s2")result = model(SAMPLE_IMAGE, resolution=512) # stops after the first passresult = model(SAMPLE_IMAGE, steps=(25, 15, 8)) # fewer steps per stageA dense flow transformer finds the occupied 64^3 voxels, a sparse flow transformer with spatial sparse attention denoises a latent on them, and a sparse decoder turns it into a signed distance field at 512^3. A second pass repeats this at 1024^3. The mesh is the field's zero crossing, from marching cubes. Upstream runs on CUDA only (torchsparse, flash-attn, Triton kernels, a CUDA voxeliser); LibreYOLO replaces them with PyTorch operations and keeps the parameter names, so the released checkpoints load unchanged on CUDA, Apple MPS and CPU.
A seed gives the same object; on CUDA the starting noise equals upstream's
for torch.manual_seed(seed). result.meshes holds vertices (V, 3), z-up
in [-0.5, 0.5]^3, and faces (F, 3). Upstream's optional remeshing and
hole filling are not included (they depend on GPL tools), so meshes come as
marching cubes returns them.
It is slow in plain PyTorch: on an RTX A6000 the library measured about 18
minutes and 23 GB of GPU memory for one object at 1024^3, where upstream's
CUDA kernels take 2.5 minutes. resolution=512 stops after the first pass.
Settings
| Setting | Default | Meaning |
|---|---|---|
resolution | 1024 | 1024 (upstream's default) or 512. |
steps | (50, 30, 15) | Steps of the dense, 512 and 1024 stages; one integer sets all three. |
guidance | 7.0 | Classifier-free guidance of all three stages. |
Variants
One checkpoint, v11 (Direct3D-S2 v1.1): 2.0B parameters in eight networks,
about 4.2 GB, plus 1.2 GB for DINOv2 ViT-L/14 and 0.4 GB for BiRefNet.
Export
| 작업 | ONNX | TorchScript | ExecuTorch | TensorRT | OpenVINO | Paddle | MNN | RKNN | Axelera | ncnn | TFLite | CoreML | Core AI |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 3D generation | 3D generation to ONNX: 지원하지 않음 | 3D generation to TorchScript: 지원하지 않음 | 3D generation to ExecuTorch: 지원하지 않음 | 3D generation to TensorRT: 지원하지 않음 | 3D generation to OpenVINO: 지원하지 않음 | 3D generation to Paddle: 지원하지 않음 | 3D generation to MNN: 지원하지 않음 | 3D generation to RKNN: 지원하지 않음 | 3D generation to Axelera: 지원하지 않음 | 3D generation to ncnn: 지원하지 않음 | 3D generation to TFLite: 지원하지 않음 | 3D generation to CoreML: 지원하지 않음 | 3D generation to Core AI: 지원하지 않음 |
Export is not implemented for LibreGen 3D families. export(), train() and
val() raise NotImplementedError (ADR 0031 in the library).
Licensing
내려받는 특정 가중치의 Hugging Face 저장소에서 라이선스를 확인하십시오. LibreYOLO 조직의 모든 체크포인트에는 라이선스가 있으며 한 계열 안에서도 항상 같지는 않습니다. 해당 저장소가 신뢰할 수 있는 기준입니다. 아래 요약은 이 페이지를 마지막으로 검증했을 때 적용된 내용을 설명합니다.
관련 라이선스에 관한 설명이며 법률 자문이 아닙니다. 상업적으로 중요한 사안이라면 라이선스를 직접 읽고 별도의 법률 자문을 받으십시오.
- 원작
- Direct3D-S2, DreamTech
- 업스트림 라이선스
- MIT
- LibreYOLO 코드
- MIT
- 가중치
- MIT, huggingface.co/LibreYOLO에 다시 게시됨
- 해석
- MIT is a permissive license, so the code and weights can be used in commercial and closed-source products; the only obligation is to keep the copyright and license notice with copies. LibreYOLO's adapter is MIT; the flow transformers, SDF VAE decoders, refiners and spatial sparse attention it adapts from Direct3D-S2 keep MIT, with the attention following native-sparse-attention-triton (Apache-2.0) and the transformer modules TRELLIS's (MIT), noted in libreyolo/models/gen/direct3d_s2/NOTICE. Upstream's hole filling and remeshing, which need GPL-licensed pymeshfix and python-igraph, are not used. The wushuang98/Direct3D-S2 v1.1 weights (MIT) are redistributed unchanged as LibreYOLO/LibreDirect3DS2v11; the BiRefNet weights (MIT) come from LibreYOLO/LibreTRELLISl and the DINOv2 encoder, facebook/dinov2-with-registers-large (Apache-2.0), from Meta. All are pinned and none is gated.
Direct3D-S2 is by DreamTech
(DreamTechAI/Direct3D-S2). Code
and the wushuang98/Direct3D-S2 v1.1 weights are MIT, so commercial use is
fine with the notice kept. LibreYOLO redistributes the weights unchanged as
LibreYOLO/LibreDirect3DS2v11. BiRefNet (MIT) comes from LibreYOLO/LibreTRELLISl
and the DINOv2 encoder, facebook/dinov2-with-registers-large (Apache-2.0),
from Meta. Upstream's GPL pymeshfix and python-igraph are not used.
Citation
@article{wu2025direct3ds2gigascale3dgeneration,
title={Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attention},
author={Shuang Wu and Youtian Lin and Feihu Zhang and Yifei Zeng and Yikang Yang and Yajie Bao and Jiachen Qian and Siyu Zhu and Philip Torr and Xun Cao and Yao Yao},
journal={arXiv preprint arXiv:2505.17412},
year={2025}
}github.com/DreamTechAI/Direct3D-S2#-citation에 있는 저자의 인용 블록에서 복사했습니다.