TRELLIS.2
TRELLIS.2 is Microsoft's open 4B image-to-3D model. It returns the object's shape as a mesh, on a grid of up to 1536^3. LibreYOLO runs the same weights in plain PyTorch through the LibreGen factory, geometry only.
- Aufgaben
- 3d generation
- Größen
- 4b at 1024 px
- Installation
pip install "libreyolo[gen]"- Supportstufe
- Geschwisterstufe, seit v1.8.0. Eine separate Produktoberfläche mit eigener Factory und eigenem Vertrag.
- Upstream
- TRELLIS.2 von Microsoft Research, DINOv3 License. Publikation, Quelle
- Lizenzen
- Code MIT, Gewichte MIT and DINOv3 License. Kommerzielle Nutzung
Install
pip install "libreyolo[gen]"The extra brings transformers, which loads the DINOv3 image encoder.
Predict
Nothing is gated and no login is needed. Weights download on first use at pinned revisions.
from libreyolo import LibreGen, SAMPLE_IMAGE model = LibreGen("trellis2") # also "trellis.2"result = model(SAMPLE_IMAGE, seed=0) result.save("object.obj")m = result.meshesprint(m.vertices[0].shape, m.faces[0].shape, m.seed)# Saves the object as .obj under runs/generate/predict.libreyolo generate source=https://raw.githubusercontent.com/LibreYOLO/libreyolo/release/libreyolo/assets/guggenheim-bilbao.jpg model=trellis2 seed=0from libreyolo import LibreGen, SAMPLE_IMAGE model = LibreGen("trellis2")result = model(SAMPLE_IMAGE, resolution=512) # one shape stage, fasterresult = model(SAMPLE_IMAGE, resolution=1536) # finest gridA structure stage places the occupied voxels, shape stages fill in a latent on them (at 512, then again at 1024 or 1536), and a sparse decoder turns it into a dual-grid mesh. Both flow stages read DINOv3 ViT-L/16 tokens. Upstream needs CUDA-only extensions (FlexGEMM, flash-attn, o-voxel); LibreYOLO runs the same weights in plain PyTorch on NVIDIA GPUs, Apple silicon and CPU. Noise is drawn on the CPU, so a seed gives the same object on every device up to kernel rounding.
result.meshes holds the mesh: vertices (V, 3), z-up in [-0.5, 0.5]^3,
and faces (F, 3). It is geometry only and the raw dual grid, before
upstream's CuMesh clean-up: faces are not consistently wound and some vertices
are unused. Upstream's texture stage bakes with nvdiffrast, a non-commercial
NVIDIA library, and is not part of LibreYOLO.
On an A100 the library measured 19.5 s and 14.3 GB peak GPU memory for one object at 1024, and 5.5 s and 11.6 GB at 512.
Settings
| Setting | Default | Meaning |
|---|---|---|
steps | 12 | Sampling steps. |
guidance | 7.5 | Classifier-free guidance. |
resolution | 1024 | Output grid: 512, 1024 or 1536. |
margin | 1.0 | Crop side over object size. |
max_tokens | 49152 | Token budget for the cascade; it may lower the resolution to fit, and params records the resolution used. |
Variants
One size, 4b: 4B parameters in five networks, about 8.7 GB, plus 1.2 GB for
the DINOv3 encoder and 1.3 GB from the TRELLIS mirror.
Export
| Aufgabe | ONNX | TorchScript | ExecuTorch | TensorRT | OpenVINO | Paddle | MNN | RKNN | Axelera | ncnn | TFLite | CoreML | Core AI |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 3D generation | 3D generation to ONNX: nicht unterstützt | 3D generation to TorchScript: nicht unterstützt | 3D generation to ExecuTorch: nicht unterstützt | 3D generation to TensorRT: nicht unterstützt | 3D generation to OpenVINO: nicht unterstützt | 3D generation to Paddle: nicht unterstützt | 3D generation to MNN: nicht unterstützt | 3D generation to RKNN: nicht unterstützt | 3D generation to Axelera: nicht unterstützt | 3D generation to ncnn: nicht unterstützt | 3D generation to TFLite: nicht unterstützt | 3D generation to CoreML: nicht unterstützt | 3D generation to Core AI: nicht unterstützt |
Export is not implemented for LibreGen 3D families. export(), train() and
val() raise NotImplementedError (ADR 0031 in the library).
Licensing
Prüfe die Lizenz im Hugging-Face-Repository der konkreten Gewichte, die du herunterlädst. Jeder Checkpoint in der LibreYOLO-Organisation hat eine Lizenz, und sie ist innerhalb einer Familie nicht immer gleich. Dieses Repository ist die maßgebliche Quelle. Die Zusammenfassung unten beschreibt den Stand bei der letzten Verifizierung dieser Seite.
Dies ist eine Beschreibung der beteiligten Lizenzen und keine Rechtsberatung. Wenn die Antwort kommerziell relevant ist, lies die Lizenzen selbst und hole eigenen Rechtsrat ein.
- Originalarbeit
- TRELLIS.2, Microsoft Research
- Upstream-Lizenz
- DINOv3 License
- Upstream-Quelle
- github.com/microsoft/TRELLIS.2
- LibreYOLO-Code
- MIT
- Gewichte
- MIT and DINOv3 License, erneut unter huggingface.co/LibreYOLO veröffentlicht
- Einordnung
- The TRELLIS.2 code and its microsoft/TRELLIS.2-4B weights are MIT, a permissive license that allows commercial and closed-source use with the copyright notice kept. The image encoder it needs is not: facebook/dinov3-vitl16-pretrain-lvd1689m is Meta's, under the DINOv3 License, a custom agreement that is not OSI-approved. It permits redistribution with a copy of the agreement and passes through trade-control and end-use restrictions (military, weapons, espionage and nuclear uses among them), so it sets the terms for the pipeline as a whole; read it before shipping a product on it. LibreYOLO's adapter is MIT, and the flow models, VAE decoder and dual-grid meshing it adapts from TRELLIS.2 keep MIT, noted in libreyolo/models/gen/trellis2/NOTICE. Upstream's nvdiffrast and nvdiffrec (NVIDIA, non-commercial) and BRIA's RMBG-2.0 (non-commercial) are not used, and the texture stage is not ported. Weights are redistributed unchanged at pinned revisions and none is gated: the geometry networks as LibreYOLO/LibreTRELLIS2-4b, TRELLIS's structure decoder and the BiRefNet weights (MIT) from LibreYOLO/LibreTRELLISl, and the DINOv3 encoder as LibreYOLO/LibreDINOv3vitl16 with the agreement.
TRELLIS.2 is by Microsoft Research
(microsoft/TRELLIS.2). The code and
the microsoft/TRELLIS.2-4B weights are MIT.
The image encoder sets the terms for the pipeline. It is Meta's
facebook/dinov3-vitl16-pretrain-lvd1689m, under the DINOv3 License, a
custom agreement that is not OSI-approved and passes through trade-control and
end-use restrictions (military, weapons, espionage and nuclear uses among
them). Read it before shipping a product on this model.
Weights are redistributed unchanged at pinned revisions and none is gated: the geometry networks as LibreYOLO/LibreTRELLIS2-4b, TRELLIS's structure decoder and BiRefNet (MIT) from LibreYOLO/LibreTRELLISl, and the DINOv3 encoder as LibreYOLO/LibreDINOv3vitl16 with the agreement. nvdiffrast, nvdiffrec and RMBG-2.0 (all non-commercial) are not used.
Citation
@article{
xiang2025trellis2,
title={Native and Compact Structured Latents for 3D Generation},
author={Xiang, Jianfeng and Chen, Xiaoxue and Xu, Sicheng and Wang, Ruicheng and Lv, Zelong and Deng, Yu and Zhu, Hongyuan and Dong, Yue and Zhao, Hao and Yuan, Nicholas Jing and Yang, Jiaolong},
journal={Tech report},
year={2025}
}Aus dem Zitierblock der Autoren unter github.com/microsoft/TRELLIS.2#-citation kopiert.