WildDet3D

WildDet3D predicts three-dimensional boxes from a single image.

Task: 3d detection
Ukuran: l at 1008 px
Instalasi: pip install "libreyolo[hf]"
Tier dukungan: Tier sejajar, sejak v1.6.0. Permukaan produk terpisah dengan factory dan kontraknya sendiri.
Proyek upstream: WildDet3D oleh Allen Institute for AI, SAM License. Makalah, sumber
Lisensi: Kode MIT, bobot SAM License. Penggunaan komersial

Install

bash

pip install "libreyolo[hf]"

Predict

Python

from libreyolo import LibreWildDet3D, SAMPLE_IMAGEfrom PIL import Imageimport numpy as np # Requires the separately installed upstream runtime.model = LibreWildDet3D(device="cpu")# Approximate pinhole intrinsics for the original image size.# Replace with your camera's measured 3x3 calibration for real geometry.width, height = Image.open(SAMPLE_IMAGE).sizef = max(width, height)intrinsics = np.array([[f, 0, width / 2], [0, f, height / 2], [0, 0, 1]], dtype=np.float32)result = model.predict(SAMPLE_IMAGE, intrinsics=intrinsics, text="person")print(result.boxes3d)

WildDet3D accepts text, box or point prompts and requires original-image camera intrinsics. Install its separate upstream runtime and provide runtime_path and runtime_python when they are outside the active environment.

result.boxes3d holds centers, dimensions and wxyz quaternions in camera coordinates, plus confidence, class and intrinsics. Plotting projects cuboids into the image. Training, validation, tracking and export are not supported. See 3D detection.

Licensing

Periksa lisensi di repositori Hugging Face untuk bobot tertentu yang diunduh. Setiap checkpoint di organisasi LibreYOLO memiliki lisensi, dan lisensinya tidak selalu sama dalam satu family. Repositori tersebut adalah sumber resmi. Ringkasan di bawah menjelaskan ketentuan yang berlaku saat halaman ini terakhir diverifikasi.

Ini adalah deskripsi lisensi yang terlibat, bukan nasihat hukum. Jika jawabannya penting secara komersial, baca sendiri lisensinya dan mintalah nasihat dari penasihat hukum Anda.

Karya asli: WildDet3D, Allen Institute for AI
Lisensi upstream: SAM License
Sumber upstream: github.com/allenai/WildDet3D
Kode LibreYOLO: MIT
Bobot: SAM License, dipublikasikan ulang di huggingface.co/LibreYOLO
Interpretasi: The upstream runtime and checkpoint retain the custom SAM License, including its field-of-use restrictions.

Citation

@misc{huang2026wilddet3dscalingpromptable3d,
      title={WildDet3D: Scaling Promptable 3D Detection in the Wild}, 
      author={Weikai Huang and Jieyu Zhang and Sijun Li and Taoyang Jia and Jiafei Duan and Yunqian Cheng and Jaemin Cho and Matthew Wallingford and Rustin Soraki and Chris Dongjoo Kim and Shuo Liu and Donovan Clay and Taira Anderson and Winson Han and Ali Farhadi and Bharath Hariharan and Zhongzheng Ren and Ranjay Krishna},
      year={2026},
      eprint={2604.08626},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2604.08626}, 
}

Disalin dari blok sitasi penulis di raw.githubusercontent.com/allenai/WildDet3D/main/README.md.