Virtual Dataset via Blender

• Test with Mask R-CNN

---

Installation

<root> is Blender installation path.

1. Download Add-ons

• Blender-Molecular-Script

• blainder-range-scanner

• bpycv

2. Copy to addons

After the add-ons modification and testing, it is recommended to copy the add-ons to <root>/2.83/scripts/addons_contrib/, which will no longer need sys.path.append("<addons path>")

• Copy Blender-Molecular-Script/molecular to addons/molecular

• Copy blainder-range-scanner/range_scanner to addons/range_scanner

• Copy bpycv/bpycv to addons/bpycv

3. Install Requirements

• Windows: Use <root>\2.83\python\Scripts\pip.exe to install requirements.txt.

• Linux: Use <root>/2.83/python/bin/python3.7m to install requirements.txt.

WARNING: make sure you are using Blender's Python to install requirements.

Add-ons Usage

WARNING: make sure you add addons to sys.path or copy the add-ons to <root>/2.83/scripts/addons_contrib/.

import sys
sys.path.append("<addons path>")
from addons import molecular
from addons import range_scanner
from addons import bpycv

• molecular

The detail is here 👉 kissablemt/Blender-Molecular-Script

Run python make_release.py first

• range_scanner

The detail is here 👉 kissablemt/blainder-range-scanner

• bpycv

The detail is here 👉 kissablemt/bpycv

---

Usage

1. Base Settings

1. Change sys.path in scripts/main.py.
2. Change root_dir in configs/base.py.

2. Build Scene

scripts/build_scene.py contains the construction of the scene.

• Camera: create_camera()

  1. Change location and rotation_euler.
  2. utils.blender.look_at(camera, point) can make the lens point towards the target point easily.
  3. Some camera rendering settings will change after the function scripts.generate_dataset.kinect_v1() is called, but not including location and rotation_euler.

  WARNING: DO NOT change the name of the camera, which will cause error in scripts.generate_dataset.kinect_v1()

  
  

• Light: create_light()

  Modify the light type and intensity as required.

  
  

• Target: create_target() It Is just creating template target for particle system generation, location and rotation_euler are not important.

  1. Change scale.
  2. Change material settings.
  
  

• Contatiner: create_container() Used to collide with particles.

  1. Change location， rotation_euler and scale.
  2. Change material settings.
  
  

• Emitter: create_emitter() Parameter settings need to view Blender-Molecular-Script source code or view it in the GUI interface.

3. Generate Dataset

scripts/generate_dataset.py contains the depth camera simulation and rendering.

• blainder-range-scanner

• bpycv

4. Convert Segmentation Images to COCO Annotation

• seg2coco

---

Extra

scripts/arrange_sequently.py

Place two objects close enough.

Reference from check intersection

scripts/surround.py

---

Result

• Build scene

• Generate point cloud

• Show in CloudCompare

• UV

• Stack

• Segmentation

• Segmentation, RGB, Depth

• Segmentation Seperate