Arkit - Collision with Real World Objects

Detect a real world object using ARKit and SceneKit

ARKit can detect planes, but right now only horizontal ones, see this answer here.
Other detections are not part of ARKit.

Augmented Reality – Lighting Real-World objects with Virtual light

At the low level, RealityKit is only responsible for rendering virtual objects and overlaying them on top of the camera frame.
If you want to illuminate the real scene, you need to post-process the camera frame.

Here are some tutorials on how to do post-processing:
Tutorial1⃣️
Tutorial2⃣️

If all you need is an effect like This , then all you need to do is add a CGImage-based post-processing effect for the virtual object (lights).

More specifically, add a bloom filter to the rendered image(You can also simulate bloom filters with Gaussian blur).

In this way, the code is all around UIImage and CGImage, so it's pretty simple/p>

If you want to be more realistic, consider using the depth map provided by LiDAR to calculate which areas can be illuminated for a more detailed brightness.

Or If you're a true explorer, you can use Metal to create a real world Digital Twin point cloud in real time to simulate occlusion of light.

Related Topics