To capture the xyz data of 78 feature points on the face
I plan to use Inter's depth camera to obtain the coordinate displacement information (XYZ) of 78 facial feature points in a period of time. I learned that there is an official SDK for SR300 and F200 to achieve this.But I have a problem. The SR300 and F200 are not sold in my area due to the production of SR300 and F200. So can I use other styles of depth cameras to achieve this?Or can the SDK that gets the feature point data be used on other types of cameras like D435i or D415.Thank you very much!
-
Hi Tkchating The 2016 SDK with the face landmark functions is not compatible with modern RealSense cameras such as the 400 Series and L515.
On the modern 400 Series cameras, face points can be detected using a library called dlib
The RealSense SDK has an example dlib facial landmark detection program called rs-face-dlib
https://github.com/IntelRealSense/librealsense/tree/master/wrappers/dlib/face
If you would prefer a pre-made commercial grade solution, the Nuitrack SDK (which is compatible with RealSense 400 Series cameras) can provide face landmark detection. The link below shows a Nuitrack face example program in the Unity engine:
https://download.3divi.com/Nuitrack/doc/UnityFaceTracking_page.html
Here is a non-Unity example of Nuitrack SDK's face tracking:
-
Thank you very much MartyG .You solved my problem very well.The Face-Dlib and Nuitrack SDK you provide are also great.
But it's a little pity that their work is not quite in line with what I want
Because What I want to extract is the 3D displacement data of many key points of the face within 1 second of completing an expression action (such as smile), I found the Face Landmark provided by SR300 and 2016 SDK.
Thank you again!
-
Using the 2016 SDK is possible but complicated by a couple of factors:
- SR300 cameras are difficult to purchase now. There are a couple of third-party SR300 compatible cameras called the Creative BlasterX Senz3D (which is virtually identical to the official SR300, as Creative manufactured the original SR300 for Intel). There is also the Razer Stargazer camera. Both third-party cameras are difficult to obtain now though.
- The 2016 SDK only works with Windows and is likely to become increasingly incompatible with modern Windows versions as time progresses, as updates for it stopped years ago.
You can sometimes find RealSense camera models no longer stocked in the online RealSense Store (such as retired models like the ZR300 stereo camera) if you browse around Intel Authorized Distributor retailers. The site below has a list of Authorized Distributors, with a drop-down menu of countries so you can find local stockists.
https://www.intel.com/content/www/us/en/partner/where-to-buy/overview.html
Please sign in to leave a comment.
Comments
4 comments