Living Digital Skin Project

This is collaborated project with Kao corporation.

The recent research will be appeared in SIGGRAPH 2003.



[Abstract]
With the recent progress in various imaging systems such as multimedia, computer graphic, and telemedicine systems, facial skin color reproduction becomes increasingly important for communication, image reproduction on hard copy and soft copy, medical diagnosis, cosmetic development, and so on. In this project, skin color is analyzed between appearance of Japanese facial images and amount of melanin and hemoglobin components in the facial skin.  Facial color images were taken by commercially available digital still camera.  The spatial distributions of melanin and hemoglobin components in the facial color image were separated by independent-component analysis of a skin color. The separated components were synthesized to simulate the various facial color images by changing the quantities of the two separated pigments. The synthesized images were evaluated subjectively. The relationship between the evaluation value and changing rate of hemoglobin and melanin components were analyzed. From the analysis , we could find the visual or psychological terms that are well related to change of hemoglobin or melanin components. From different point of view, we could find how the changes of hemoglobin or melanin components influence the appearance of facial color image.

 近年,マルチメディア,CG,遠隔医療などの技術の発展に伴って,顔色再現がますます重要視されている.人間の肌は複数の層を形成する複雑な構造であり,各層にはメラニン,ヘモグロビンなどの色素が存在する.肌の構造や色素成分の変化によって,肌の見えは様々に変化する.本プロジェクトでは,顔画像よりメラニンとヘモグロビンの成分量を分離抽出し,それぞれの成分量を変化させ再び合成することで,様々な肌色の顔画像を予測する.さらに各色素成分量と顔色の見えとの関係を,主観評価実験により解析する.


[Images]

The skin color is modeled as distributing in two dimentional plane spanned by colors of melanin and hemoglobin in optical density domain. The independent component analysis is applied to separate the color based on the melanin and hemoglobin.





The separated melanin and hemoglobin are synthesized by changing the amount of them. The real skin color variation can be achieved by the system.





The synthsezed facial colors are evaluated by sibjective experiment to find the relation between the appearance and pigmentation.



Results #1


Results #2


Results #3

[Related papers]

N. Tsumura, K. Uetsuki, N. Ojima, Y, Miyake, "Correlation map analysis between appearance of Japanese facial images and amount of melanin and hemoglobin components in the skin," Proc. SPIE 4299 pp.252-260(2001),

N. Tsumura, H. Haneishi, Y. Miyake, ;Independent component analysis of spectral absrobance image in human skin,; Optical Review Vol. 7, No. 6, 479-482(2000) .

N. Tsumura, H. Haneishi, Y. Miyake, Independent component analysis of skin color image:Journal of Optical Society of America A Vol. 16 No.9, 2169-2176(1999).

植月啓次,津村徳道,小島信敏,三宅洋一,独立成分分析による顔色変化予測に基づく顔画像の評価,日本写真学会誌 64巻 4号,255-263(2001).

津村徳道,羽石秀昭,三宅洋一,光散乱を考慮した肌の分光反射率の非線形独立成分分析,光学 30, 6 (2001) 400-406.

植月啓次,津村徳道,小島伸俊,三宅洋一,肌の色素成分に顔色合成とその評価,カラーフォーラムJAPAN2000論文集(2000) 5-8.

津村徳道,羽石秀昭,三宅洋一,”肌分光画像の独立成分分析(II)ー光散乱の影響ー”Optics Japan '98 in Okayama pp.97-98(1998年9月18日,岡山).

津村徳道,羽石秀昭,三宅洋一,”肌の2次元分光反射率分布に対する独立成分分析”第4回画像センシングシンポジウム講演論文集,pp.225-228(横浜,1998.5.29).

津村徳道,羽石秀昭,三宅洋一,"肌分光画像の独立成分分析,"第45回応用物理学関係連合講演会  予稿集p.951(東京,1998.3.28). 

津村徳道,羽石秀昭,三宅洋一,”肌画像の独立成分分析に基づく顔色の変化予測”Optics Japan '97 in Sendai pp.105-106(1997年9月30日,仙台).