NOTICE: from 2024.02.01 on, updates for earlier versions (UE 5.0) will be available on our Github repo iiijasdf/ChatAvatar-Plugin-for-UE4: Official reposity of ChatAvatar Plugin for UE4 (github.com) . Please kindly check the Release page and install the plugin following the Readme in the repo.

ChatAvatar Plugin seamlessly connects UE with ChatAvatar (Text/Image to 3D Avatar tools, hyperhuman.deemos.com), allowing for one-click import of digital human asset packages generated by ChatAvatar. With a well-designed shader graph and options for facial and body control, it offers efficient and diverse character generation beyond MetaHuman. As an added bonus, we are offering some tokens as a gift for every new registered user to freely experience our services.

ChatAvatar enables the creation of hyper-realistic 3D facial assets with PBR textures through AI-driven conversations(text-to-avatar). Combining diffusion technology and our Production-Ready Facial Assets dataset, CG-friendly assets are generated that meet industry standards, usable in Unity, UE, Maya. This game-changing tech offers new horizons for immersive virtual experiences.

Developed by DeemosTech, ChatAvatar is a new technology that utilizes a proprietary diffusion model and Production-Ready Facial Assets dataset to generate hyper-realistic, 3D facial assets with PBR textures through text-to-avatar technology. These assets meet industry standards and can be directly used in popular software like Unity, Unreal Engine, and Maya. It enables users to create 3D facial assets compatible with CG pipelines, with desired shapes, textures, and fine-grained animation capabilities, using just one sentence.

The technology behind ChatAvatar uses a coarse-to-fine scheme to generate neutral facial geometry with a unified topology and employs a selection strategy in the CLIP embedding space for coarse geometry. It optimizes detailed displacements and normals using Score Distillation Sampling (SDS) from the generic Latent Diffusion Model (LDM). For appearance generation, a dual-path mechanism combines the generic LDM with a novel texture LDM, ensuring diversity and textural specification in the UV space. The two-stage optimization performed by SDS provides compact priors for fine-grained synthesis, and learns the mapping from the compact latent space into physically-based textures like diffuse albedo, specular intensity, and normal maps. Follow our twitter @deemostech to know more about ChatAvatar.

[Update 20240229]: Fixed known bugs.

[Update 20240201]: Updated importing process, and material setting for later update on the main website. Please notice that this update is ONLY ON ENGINE VERSION 5.1 - 5.3 in Epic Launcher, for update on earlier versions (5.0), please refer to our Github repo iiijasdf/ChatAvatar-Plugin-for-UE4: Official reposity of ChatAvatar Plugin for UE4 (github.com) . Happy Chinese New Year!

[Update 20230830]: Updated texture resources used by the plugin, and improved display effect of the default material.

(Update 20230801): ChatAvatar Plugin for UE4.x are also ready! Please kingly check out this reposity iiijasdf/ChatAvatar-Plugin-for-UE4: Official reposity of ChatAvatar Plugin for UE4 (github.com) for detailed information :)