Model/Pipeline/Scheduler description
JoyAI-Image is a unified multimodal foundation model for image understanding, text-to-image generation, and instruction-guided image editing. It combines an 8B Multimodal Large Language Model (MLLM) with a 16B Multimodal Diffusion Transformer (MMDiT). A central principle of JoyAI-Image is the closed-loop collaboration between understanding, generation, and editing. Stronger spatial understanding improves grounded generation and contrallable editing through better scene parsing, relational grounding, and instruction decomposition, while generative transformations such as viewpoint changes provide complementary evidence for spatial reasoning.
The github homepage: https://github.com/jd-opensource/JoyAI-Image
The released JoyAI-Image-Edit weights: https://huggingface.co/jdopensource/JoyAI-Image-Edit
Open source status
Provide useful links for the implementation
No response
Model/Pipeline/Scheduler description
JoyAI-Image is a unified multimodal foundation model for image understanding, text-to-image generation, and instruction-guided image editing. It combines an 8B Multimodal Large Language Model (MLLM) with a 16B Multimodal Diffusion Transformer (MMDiT). A central principle of JoyAI-Image is the closed-loop collaboration between understanding, generation, and editing. Stronger spatial understanding improves grounded generation and contrallable editing through better scene parsing, relational grounding, and instruction decomposition, while generative transformations such as viewpoint changes provide complementary evidence for spatial reasoning.
The github homepage: https://github.com/jd-opensource/JoyAI-Image
The released JoyAI-Image-Edit weights: https://huggingface.co/jdopensource/JoyAI-Image-Edit
Open source status
Provide useful links for the implementation
No response