StageDesigner
¹Fudan University, ²Shanghai University, ³Shanghai Theatre Academy
📧 zxgan23@m.fudan.edu.cn, mtli@shu.edu.cn, yegn@fudan.edu.cn, {chenruhua, zhongxia.ji, huzuo}@sta.edu.cn
Paper
arXiv
Code
Dataset
Abstract
In this work, we introduce StageDesigner, the first comprehensive framework for artistic stage generation using large language models (LLMs) combined with layout-controlled diffusion models. Given the professional requirements of stage scenography, StageDesigner simulates the workflows of seasoned artists to generate immersive 3D stage scenes. Specifically, our approach is divided into three primary modules: Script Analysis, which extracts thematic and spatial cues from input scripts; Foreground Generation, which constructs and arranges essential 3D objects; and Background Generation, which produces a harmonious background aligned with the narrative atmosphere and maintains spatial coherence by managing occlusions between foreground and background elements. Furthermore, we introduce the StagePro-V1 dataset, a dedicated dataset with 276 unique stage scenes spanning different historical styles and annotated with scripts, images, and detailed 3D layouts, specifically tailored for this task. Finally, evaluations using both standard and newly proposed metrics, along with extensive user studies, demonstrate the effectiveness of StageDesigner, showcasing its ability to produce visually and thematically cohesive stages that meet both artistic and spatial coherence standards.
Framework
StageDesigner is a novel framework for generating immersive artistic stage designs from theater scripts. It combines large language models (LLMs) with layout-controlled diffusion models to create 3D stage layouts, aligning foreground and background elements seamlessly. Our approach empowers both general users and professional designers with AI-driven tools for scenography.
StagePro-V1 Dataset
The StagePro-V1 dataset, created specifically for this project, spans decades of stage design and includes richly annotated scripts, stage images, and 3D layouts. The dataset features:
- 276 unique stage productions from the 1940s to the 2020s.
- Detailed script annotations with spatial and thematic cues.
- Diverse artistic styles, reflecting real-world scenography practices.
Below are some stage examples from the dataset:
 |
 |
|---|---|
| The Cruel Game | Beyond the Horizon |
 |
 |
|---|---|
| Lend me a Tenor | Shooting Star |
Generated Stages
Below are examples of outputs generated by StageDesigner, including cohesive 3D layouts and atmospherically aligned backgrounds:
 |
 |
|---|---|
| Favoritism | Withered Trees Blossom Again |
 |
 |
|---|---|
| The Godfather | The Diary of Anne Frank |
More details are coming soon