CVPR '26 Highlight: Tsinghua University Creates Mirror Illusion Art Generator, Supports 3D Printing

marsbitPublished on 2026-07-24Last updated on 2026-07-24

Abstract

Researchers from Tsinghua University have developed AutoMIA, an AI system that automatically generates mirror illusion art. Given two arbitrary input images, AutoMIA designs a 3D object that, when placed in front of a mirror, displays one image when viewed directly and the other as its mirror reflection. The system models this as a dual-view inverse design problem, using a voxel representation and differentiable volume rendering to optimize for both shape and color fidelity from two specified viewpoints. Key innovations include Projection-Aligned Connectivity pruning (PAC) to remove noise, Position-Weighted Adaptive denoising (PWA), Internal Voxel Protection (IVP) to prevent structural fractures for 3D printing, and Shape-Color Decoupled optimization (SCD) to balance geometric and color learning. Experiments show AutoMIA outperforms prior methods like Shadow Art in smoothness, noise reduction, and shape consistency, while remaining computationally efficient (76 seconds avg. on an RTX 3090). The method supports diverse inputs (letters, logos, emojis, etc.) and successfully transitions from digital simulation to physical artifacts via 3D printing, demonstrating practical applications in computational art and fabrication. This work, a CVPR 2026 Highlight and Efficient CVPR award winner, lowers the barrier for creating complex mirror illusion art.

[Introduction] The AutoMIA system developed by the Tsinghua University team can transform any two images into 3D artworks with a mirror illusion effect, achieving different visual patterns on the front and mirror-reflected sides, and supporting 3D printing.

First, look at the following two sets of photos: in each set, the left side shows the front pattern of an object placed in front of a mirror, and the right side shows its reflection in the mirror. Interestingly, the front view and the mirror reflection appear to be two almost completely unrelated things—in the first set, the front reads 'CVPR', but in the mirror it becomes '2026'; in the second set, the front shows a 'mountain', while the mirror shows 'water'.

Their contours, colors, and even meanings don't match, as if creating an 'illusion'.

The reason behind this is that it originates from a specially designed 3D object that exploits the 'symmetry completion effect' of the human visual system to create an illusion, a phenomenon known as mirror illusion art.

Researchers meticulously design the three-dimensional geometry and surface color, allowing a real object to present drastically different visual effects when viewed directly and when viewed in a mirror.

Below are two corresponding 'explanation' videos.

Traditionally, the design of such artworks requires clever conceptualization by professional artists, along with extensive complex manual design experience and mathematical calculations, making the creation of such art highly inaccessible for the average person.

So, is there a method that can automatically assist people in completing such artistic design, allowing ordinary individuals to transform their inspiration into artworks?

Recently, a research team from Tsinghua University and other institutions proposed AutoMIA, an AI-driven method for automatically generating mirror illusion art. Users only need to arbitrarily specify two images, corresponding to the patterns in front of the mirror and in the mirror respectively, and AutoMIA can automatically complete the 3D artwork design, supporting direct 3D printing to create the artwork.

Paper link: http://arxiv.org/abs/2607.02015

Code link: https://github.com/zxp555/AutoMIA

The paper has been accepted by CVPR 2026 and selected as a Highlight Paper. Due to its high computational efficiency, this work also received the Efficient CVPR Award.

Research Background

Optical illusion art has long been an important topic at the intersection of art, psychology, and computer vision. Common 2D illusions include hybrid images, visual metamorphosis images, etc.; 3D illusions include Shadow Art, Multi-View Wire Art, etc.

These methods typically rely on specific viewpoints, projections, or shadow relationships to make the same object appear different under various observation conditions.

Mirror Illusion Art is a more specialized 3D illusion: when a real object is placed in front of a mirror, the observer sees one pattern from the front and another pattern in the mirror.

Previously, related designs often required extensive manual derivation and adjustment, and mostly focused on shape design, making it difficult to handle colored patterns simultaneously. Directly borrowing methods from Shadow Art could easily produce surface noise, floating background patches, or internal fractures, affecting visual quality and physical fabrication.

Therefore, the authors posed a direct question: Can AI be made to automatically design such mirror illusion objects? Given two target images, can the system simultaneously optimize the 3D shape and color so that the same object presents two specified appearances from two viewpoints?

Research Methodology

AutoMIA models this problem as a dual-view inverse design task. The system represents the 3D object using voxels, each containing density and color information. Through differentiable volume rendering, the object is rendered from two specified viewpoints, and the rendering results are compared with the two target images.

The optimization objective includes both shape similarity and color similarity, enabling the generated object to meet contour requirements while also producing the colors of the target images.

During actual optimization, the authors identified four key issues: surface noise, background noise, internal fractures, and imbalance between shape and color optimization.

To address these, the paper proposes four core mechanisms.

The first is PAC, Projection-Alignment-based Connected Component Pruning. The system projects connected components from the current voxel grid onto the two viewpoints one by one, scores them based on their overlap with the target mask and background spillover, retaining structures that genuinely contribute to the target pattern and removing floating or ineffective noise.

The second is PWA, Position-based Weight-Adaptive Noise Suppression. It adjusts the background penalty weight based on the pixel's distance to the target region, imposing stronger penalties on erroneous projections far from the target pattern, thereby reducing background noise in distant areas.

The third is IVP, Internal Voxel Protection. Since the supervision images primarily constrain the object's surface, internal voxels are prone to being erroneously weakened during optimization, leading to structural fractures. IVP identifies internal voxels and applies a lower density limit, helping to maintain object integrity, which is particularly important for subsequent 3D printing.

Finally, SCD, Shape-Color Decoupled Optimization. AutoMIA divides the training process into stages of shape optimization, joint shape-color optimization, and color refinement, avoiding premature color interference with geometric structure and reducing conflicts between colors from different viewpoints.

Experimental Results

The paper validates AutoMIA using various types of 2D images as input, including English letters, numbers, Chinese characters, geometric patterns, emojis, cartoon patterns, and logos.

In experiments, the authors compared AutoMIA with methods like Shadow Art (SA) and Shadow Art Revisited (SAR). Since baseline methods mainly support shape optimization, the comparison focused on metrics like smoothness, noise level, and shape consistency.

Results show that AutoMIA achieves significant advantages in reconstruction quality. According to the paper, AutoMIA's Smoothness Level (SL) reaches 0.989, Noise Level (NL) drops to 0.049, and Shape Similarity (SS) reaches 0.931. In contrast, SA and SAR show clear gaps in shape consistency and noise control.

Meanwhile, AutoMIA's average design time on a single RTX 3090 is only 76 seconds, with an average GPU memory usage of about 2.6GB, demonstrating high computational efficiency.

Visual results show that SA and SAR are prone to issues like floating noise, uneven surfaces, or internal fractures, making it difficult to form stable, complete solid structures.

In contrast, results generated by AutoMIA not only better match the contours of the two target images but also reconstruct the colored surfaces of the input images, giving clear visual semantics to both the front and mirror views.

For mirror illusion art, this point is crucial: if the shape is correct but colors are chaotic, or if colors are close but the structure is fragmented, it ultimately fails to create a convincing illusion effect.

Ablation studies further indicate that PAC, PWA, IVP, and SCD all contribute to the final result. Removing any module leads to a decline in reconstruction quality. For example, removing PAC significantly increases noise and reduces shape consistency; removing SCD affects shape, color, and smoothness.

This indicates that AutoMIA does not rely solely on voxel optimization but incorporates systematic design to address problems specific to mirror illusion art creation.

The following provides a set of examples from the digital world. As can be seen in the figures, mirror illusion objects with good rendering effects are produced in the Blender digital simulation software.

In addition to digital results, the paper also showcases several physical fabrication cases. The authors convert the optimized voxel models into 3D-printable formats and fabricate real objects via 3D printing.

In photos of the physical objects, the front and mirror sides present different patterns, demonstrating that the method can successfully transition from digital design to the physical world.

Users can utilize this method to create various types of artworks.

Conclusion and Outlook

The researchers proposed AutoMIA, an AI design system for automatically generating Mirror Illusion Art.

Starting from two 2D images, it can jointly optimize the shape and color of a 3D object. Through mechanisms like PAC, PWA, IVP, and SCD, it enhances result quality, making the generated objects smoother, more complete, and more suitable for physical fabrication.

This work showcases new possibilities for AI in computational design and artistic creation: it can not only generate images but also design 3D illusion objects with physical realizability. An object has only one form in reality but can present another visual identity in the mirror. This effect of 'inconsistency between the front and the mirror' also provides new research directions for visual perception, inverse graphics, and digital fabrication.

About the Authors

The authors of the paper, in order, are: Zhu Xiaopei, Tsinghua University Shuimu Scholar, collaborating supervisor Professor Zhu Jun; Li Zeyuan (co-first author), undergraduate student at Huazhong University of Science and Technology; and Tsinghua University Professor Zhu Jun and Associate Professor Hu Xiaolin (corresponding author).

Reference: http://arxiv.org/abs/2607.02015

This article is from the WeChat public account "Xin Zhi Yuan," author: Xin Zhi Yuan; editor: LRST

Related Questions

QWhat is the main contribution of the AutoMIA system developed by the Tsinghua University team?

AThe main contribution of the AutoMIA system is the automation of Mirror Illusion Art design. It allows users to input any two images, representing the front view and the mirrored reflection view, and automatically generates the corresponding 3D model's geometry and surface color. This process enables a single physical object to display two completely different visual patterns when viewed directly and in a mirror. The system is efficient, produces high-quality, manufacturable results, and supports direct 3D printing.

QWhat are the four core mechanisms proposed in AutoMIA to address key optimization problems?

AAutoMIA proposes four core mechanisms to address optimization challenges: 1) PAC (Projection-Aligned Component pruning): Prunes noise by evaluating connected components based on their projection alignment with target masks. 2) PWA (Position-Weighted Adaptive denoising): Suppresses background noise by applying distance-aware penalization weights. 3) IVP (Internal Voxel Protection): Prevents structural断裂 by enforcing a density lower bound on internal voxels, crucial for 3D printing. 4) SCD (Shape-Color Decoupled optimization): Employs a phased training strategy (shape-only, joint shape-color, color refinement) to balance geometry and color optimization.

QHow does the performance of AutoMIA compare to baseline methods like Shadow Art (SA) and Shadow Art Revisited (SAR)?

AAutoMIA significantly outperforms baseline methods like Shadow Art (SA) and Shadow Art Revisited (SAR) in reconstruction quality. Quantitative metrics show AutoMIA achieves a Smoothness Level (SL) of 0.989, Noise Level (NL) of 0.049, and Shape Similarity (SS) of 0.931, indicating superior surface smoothness, lower noise, and higher shape consistency with target images. Visual results confirm that SA and SAR often produce floating noise, uneven surfaces, or internal断裂, making their outputs unsuitable for stable physical fabrication, whereas AutoMIA generates complete, smooth, and color-accurate 3D structures.

QWhat is the practical application outcome demonstrated for the AutoMIA system?

AA key practical application outcome demonstrated for AutoMIA is the successful transition from digital design to physical artifact via 3D printing. The paper showcases multiple real-world examples where the optimized voxel models are converted into 3D printable formats and then physically manufactured. Photographs of these printed objects confirm that they successfully exhibit the intended mirror illusion effect: the object's front view and its reflection in a mirror display two distinct, user-specified patterns, validating the system's viability for creating tangible art and design pieces.

QWhat recognition did the AutoMIA research receive at CVPR 2026?

AThe research on AutoMIA was accepted by CVPR 2026 and was recognized as a Highlight Paper. Additionally, due to its high computational efficiency, the work was awarded the Efficient CVPR prize.

Related Reads

The Verdict in Choi Tae-won's Divorce Case: Revealing the Inheritance Undercurrent Behind SK Hynix's Trillion-Won Empire

SK Group Chairman Chey Tae-won's high-profile divorce case, involving a record 1.38 trillion won settlement, has drawn attention to the succession plans for Korea's second-largest conglomerate, especially its crown jewel, SK hynix. Unlike traditional chaebol scripts centered on the eldest son, Chey's three children from his marriage to former President Roh Tae-woo's daughter, Roh Soh-yeong, are carving distinct, non-traditional paths. Eldest daughter Chey Yun-jung (b. 1989) is seen as the most evident successor. With a scientific and consulting background, she holds executive roles at SK bioscience and SK Inc.'s growth support department, focusing on future strategy and biopharma. Her marriage is to an AI infrastructure entrepreneur, not a traditional business alliance. Second daughter Chey Min-jung (b. 1991) took a unique route, voluntarily serving as a South Korean naval officer, including an anti-piracy deployment. She later worked on policy and strategy for SK hynix in Washington D.C. before co-founding an AI-driven healthcare startup. She married a former U.S. Marine Corps officer, connecting her to U.S. defense and policy circles—networks crucial for a global semiconductor giant. The only son, Chey In-geun (b. 1995), who studied physics like his father, worked briefly at SK E&S before joining McKinsey. Despite fitting the traditional "heir" profile as the eldest son, he remains silent and holds no public position or shares in SK, suggesting the old succession playbook is obsolete. As SK hynix's valuation soars, becoming a geopolitical asset in the AI era, the heirs' legitimacy is no longer automatic. They must prove themselves in fields like AI biotech, global policy, and strategic consulting. Their marriages also reflect new elite networks in tech and defense, not old political alliances. Their inheritance is the complex challenge of navigating a globalized, tech-driven world, not just a corporate throne.

marsbit10h ago

The Verdict in Choi Tae-won's Divorce Case: Revealing the Inheritance Undercurrent Behind SK Hynix's Trillion-Won Empire

marsbit10h ago

From OpenSea to OpenRouter: Is Alex Atallah Repeating His 'Exit at the Peak' Playbook?

From OpenSea to OpenRouter: Is Alex Atallah Repeating His "Exit at the Peak" Playbook? According to the Wall Street Journal, payments giant Stripe is in talks to acquire the AI model aggregation platform OpenRouter in a potential deal valuing the company near $100 billion. This would mark founder Alex Atallah's second creation of a company reaching a $100 billion valuation, following his co-founding of NFT marketplace OpenSea. OpenRouter, founded just over three years ago, has grown rapidly by acting as a unified gateway for developers to access over 400 AI models. It currently has about 10 million users and processes over 200 trillion tokens monthly. While the platform's annualized revenue is around $50 million, its valuation has skyrocketed from $1.3 billion in March 2026. The potential acquisition by Stripe, a company OpenRouter's founder once likened it to, represents a major expansion into AI infrastructure for the payments leader. This move echoes Atallah's previous timing with OpenSea, where he departed before the NFT market's significant downturn. For OpenRouter, selling now may be strategic. Despite its scale, its business model—charging a 5-5.5% fee on AI inference calls—faces pressure from competition, open-source models, and potential price wars among model providers, limiting its profitability narrative for an IPO. A key asset for potential acquirers like Stripe is OpenRouter's vast repository of real-world AI usage data, which offers unique insights into model performance and developer preferences that are difficult to replicate. Whether this potential deal signifies a new valuation benchmark for AI infrastructure or another market peak signal remains to be seen.

链捕手11h ago

From OpenSea to OpenRouter: Is Alex Atallah Repeating His 'Exit at the Peak' Playbook?

链捕手11h ago

Trading

Spot
活动图片