インペインティング

Inpainting — Grokipedia Fact-checked by Grok 2 months ago Inpainting Ara Eve Leo Sal 1x Image inpainting is a technique in computer vision and image processing for reconstructing missing or damaged regions of an image by synthesizing visually plausible content based on the surrounding context. [1] This process aims to seamlessly fill holes or occlusions while preserving the overall structure , texture, and semantics of the image . [2] The origins of inpainting trace back to traditional art conservation, where restorers fill in deteriorated or missing parts of artworks to restore their completeness, a practice as ancient as visual art itself. In the digital domain , early computational methods emerged in the late 1990s and early 2000s, focusing on partial differential equation (PDE)-based diffusion to propagate isophote directions from known regions into the missing areas. [1] These were followed by exemplar-based approaches, such as the 2004 algorithm by Criminisi et al., which prioritized boundary patches and synthesized fills by matching and copying exemplars from undamaged parts of the image, enabling effective handling of larger gaps. [3] The field advanced dramatically with deep learning in the mid-2010s, shifting from handcrafted priors to data-driven models. Pioneering work by Pathak et al. in 2016 introduced context encoders, a convolutional neural network (CNN) architecture trained to predict missing regions in an unsupervised manner, capturing both appearance and semantic features. [4] Subsequent developments incorporated generative adversarial networks (GANs), as in Iizuka et al.'s 2017 method, which used a fully convolutional network with dilated convolutions and global and local discriminators to ensure both structural consistency and realistic textures across the entire image. [5] More recent innovations, including variational autoencoders (VAEs), transformers, and diffusion models (e.g., Saharia et al., 2022, and subsequent works through 2025), have further improved scalability for large missing regions and video extensions, achieving state-of-the-art perceptual quality. In modern AI image editing tools based on diffusion models—such as Stable Diffusion inpainting, Adobe Generative Fill, and DALL·E's editing features in ChatGPT—inpainting involves masking specific areas, such as faces or backgrounds, and regenerating those parts based on textual prompts or the surrounding context. [6] [2] [7] For instance, to replace a car in a photograph using a tool like Adobe Generative Fill, the process typically involves opening or uploading the photo, selecting or brushing over the area occupied by the existing car to mask it, entering a detailed text prompt such as "a sleek black Tesla Model 3, matching the original lighting, perspective, shadows, and reflections for seamless integration," generating multiple variations, and selecting the most suitable one. Effective prompts are specific about the car's model, color, style, angle, and integration with the scene; in some tools, the prompt may be left blank to allow filling based on surrounding context, or negative prompts can be used to avoid artifacts. [8] Similarly, to apply artistic body paint overlays (such as intricate paint designs on skin) to an existing photograph while preserving the original face unchanged, users can mask only the body regions (excluding the face), provide a prompt describing the desired body paint effects (such as "artistic colorful body paint designs on skin matching the lighting and pose"), and generate the edit. Another example is removing an illuminated sign and a card machine from a photo without deforming the face: users mask only the unwanted objects, and AI-powered tools fill the areas based on surrounding pixels and context, leaving the face untouched and undistorted. Recommended methods include Adobe Photoshop's Remove tool or Generative Fill, where brushing over the objects enables seamless AI filling; Photoroom's Magic Retouch for quick online removal and natural background reconstruction; and Stable Diffusion inpainting, which confines edits to the masked region via masking and optional background prompts. [9] [10] This capability is supported in 2026 by tools including Adobe Firefly Generative Fill (integrated in Photoshop or online) [8] , Pincel.app AI Image Editor [11] , Getimg.ai Inpainting [12] , and OpenArt AI inpainting [13] . These tools use masking to provide precise control over edits, ensuring that unmasked areas like the face remain unchanged. However, the probabilistic generative process of diffusion models prioritizes overall image coherence in anatomy, pose, lighting, style, and expression, which can lead to unintended alterations in non-masked regions. For example, inserting an object like a cup into a hand may cause changes to facial features. Faces are particularly susceptible because of the high detail required for identity preservation and realistic rendering. As of early 2026, several free online AI tools offer accessible options specifically for removing people or objects from photographs using inpainting techniques. Cleanup.pictures is widely regarded as the top free option for high-quality results; it requires no sign-up, offers unlimited uses, but limits exports to 720p resolution with no watermarks. Users brush over the person to remove them, and the AI fills the background. Other strong free options include Fotor AI Person Remover, which provides automatic removal of people without sign-up for basic use and good results for simple edits; Pixelbin AI Object Remover, which supports one-click or brush selection to remove people or objects with no watermarks on HD outputs; NoteGPT AI Object Remover, which is fast and requires no sign-up; and Inpaint Online, which is effective despite limited file size support. Many free tools impose usage limits or resolution caps on their free tiers, and results vary by image complexity. [14] [15] [16] [17] [18] Inpainting finds wide applications in cultural heritage restoration, object removal from photographs, film and video post-production for special effects , digital forensics , and virtual reality scene editing. [2] Challenges persist in maintaining long-range consistency for irregular masks and generating diverse, contextually appropriate outputs, driving ongoing research toward more robust and efficient solutions. [2] Overview Definition and Principles Inpainting is the process of reconstructing missing or deteriorated regions in artworks or images to achieve visual completeness while preserving the original intent and aesthetic qualities. [19] In physical contexts, such as art conservation, it involves manually filling losses with compatible materials to reinstate the pictorial layer without altering undamaged original surfaces. [20] In digital forms, it computationally generates pixel values for damaged areas based on surrounding contextual data, often guided by a mask that delineates the regions to be restored. [21] The core principles of inpainting emphasize seamlessness, where the reconstructed area blends imperceptibly with adjacent regions; context-awareness, drawing from nearby visual cues to infer plausible content; and minimal intervention, ensuring that alterations are limited to necessary areas to avoid over-restoration. [22] [23] Basic concepts include maintaining edge continuity to preserve structural lines and texture matching to replicate surface patterns, all while prioritizing the integrity of the source material . [24] These principles apply across both physical and digital modalities, though physical inpainting relies on manual skill and material compatibility, whereas digital approaches leverage algorithmic propagation of information from intact pixels. [25] A key prerequisite for effective inpainting, particularly in digital workflows, is the accurate definition of masks to isolate damaged areas, allowing targeted reconstruction without affecting preserved content. [26] For instance, consider a simple photograph with a rectangular scratch across a landscape ; inpainting would analyze the surrounding grass and sky textures to fill the gap, ensuring the edges align smoothly and the colors harmonize with the overall scene to restore visual coherence. [23] This restorative technique finds applications in art restoration to preserve cultural artifacts and in photo editing to repair everyday images. [27] Applications Inpainting finds extensive applications in art and cultural heritage preservation, where it is employed to restore damaged paintings and murals by reconstructing missing sections such as tears in canvases or losses in frescoes. For instance, techniques have been applied to repair naturally degraded temple murals, maintaining intrinsic details and avoiding color bias while enhancing historical accuracy. [28] This process improves aesthetics and ensures the longevity of cultural artifacts, as demonstrated in the virtual restoration of historic murals using coordinate-augmented generative adversarial networks. [29] In digital media , inpainting supports photo editing by removing unwanted objects, replacing existing objects with new ones, and seamlessly generating content in masked regions, capabilities integrated into tools such as Adobe Photoshop 's Generative Fill and Adobe Firefly for professional and web-based retouching. [30] [31] For example, to replace a car in a photograph with another vehicle, users can mask the original car area and enter a detailed text prompt describing the replacement, such as "a sleek black Tesla Model 3, matching the original lighting, perspective, shadows, and reflections for seamless integration," then generate variations and select the best result; effective prompts specify model, color, style, angle, and scene fit, while some tools allow blank prompts to infer from surroundings or negative prompts to avoid artifacts. [32] A common application is the removal of people from photographs, whic