Control Layers (Edges/Depth)

Control Layers are a powerful feature in Fater that allow you to significantly influence the structure, composition, and form of images generated by specific AI models. Instead of relying solely on a text prompt, you can provide a visual guide in the form of an Edges map or a Depth map.

Models designed for "Controlled" generation (found under the "Generate" or "Edit" categories with a "Controlled" subcategory in the Model Selector) can interpret these Control Layers to create results that closely adhere to the provided visual structure.


What are Control Layers?

Control Layers are regular image layers within your project that you designate as having a special purpose for these AI models.

  1. Edges Map (Sometimes called Canny):

    • What it is: A black and white image where white lines represent the key edges, outlines, or contours of a desired subject or scene. Black/Transparent areas represent empty space or areas without defined edges.

    • How it's used: The AI model will try to generate an image where the main forms and structures align with the white edges in your Edges map layer. It's excellent for defining the overall composition, the shape of objects, or architectural outlines.

    • Creating an Edges Map:

      • You can prepare an Edges map externally and upload it as a layer.

      • Fater provides a tool in the Inpaint Toolbar (CPU icon) to Generate an Edges map from your existing visible layers.

      • You can also manually draw white lines on a black layer using the Pencil Tool if you need very specific edge guidance.

  2. Depth Map:

    • What it is: A grayscale image where different shades of gray represent varying distances from the viewer. Lighter shades (white) are closer, and darker shades (black) are further away.

    • How it's used: The AI model uses the depth information to understand the 3D spatial arrangement of the scene, influencing how objects are placed, their relative sizes, and potentially effects like depth of field. This is useful for creating images with a strong sense of perspective and three-dimensionality.

    • Creating a Depth Map:

      • You might generate depth maps using 3D software and import them as layers.

      • Fater provides a tool in the Inpaint Toolbar (Mountain icon) to Generate a Depth map from your existing visible layers.


How to Use Control Layers

  1. Prepare or Generate Your Control Layer: Create or import your Edges map or Depth map as a standard image layer.

  2. Designate it as a Control Layer:

    • In the Layers Tab, find your Edges/Depth map layer.

    • Right-click on the layer (or use its "More Options" menu if available) and select "Set as Control Layer."

    • Alternatively, drag the layer into the dedicated "Control Layers" section at the bottom of the Layers Tab (this section appears when a "Controlled" AI model is selected).

    • You can also set the "Preprocessed Type" (Edges or Depth) for the layer directly in the Control Layers section.

  3. Select a "Controlled" AI Model:

    • In the Left Sidebar's Model Selector, choose an AI model that supports Control Layers (e.g., a model from the "Generate" or "Edit" category with a "Controlled" subcategory, and a matching "Control Type" like "Contour" for Edges or "Depth" for Depth maps).

  4. Configure Model Parameters: Adjust settings like Prompt, Steps, Guidance in the Left Sidebar. Some models might have specific parameters for how strongly to adhere to the Control Layer.

  5. Write Your Prompt: Your text prompt will still guide the content, style, and details of the generation, while the Control Layer guides the structure.

  6. Generate: Click the "Generate" button in the Floating Prompt Area.

The AI will then attempt to generate an image that respects both your text prompt and the visual guidance from your active, visible Control Layer(s).


Important Notes:

  • Visibility: Every Control Layers in the active Layer Workspace will be used by the AI, even those with visibility turned off.

  • One Type at a Time (Usually): Typically, you'll use either an Edges map or a Depth map at one time, depending on what the selected AI model is designed to work with.

  • Experimentation: The interplay between your prompt and the Control Layer is key. You may need to experiment to get the perfect balance.

Control Layers offer a sophisticated way to direct AI image generation with a higher degree of structural precision.

Last updated