(Translated by https://www.hiragana.jp/)
Add a `TiledStableDiffusionRefineInvocation` (for upscaling workflows) by RyanJDick · Pull Request #6626 · invoke-ai/InvokeAI · GitHub
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a TiledStableDiffusionRefineInvocation (for upscaling workflows) #6626

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

RyanJDick
Copy link
Collaborator

Summary

Adds a TiledStableDiffusionRefineInvocation node with the following characteristics:

  • The node applies the following sequence:
    • Split tiles in image space
    • VAE encode
    • Denoise
    • VAE decode
    • Merge tiles in image space
  • The same process can be achieved in a workflow with existing nodes. The primary reason for creating this standalone node is to avoid the need for an 'iterate' node to achieve this workflow. Iterate nodes have some limitations, and are not currently permitted in the hosted InvokeAI app.
  • The TiledMultiDiffusionDenoiseLatents node serves a similar purpose in upscaling workflows. Here are the rough tradeoffs between them:
    • MultiDiffusion upscaling requires using a tiled VAE, which can cause some discoloration issues
    • MultiDiffusion is less prone to visible seams.
    • TODO: Speed comparison

TODO: Add comparison images.

Related Issues / Discussions

QA Instructions

Merge Plan

Checklist

  • The PR has a short but descriptive title, suitable for a changelog
  • Tests added / updated (if applicable)
  • Documentation added / updated (if applicable)

@github-actions github-actions bot added python PRs that change python files invocations PRs that change invocations labels Jul 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
invocations PRs that change invocations python PRs that change python files
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant