404 Lora Helper: A CivitAI Contest Toolkit
🚀 Elevate Your 404 Contest Submissions with Specialized LoRAs
A series of LoRAs designed specifically for the CivitAI 404 Contest.
Each LoRA has been trained with the first ~800 image submissions from the contest, offering diverse ways to enhance your entries.
🌟 Available LoRAs:
1️⃣ LoRA1 - The Standard Bearer
• Trained with CivitAI's trainer on 760 images
• Learning rate: 0.0005, Epoch: 16, Steps: 3200
• Optimizer: AdamW8bit, Base model version: sdxl_base_v1-0
2️⃣ LoRA2 - Lycoris FULL Spectrum
• Featuring a variety of algorithms from the Lycoris FULL suite
• Modules include LohaModule, LoConModule, FullModule, and LokrModule
• Tailored adjustments for both UNet and Text Encoder components
module type table: {'LohaModule': 176, 'LoConModule': 150, 'FullModule': 26, 'LokrModule': 700} enable_conv = true # UNet Target Modules and Names unet_target_module = ["Transformer2DModel", "ResnetBlock2D", "Downsample2D", "Upsample2D"] unet_target_name = ["conv_in", "conv_out", "time_embedding.linear_1", "time_embedding.linear_2"] # Text Encoder Target Modules and Names text_encoder_target_module = ["CLIPAttention", "CLIPMLP"] text_encoder_target_name = [] # "token_embedding" not supported # Module Algorithm Map module_algo_map = { "CrossAttention": { # Attention Layer in UNet "algo": "lokr", "dim": 100000000000, "factor": 64 }, "FeedForward": { # MLP Layer in UNet "algo": "lokr", "dim": 100000000000, # Trigger full matrix "factor": 6 }, "ResnetBlock2D": { # ResBlock in UNet "algo": "lora", "dim": 64, "alpha": 1, "use_tucker": true, # Use tucker decomposition for convolution "factor": 8 }, "CLIPAttention": { # Attention Layer in TE "algo": "loha", "dim": 32, "alpha": 1 }, "CLIPMLP": { # MLP Layer in TE "algo": "lora", "dim": 64, # Trigger full matrix "alpha": 1 } }
3️⃣ LoRA3 - The Fusion Quartet
• A dynamic blend of four different LoRAs
• Network dimensions and alpha dynamically resized for nuanced results
• A unique approach