首页 > 综合

【Lora测试16】用stable diffusion做自己的fufu玩偶吧!

发布时间:2023-07-08 16:17:23 丨 来源:哔哩哔哩 丨

前言

对fufu LoRa的全面评测

FuFu一词,指的是在虚拟歌姬初音未来的周边中,由三月八日老师绘制并由SEGA出品的玩偶。其fufu的名称则取自玩偶名字fuwafuwa中的简称。除却初音未来iP形象可以被称为fufu,所有以这种呆萌形象画风出现的玩偶都可以称之为fufu。不过看着傻乎乎的fufu价格却不便宜,贫穷使人进步,学会SD自己生成几只过过瘾还是没问题的。


(资料图片)

而本次测试的fufu LoRa模型,就能将任何形象都转化为fufu。

下载链接

大模型链接:

链接:/s/1qucE1B4DyaDRvkn_ZXuJng?pwd=91h1

提取码:91h1

Lora/Embedding链接:

链接:/s/1Mf0schQoyCm_hf8uOsHg7A?pwd=dzli

提取码:dzli

图包链接:

链接:/s/15RJF3HT2s0ycpEsdGOQeCg?pwd=kof2

提取码:kof2

交流群

qq群:697080799

微信群:

测试中使用的模型

CKPT大模型

abyssorangemix2SFW_abyssorangemix2Sfw

anything-v5

Basil mix

cetusMix_v4

Chilloutmix

CounterfeitV30_v30

ghostmix_v20Bakedvae

manmaruMix_v10

perfectWorld_v4Baked

realisticVision

revAnimated_v11

sxzLuma_098VAE

Lora模型

(测试lora本体)

blindbox_V1Mix

zhongliLoraCollection_zhongliHard

kleeGenshinImpact_kleeGenshinImpact

Embedding模型

ng_deepnegative_v1_75t

EasyNegative

实际使用案例

大模型:CounterfeitV30_v30

Lora  权重:

嵌入式:EasyNegative  权重:1

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image,

负:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:),looking at viewer,(NSFW:),naked,

Steps: 35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3698942781, Size: 600x800

大模型:anything-v5-PrtRE

Lora  权重:

嵌入式:EasyNegative  权重:1

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

(masterpiece, best quality:), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1gril,white armor,knight,street,red hair,full body, chibi,wanju/(fufu/),standing,

负:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:),looking at viewer,(NSFW:),naked,

Steps: 35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3993299175, Size: 600x800

大模型:CounterfeitV30_v30

Lora  权重:

嵌入式:EasyNegative  权重:1

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

(masterpiece, best quality:), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1gril,green eyes, bony meat, eating, happy, bonfire, night, moonlight, beast ears,smile,full body, chibi,wanju/(fufu/),standing,

负:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:),looking at viewer,(NSFW:),naked,

Steps: 35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 27581122, Size: 600x800

大模型:CounterfeitV30_v30

Lora  权重:

嵌入式:EasyNegative  权重:1

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

(masterpiece, best quality:), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1gril,pointy ears,library,reading,red hair, magic,beast ears,smile,fox Tail,

full body, chibi,wanju/(fufu/),standing,

负:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:),looking at viewer,(NSFW:),naked,

Steps: 35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 778860232, Size: 600x800

大模型:CounterfeitV30_v30

Lora 权重:

嵌入式:EasyNegative  权重:1

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

(masterpiece, best quality:), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1gril,pointy ears,outdoors,   magic,beast ears,smile,fox Tail,

full body, chibi,wanju/(fufu/),standing,

负:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:),looking at viewer,(NSFW:),naked,

Steps:35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1235833522, Size: 600x800

大模型:CounterfeitV30_v30

Lora  权重:

嵌入式:EasyNegative  权重:1

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

(masterpiece, best quality:), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1gril,outdoors, smile,

full body, chibi,wanju/(fufu/),standing,

PCR, CHIBI

负:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:),looking at viewer,(NSFW:),naked,

Steps: 35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 1814127239, Size: 600x800

提示词对照表

大模型:CounterfeitV30_v30

Loraadd_detail  权重:1

LorakleeGenshinImpact_kleeGenshinImpact  权重:1

Lora 权重:1

嵌入式:EasyNegative  权重:1

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

(masterpiece, best quality:), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1girl,red hat,blonde hair, WANJU\(FUFU\)

负:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:),looking at viewer,

Steps: 35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 609054887, Size: 600x800

对照表

阶段结论

使用这款lora,触发词建议使用以上几个单词作为提示词,尤其是这个点点,虽然只是两个英文句号加一个空格,但能极大的稳定面部的生成,这个提示词的权重可以放到左右。

大模型测试

基础信息

大模型:如下图对照表所示

Lora  权重:

嵌入式:EasyNegative  权重:1

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

(masterpiece, best quality:), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

Candles, Reading, Indoor,1girl, Top Hat,

WANJU\(FUFU\),chibi,hatsune miku,

负:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:),looking at viewer,

Steps: 35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3405368600, Size: 600x800

对照表

一测

二测

阶段结论

这款lora对各种画风的兼容方面表现一般,比较适合二次元画风的大模型,如果要追求还原度,则推荐revanimeted。二测的几款大模型比较推荐用于生成。

兼容性测试

人物lora测试(可莉)

基础信息

大模型:CounterfeitV30_v30

Lora  权重:

LorakleeGenshinImpact_kleeGenshinImpact  权重:

嵌入式:EasyNegative  权重:

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

(masterpiece, best quality:), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1girl,red hat,blonde hair,standing,looking at viewer, . . ,

WANJU\(FUFU\),chibi,

负:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:),looking at viewer,

Steps: 35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3187457933, Size: 600x800

对照图

人物lora测试(钟离)

基础信息

大模型:CounterfeitV30_v30

Lora  权重:1

LorazhongliLoraCollection_zhongliHard  权重:

嵌入式:EasyNegative  权重:

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

(masterpiece, best quality:), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

1boy, solo, male focus, zhongli (genshin impact), jewelry, earrings, single earring, bangs, brown hair, long hair, hair between eyes, necktie, closed mouth, multicolored hair, tassel, tassel earrings, shirt, jacket, looking at viewer, collared shirt, ponytail, upper body, long sleeves, white necktie, gradient hair, black hair, orange eyes, formal, vest, coat, brown vest, suit,standing,

. . ,

WANJU\(FUFU\),chibi,

负:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:),looking at viewer,

Steps: 35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3187457933, Size: 600x800

对照图

画风lora测试(盲盒)

基础信息

大模型:CounterfeitV30_v30

Lora  权重:

Lorablindbox_V1Mix  权重:

嵌入式:EasyNegative  权重:

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

(masterpiece, best quality:), reflections, extremely detailed, (extremely detailed CG unity 8k wallpaper), cinematic lighting, detailed background,

(1girl:), Top Hat, blindbox,

. . ,

WANJU\(FUFU\),chibi,

负:

paintings, sketches, (worst quality:2), (low quality:2), (normal quality:2), lowres, duplicate, mutated hands, mutated legs, (blurry:), (bad anatomy:), bad proportions, extra limbs, more than 2 nipples, extra legs, fused fingers, missing fingers, jpeg artifacts, signature, watermark, username, artist name, heterochromia, muscular legs, monochrome, grayscale, skin spots, acnes, skin blemishes, age spot, skin spots, acnes, logo, badhandv4, easynegative, cropped image, patreon,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, ng_deepnegative_v1_75t, lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry,(Tiptoe:),looking at viewer,

Steps: 35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 3659272366, Size: 600x800

对照图

阶段结论

这款lora与人物兼容性适配的很不错,效果理想。不过要注意之前提到的污染问题,可能会让人物形象倾向初音未来的服装,也可能让发色偏向葱绿色,需要小心调试权重或者多试几次。

这里推荐fufuLora权重~,人物Lora以上

图生图测试

基础信息

大模型:CounterfeitV30_v30

Lora  权重:

嵌入式:EasyNegative  权重:

嵌入式:ng_deepnegative_v1_75t  权重:1

正:

masterpiece, best quality,

WANJU\(FUFU\),chibi,hatsune miku,

1girl,black business suit,Arms folded across the chest,smile,short hair, black hair,

负:

NSFW,lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, lowres, text, cropped, worst quality, low quality, normal quality, jpeg artifacts, signature, watermark, username, blurry, text, signature, watermark, simple background, toony, dated, low res, line art, flat colors

Steps: 35,Sampler: DPM++ SDE Karras, CFG scale: 7, Seed: 2605847031, Size: 608x880

对照表

阶段结论

图生图方面,由于身体比例变化大,这里不做推荐,在高重绘幅度下会有些微妙的效果,说不清是提取了原图元素还是只是单纯对提示词生效。总之不太推荐使用。

关键词:

客户端中查看
手机中查看

滚动新闻

更多滚动

更多茶叶