6 Commits

Author	SHA1	Message	Date
Raphael Walker	61b50720d0	Add support for attention masking in Flux (#5942) ... * fix attention OOM in xformers * allow passing attention mask in flux attention * allow an attn_mask in flux * attn masks can be done using replace patches instead of a separate dict * fix return types * fix return order * enumerate * patch the right keys * arg names * fix a silly bug * fix xformers masks * replace match with if, elif, else * mask with image_ref_size * remove unused import * remove unused import 2 * fix pytorch/xformers attention This corrects a weird inconsistency with skip_reshape. It also allows masks of various shapes to be passed, which will be automtically expanded (in a memory-efficient way) to a size that is compatible with xformers or pytorch sdpa respectively. * fix mask shapes	2024-12-16 18:21:17 -05:00
a-One-Fan	a178e25912	Fix Flux FP64 math on XPU (#4210)	2024-08-05 01:26:20 -04:00
comfyanonymous	48eb1399c0	Try to fix mac issue.	2024-08-01 13:41:27 -04:00
comfyanonymous	f2b80f95d2	Better Mac support on flux model.	2024-08-01 13:10:50 -04:00
comfyanonymous	8d34211a7a	Fix old python versions no longer working.	2024-08-01 09:57:20 -04:00
comfyanonymous	1589b58d3e	Basic Flux Schnell and Flux Dev model implementation.	2024-08-01 09:49:29 -04:00