Fix low_cpu_mem_usage Flag Conflict with DeepSpeed Zero 3 in `from_…

…pretrained` for Models with `keep_in_fp32_modules`" (huggingface#27762)

Fix `from_pretrained` Logic
for `low_cpu_mem_usage` with DeepSpeed Zero3

src/transformers/modeling_utils.py

@@ -3466,7 +3466,7 @@ def from_pretrained(
 
         # Check first if we are `from_pt`
         if use_keep_in_fp32_modules:
-            if is_accelerate_available():
+            if is_accelerate_available() and not is_deepspeed_zero3_enabled():
                 low_cpu_mem_usage = True
             keep_in_fp32_modules = model._keep_in_fp32_modules
         else: