Python 安装库报错 “python setup.py egg_info did not run successfully.“

文章目录

• 1. Python 安装库报错
• 2. 问题解决
• 3. 参考

1. Python 安装库报错

有时 Python 用 pip install 安装库的时候会报错，python setup.py egg_info did not run successfully. ，我在安装 deepspeed 报错示例如下：

  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [20 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/private/var/folders/hv/g_8qfj_56k98k8tnpf_58k980000gn/T/pip-install-r4m2v95f/deepspeed_bb04440e1d854d09a2dde2b5d62ad864/setup.py", line 38, in <module>
          from op_builder.all_ops import ALL_OPS
        File "/private/var/folders/hv/g_8qfj_56k98k8tnpf_58k980000gn/T/pip-install-r4m2v95f/deepspeed_bb04440e1d854d09a2dde2b5d62ad864/op_builder/all_ops.py", line 29, in <module>
          builder = get_accelerator().create_op_builder(member_name)
        File "/private/var/folders/hv/g_8qfj_56k98k8tnpf_58k980000gn/T/pip-install-r4m2v95f/deepspeed_bb04440e1d854d09a2dde2b5d62ad864/accelerator/mps_accelerator.py", line 234, in create_op_builder
          builder_class = self.get_op_builder(op_name)
        File "/private/var/folders/hv/g_8qfj_56k98k8tnpf_58k980000gn/T/pip-install-r4m2v95f/deepspeed_bb04440e1d854d09a2dde2b5d62ad864/accelerator/mps_accelerator.py", line 241, in get_op_builder
          from deepspeed.ops.op_builder.cpu import NotImplementedBuilder
        File "/private/var/folders/hv/g_8qfj_56k98k8tnpf_58k980000gn/T/pip-install-r4m2v95f/deepspeed_bb04440e1d854d09a2dde2b5d62ad864/deepspeed/__init__.py", line 21, in <module>
          from . import ops
        File "/private/var/folders/hv/g_8qfj_56k98k8tnpf_58k980000gn/T/pip-install-r4m2v95f/deepspeed_bb04440e1d854d09a2dde2b5d62ad864/deepspeed/ops/__init__.py", line 6, in <module>
          from . import adam
        File "/private/var/folders/hv/g_8qfj_56k98k8tnpf_58k980000gn/T/pip-install-r4m2v95f/deepspeed_bb04440e1d854d09a2dde2b5d62ad864/deepspeed/ops/adam/__init__.py", line 6, in <module>
          from .cpu_adam import DeepSpeedCPUAdam
        File "/private/var/folders/hv/g_8qfj_56k98k8tnpf_58k980000gn/T/pip-install-r4m2v95f/deepspeed_bb04440e1d854d09a2dde2b5d62ad864/deepspeed/ops/adam/cpu_adam.py", line 7, in <module>
          from cpuinfo import get_cpu_info
      ModuleNotFoundError: No module named 'cpuinfo'
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

可能是 python 依赖的库版本不对

2. 问题解决

更新必须的库

pip install --upgrade pip
pip install --upgrade setuptools
pip install ez_setup

上面安装更新完成之后，再执行 pip install 命令，执行成功，例如：

 smaller@SmallerdeMacBook-Pro: pip install deepspeed                                                                                                      ✔  564  17:10:03
Collecting deepspeed
  Using cached deepspeed-0.13.1.tar.gz (1.3 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting hjson (from deepspeed)
  Using cached hjson-3.1.0-py3-none-any.whl (54 kB)
Collecting ninja (from deepspeed)
  Using cached ninja-1.11.1.1-py2.py3-none-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl.metadata (5.3 kB)
Requirement already satisfied: numpy in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from deepspeed) (1.26.3)
Requirement already satisfied: packaging>=20.0 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from deepspeed) (23.2)
Requirement already satisfied: psutil in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from deepspeed) (5.9.8)
Collecting py-cpuinfo (from deepspeed)
  Using cached py_cpuinfo-9.0.0-py3-none-any.whl (22 kB)
Collecting pydantic (from deepspeed)
  Using cached pydantic-2.5.3-py3-none-any.whl.metadata (65 kB)
Collecting pynvml (from deepspeed)
  Using cached pynvml-11.5.0-py3-none-any.whl (53 kB)
Requirement already satisfied: torch in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from deepspeed) (2.1.2)
Requirement already satisfied: tqdm in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from deepspeed) (4.66.1)
Collecting annotated-types>=0.4.0 (from pydantic->deepspeed)
  Downloading annotated_types-0.6.0-py3-none-any.whl.metadata (12 kB)
Collecting pydantic-core==2.14.6 (from pydantic->deepspeed)
  Downloading pydantic_core-2.14.6-cp310-cp310-macosx_10_7_x86_64.whl.metadata (6.5 kB)
Requirement already satisfied: typing-extensions>=4.6.1 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pydantic->deepspeed) (4.9.0)
Requirement already satisfied: filelock in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from torch->deepspeed) (3.13.1)
Requirement already satisfied: sympy in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from torch->deepspeed) (1.12)
Requirement already satisfied: networkx in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from torch->deepspeed) (3.2.1)
Requirement already satisfied: jinja2 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from torch->deepspeed) (3.1.3)
Requirement already satisfied: fsspec in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from torch->deepspeed) (2023.10.0)
Requirement already satisfied: MarkupSafe>=2.0 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from jinja2->torch->deepspeed) (2.1.4)
Requirement already satisfied: mpmath>=0.19 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from sympy->torch->deepspeed) (1.3.0)
Downloading ninja-1.11.1.1-py2.py3-none-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl (270 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 270.6/270.6 kB 21.5 kB/s eta 0:00:00
Downloading pydantic-2.5.3-py3-none-any.whl (381 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 381.9/381.9 kB 13.7 kB/s eta 0:00:00
Downloading pydantic_core-2.14.6-cp310-cp310-macosx_10_7_x86_64.whl (1.9 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.9/1.9 MB 21.8 kB/s eta 0:00:00
Downloading annotated_types-0.6.0-py3-none-any.whl (12 kB)
Building wheels for collected packages: deepspeed
  Building wheel for deepspeed (pyproject.toml) ... done
  Created wheel for deepspeed: filename=deepspeed-0.13.1-py3-none-any.whl size=1350251 sha256=e94dff2604fd66ab4d2dd7d5d3fdd6571e0859a009aa471b74c548a2009f7565
  Stored in directory: /Users/smaller/Library/Caches/pip/wheels/0f/fb/b5/b159b3500525eca167d8ca6e3a7e224b6075045cac90f47cf7
Successfully built deepspeed
Installing collected packages: py-cpuinfo, ninja, hjson, pynvml, pydantic-core, annotated-types, pydantic, deepspeed
Successfully installed annotated-types-0.6.0 deepspeed-0.13.1 hjson-3.1.0 ninja-1.11.1.1 py-cpuinfo-9.0.0 pydantic-2.5.3 pydantic-core-2.14.6 pynvml-11.5.0

3. 参考

https://zhuanlan.zhihu.com/p/581112365