🍪
cookielau
  • Introduction
  • Machine Learning
    • Distributed
      • Bookmarks
    • NLP
      • Transformers
    • MLC
      • Tensor Program Abstraction
      • End-to-End Module Execution
  • Framework
    • PyTorch
      • Bookmarks
      • Model
      • Shared
      • Miscellaneous
    • Tensorflow
      • Bookmarks
      • Model
      • Shared
      • Miscellaneous
    • CUDA
      • Bookmarks
    • DeepSpeed
    • Bagua
      • Model
      • Optimizer
    • Others
      • Bookmarks
  • About Me
    • 2022-04-28
  • Random Thoughts
  • Archives
    • CPP
      • Bookmarks
      • Container
      • Algorithm
      • FILE CONTROL
      • Virtual Table
      • Assembly
      • Key Words
      • Problems
      • Others
    • JAVA
      • String Container
      • Maps
    • PYTHON
      • Bookmarks
      • Python Tools
        • Batch Rename
        • Combine Excel
        • Excel Oprations
        • Read Write Excel
        • Rotate PDF
      • Library
        • Pandas Notes
        • Numpy Notes
        • Json Notes
      • Spider
        • Selenium Install
        • Selenium Locating
        • Selenium Errors
        • Selenium Basics
      • Django
        • Start Up
      • Others
    • LINUX
      • Installation
      • Cli Tools
      • WSL
      • Bugs
    • JUNIOR2
      • Economics
        • Chapter 0x01 经济管理概述
        • Chapter 0x02 微观市场机制分析
        • Chapter 0x03 生产决策与市场结构
        • Chapter 0x04 宏观经济市场分析
        • Chapter 0x05 管理的职能
        • Chapter 0x06 生产系统结构与战略
        • Chapter 0x0b 投资项目经济评价
        • Chapter 0x0f 投资项目经济评价
      • Computer Network
        • 概述
        • 分层模型
        • 物理层
        • 数据链路层
        • 网络层
        • 传输层
        • 应用层
        • HTTP(s)实验
        • [Practice]
      • Software Engineering
        • Introduction
        • Demand Analysis
        • Task Estimation
        • Presentation
      • Network Security
        • Chapter 0x01 概述
        • Chapter 0x02 密码学
        • Chapter 0x03 公钥体制
        • Chapter 0x04 消息认证
        • Chapter 0x05 密钥管理
        • Chapter 0x06 访问控制
        • Assignments
      • x86 Programming
        • Basic Knowledge
        • Program Design
        • System Interruption
        • Frequently used functions
    • MD&LaTex
      • Markdown
      • LaTex
    • NPM
      • NPM LINK
    • MyBlogs
      • 2020BUAA软工——“停下来,回头看”
      • 2020BUAA软工——“初窥构建之法”
      • 2020BUAA软工——“上手软件工程,PSP初体验!”
      • 2020BUAA软工——“深度评测官”
      • 2020BUAA软工——“并肩作战,平面交点Pro”
    • SC
      • PAC 2022
        • Lectures
      • OpenMP & MPI
        • MPI Overview
        • Message Passing Programming
        • OpenMP Overview
        • Work Sharing Directives
        • Annual Challenge
        • Future Topics in OpenMP
        • Tasks
        • OpenMP & MPI
    • Hardware
      • Nvidia GPU
        • Frequent Error
        • Memory Classification
        • CUDA_7_Streams_Simplify_Concurrency
        • Optimize_Data_Transfers_in_CUDA
        • Overlap_Data_Transfers_in_CUDA
        • Write_Flexible_Kernels_with_Grid-Stride_Loops
        • How_to_Access_Global_Memory_Efficiently
        • Using_Shared_Memory
      • Intel CPU
        • Construction
        • Optimization
        • Compilation
        • OpenMP
    • English
      • Vocab
      • Composition
    • Interview
      • Computer Network
Powered by GitBook
On this page
  • Environment
  • Failed to initialize NVML: Driver/library version mismatch

Was this helpful?

  1. Archives
  2. Hardware
  3. Nvidia GPU

Frequent Error

Jun 6th, 2020 - Now

q2l

[toc]

Environment

Failed to initialize NVML: Driver/library version mismatch

  • 原因:驱动更新导致不匹配

  • 解决方案:

    • 卸载 kernel mode

    • sudo rmmod nvidia

    • 在卸载中可能会遇到相关进程被占用的报错,只需要卸载占用的进程即可

  • 实例:

    ```bash

    (base) [q2l@gpu4 ~]$ nvidia-smi

    Failed to initialize NVML: Driver/library version mismatch

    (base) [q2l@gpu4 ~]$ sudo lsof -n -w /dev/nvidia* //查看当前正在运行的Nvidia进程,发现并没有

    (base) [q2l@gpu4 ~]$ sudo rmmod nvidia

    rmmod: ERROR: Module nvidia is in use by: nvidia_modeset

    (base) [q2l@gpu4 ~]$ sudo rmmod nvidia_modeset

    rmmod: ERROR: Module nvidia_modeset is in use by: nvidia_drm

    (base) [q2l@gpu4 ~]$ sudo rmmod nvidia_drm

    (base) [q2l@gpu4 ~]$ sudo rmmod nvidia_modeset

    (base) [q2l@gpu4 ~]$ sudo rmmod nvidia

    (base) [q2l@gpu4 ~]$ nvidia-smi

    Fri Jun 5 09:05:02 2020

    +-----------------------------------------------------------------------------+

    | NVIDIA-SMI 440.33.01 Driver Version: 440.33.01 CUDA Version: 10.2 |

    |-------------------------------+----------------------+----------------------+

    | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |

    | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |

    |===============================+======================+======================|

    | 0 Tesla V100-PCIE... Off | 00000000:06:00.0 Off | 0 |

    | N/A 49C P0 40W / 250W | 0MiB / 32510MiB | 0% Default |

    +-------------------------------+----------------------+----------------------+

    | 1 Tesla V100-PCIE... Off | 00000000:84:00.0 Off | 0 |

    | N/A 46C P0 40W / 250W | 0MiB / 32510MiB | 0% Default |

    +-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | No running processes found | +-----------------------------------------------------------------------------+

```

PreviousNvidia GPUNextMemory Classification

Last updated 4 years ago

Was this helpful?

Reference:

nvidia-smi:command not found 问题解决,Failed to initialize NVML: Driver/library version mismatch