Browse Source

Specify a maxinmum number of OpenBLAS threads

Environment variables are used to specify a maximum number of OpenBLAS threads.

In ubuntu(GPU) environment, numpy will use too many threads for computing,
it may affect the start of the summary process.
Notice: At present, the performance of setting the thread to 2 has been tested to be more suitable.
If it is to be adjusted, it is recommended to test according to the scenario first

a
tags/v1.1.0
ougongchang 5 years ago
parent
commit
99c06b9801
1 changed files with 10 additions and 0 deletions
  1. +10
    -0
      mindspore/train/summary/_writer_pool.py

+ 10
- 0
mindspore/train/summary/_writer_pool.py View File

@@ -31,6 +31,16 @@ except ValueError:
import multiprocessing as ctx import multiprocessing as ctx




# Environment variables are used to specify a maximum number of OpenBLAS threads:
# In ubuntu(GPU) environment, numpy will use too many threads for computing,
# it may affect the start of the summary process.
# Notice: At present, the performance of setting the thread to 2 has been tested to be more suitable.
# If it is to be adjusted, it is recommended to test according to the scenario first
os.environ['OPENBLAS_NUM_THREADS'] = '2'
os.environ['GOTO_NUM_THREADS'] = '2'
os.environ['OMP_NUM_THREADS'] = '2'


def _pack_data(datadict, wall_time): def _pack_data(datadict, wall_time):
"""Pack data according to which plugin.""" """Pack data according to which plugin."""
result, summaries, step = [], [], None result, summaries, step = [], [], None


Loading…
Cancel
Save