• Stars
    star
    101
  • Rank 338,166 (Top 7 %)
  • Language
    Python
  • License
    Apache License 2.0
  • Created over 4 years ago
  • Updated 7 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A visual dashboard for model tuning.

MindInsight

็ฎ€ไฝ“ไธญๆ–‡

Introduction

MindInsight provides MindSpore with easy-to-use debugging and tuning capabilities. During the training, data such as scalar, tensor, image, computational graph, model hyper parameter and training's execution time can be recorded in the file for viewing and analysis through the visual page of MindInsight.

MindInsight Architecture

Click to view the MindInsight design document, learn more about the design. Click to view the Tutorial documentation learn more about the MindInsight tutorial.

Installation

System Environment Information Confirmation

  • The hardware platform supports Ascend, GPU and CPU.
  • Confirm that Python 3.7.5 is installed.
  • The versions of MindInsight and MindSpore must be consistent.
  • If you use source code to compile and install, the following dependencies also need to be installed:
    • Confirm that node.js 10.19.0 or later is installed.
    • Confirm that wheel 0.32.0 or later is installed.
  • All other dependencies are included in requirements.txt.

Installation Methods

You can install MindInsight either by pip or by source code.

Installation by pip

Install from PyPI:

pip install mindinsight

Install with customized version:

pip install https://ms-release.obs.cn-north-4.myhuaweicloud.com/{version}/MindInsight/any/mindinsight-{version}-py3-none-any.whl --trusted-host ms-release.obs.cn-north-4.myhuaweicloud.com -i https://pypi.tuna.tsinghua.edu.cn/simple
  • When the network is connected, dependency items are automatically downloaded during .whl package installation. (For details about other dependency items, see requirements.txt). In other cases, you need to manually install dependency items.
  • {version} denotes the version of MindInsight. For example, when you are downloading MindSpore 1.3.0, {version} should be 1.3.0.
  • MindInsight supports only Linux distro with x86 architecture 64-bit or ARM architecture 64-bit.

Installation by Source Code

Downloading Source Code from Gitee
git clone https://gitee.com/mindspore/mindinsight.git
Compiling MindInsight

You can choose any of the following installation methods:

  1. Run the following command in the root directory of the source code:

    cd mindinsight
    pip install -r requirements.txt -i https://pypi.tuna.tsinghua.edu.cn/simple
    python setup.py install
  2. Build the whl package for installation.

    Enter the root directory of the source code, first execute the MindInsight compilation script in the build directory, and then execute the command to install the whl package generated in the output directory.

    cd mindinsight
    bash build/build.sh
    pip install output/mindinsight-{version}-py3-none-any.whl -i https://pypi.tuna.tsinghua.edu.cn/simple

Installation Verification

Execute the following command:

mindinsight start [--port PORT]

notes: the param --port default value is 8080

If it prompts the following information, the installation is successful:

Web address: http://127.0.0.1:8080
service start state: success

Quick Start

Before using MindInsight, the data in the training process should be recorded. When starting MindInsight, the directory of the saved data should be specified. After successful startup, the data can be viewed through the web page. Here is a brief introduction to recording training data, as well as starting and stopping MindInsight.

SummaryCollector is the interface MindSpore provides for a quick and easy collection of common data about computational graphs, loss values, learning rates, parameter weights, and so on. Below is an example of using SummaryCollector for data collection, specifying the directory where the data is stored in ./summary_dir.

...

from mindspore import SummaryCollector
summary_collector = SummaryCollector(summary_dir='./summary_dir')
model.train(epoch=1, ds_train, callbacks=[summary_collector])

For more ways to record visual data, see the MindInsight Tutorial.

After you've collected the data, when you launch MindInsight, specify the directory in which the data has been stored.

mindinsight start --summary-base-dir ./summary_dir [--port PORT]

notes: the param --port default value is 8080

After successful startup, visit http://127.0.0.1:8080 through the browser to view the web page.

Command of stopping the MindInsight service:

mindinsight stop [--port PORT]

notes: the param --port default value is 8080, you can stop the specified port MI service.

For more about MindInsight command_line๏ผŒsee the MindInsight Command_line.

Docs

More details about installation guide, tutorials and APIs, please see the User Documentation.

Community

Governance

Check out how MindSpore Open Governance works.

Communication

Vulkan Vision

Vulkan Vision(V-Vision) provides an unprecedented level of detail into the execution of Vulkan applications through dynamic instrumentation. V-Vision supports analyzing AI workloads implemented using the a compute pipeline as well as traditional raster and ray-tracing Vulkan applications. To use V-Vision please refer to the build instructions. For more information, please refer to the paper published at CGO 2021.

Contributing

Welcome contributions. See our Contributor Wiki for more details.

Release Notes

The release notes, see our RELEASE.

License

Apache License 2.0

More Repositories

1

mindspore

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
C++
4,266
star
2

models

Python
346
star
3

akg

AKG (Auto Kernel Generator) is an optimizer for operators in Deep Learning Networks, which provides the ability to automatically fuse ops with specific patterns.
Python
213
star
4

docs

MindSpore document
Jupyter Notebook
158
star
5

mindarmour

A tool box for MindSpore users to enhance model security and trustworthiness.
Python
90
star
6

graphengine

A connecting link module between frontends and Ascend processors.
C++
85
star
7

mindspore-21-days-tutorials

MindSpore 21 days tutorials.
Python
77
star
8

community

MindSpore community
Python
69
star
9

mindquantum

MindQuantum is a quantum machine learning library that can be used to build and train different quantum neural networks.
Python
69
star
10

ms-operator

MindSpore on Kubernetes
Go
62
star
11

course

MindSpore course
Jupyter Notebook
59
star
12

infrastructure

The codes that boot up the mindspore community
Dockerfile
44
star
13

book

The code repository stores the complete practice code in 'Introduction DeepLearning with MindSpore'.
Python
43
star
14

serving

A lightweight and high-performance service module that helps MindSpore developers efficiently deploy online inference services in the production environment.
C++
39
star
15

mail_templates

The mail templates for community mail server
37
star
16

mindscience

Jupyter Notebook
36
star
17

hub

MindSpore hub
Python
29
star
18

zidongtaichu

Python
19
star
19

contrib

Jupyter Notebook
16
star
20

reinforcement

Python
12
star
21

xai

Python
8
star
22

transformer

Python
4
star
23

graphlearning

Python
3
star
24

mindpandas

Python
3
star
25

llm-serving

Python
3
star
26

recommender

Python
2
star
27

federated

C++
2
star
28

golden-stick

Python
2
star
29

omni-perception-pretrainer

Python
2
star
30

MindFormers

Python
1
star
31

Xihe-docs

Dockerfile
1
star
32

toolkits

Python
1
star