English
Neu.ro Core
Neu.ro Toolbox
ADMINISTRATION
FAQ
How to upload and download Data
You can upload your datasets to the Platform using Neuro CLI. Neuro CLI supports basic file system operations for copying and moving files to and from the platform storage.
From your terminal or command prompt, change to the directory containing your dataset, and run:
1
neuro cp -r data/ storage:data/
Copied!
The URI
storage:data/ indicates that the destination is the platform. In a similar fashion,1
neuro cp -r storage:data/ data/
Copied!
downloads dataset to your current directory locally.
You can access your dataset from within a container by giving
--volume storage:data/:/var/storage/data/:rw to neuro run as a parameter when starting a new job.How to browse data with Filebrowser
Filebrowser is a web-based file management interface. You can use it to view and manage your storage on Neuro Platform. To start the job and open the tool in your default browser, run the following command:
1
neuro run \
2
--name filebrowser \
3
--preset cpu-small \
4
--http 80 \
5
--detach \
6
--browse \
7
--volume storage::/srv:rw \
8
filebrowser/filebrowser
Copied!
Filebrowser requires logging in; the default credentials are
admin/admin. For more complex user setup, please refer to Filebrowser documentation.How to connect to a running job
To work with your dataset from within a container, to troubleshoot a model, or to get shell access to a GPU instance, you can execute a command shell within a running job in interactive mode.
To do so, copy the job id of a running job (you can run
neuro ps to see the list), and run:1
neuro exec <job-id or job-name> bash
Copied!
For example,
1
neuro exec training bash
Copied!
This command starts bash within the running job and connects your terminal to it.
How to run a job in a custom environment
Assuming you have a local Docker image named
helloworld built on your local machine, you can push it to the Neuro Platform by running:1
neuro push helloworld
Copied!
After that, you can start the job by running:
1
neuro run image:helloworld
Copied!
How to kill all running jobs
To kill all jobs that are currently running on your behalf, run the following command:
1
neuro kill `neuro -q ps -o <user>`
Copied!
For example,
1
neuro kill `neuro -q ps -o mariyadavydova`
Copied!
How to run two or more commands in a job
Sometimes you want to execute two or three commands in a job without having to connect to it. For example, you may want to change the working directory and to run training. To achieve this, you need to wrap your commands in
”bash -c ‘<commands>’” call, like this:1
"bash -c 'cd /project && python mnist/train.py'"
Copied!
How to get output from a running job
There are two ways to get the output of your running job:
- Run it without the
--detachoption. - Connect to a running job output with
neuro log <JOB>, where JOB is either the id or the name of your job.
In some cases, Python caches the output of the scripts, so that you won’t get any output until the job finishes. To overcome this problem, provide
-u option to python, like this:1
"bash -c 'cd /project && python -u mnist/train.py'"
Copied!
How to check storage usage
To check the usage of storage space, run the following command:
1
$ neuro run -v storage://:/var/storage ubuntu du -h -d 1 /var/storage
Copied!
If you want to check storage space in any specific folder, just provide the folder name to this command in the following way:
1
$ neuro run -v storage:FOLDER_NAME:/var/storage ubuntu du -h -d 1 /var/storage
Copied!
Last modified 9mo ago