English
Neu.ro Core
Neu.ro Toolbox
ADMINISTRATION
Environments (Docker images)
Neu.ro uses Docker containers to run jobs in isolated environments. To run a container, you need to use Docker images that are templates containing an application and all the dependencies to run that application. Thus, a Docker container is a running instance of a Docker image.
Neu.ro lets you use Docker images either from the public Docker registry (such as Docker Hub) or from a platform's cluster registry (also called a private repository). Every cluster has one platform registry, so you cannot reuse images from one cluster in another cluster.
There are several ways to add custom images to the platform registries. These images can be shared with your teammates.
Managing environments
In these tutorials, we will use a sample project - Nero-Assistant - to understand the available options. Before you can work in an environment, make sure that you have initialzedi a new project (see the Getting Started guide for details).
How do I run a job in a container from a public registry image?
You can run jobs from images both on the public Docker registry and on the platform registry. You can use the
neuro run command to run a job:neuro run [OPTIONS] IMAGE [CMD]Parameters
Name
Description
IMAGE
The full URI of the image on which you want to run the command.
[CMD]
The commands that you want to pass to the container.
Sample output
1
> neuro run -n job369 -s cpu-small ubuntu
2
√ Job ID: job-2610359c-58b1-4bfc-af69-52ee6e330b1f
3
√ Name: job369
4
- Status: pending Creating
5
- Status: pending Scheduling
6
√ Http URL: https://job369--jane-doe.jobs.default.org.neu.ro
7
√ The job will die in a day. See --life-span option documentation for details.
8
√ Status: running
9
√ =========== Job is running in terminal mode ===========
10
√ (If you don't see a command prompt, try pressing enter)
11
√ (Use Ctrl-P Ctrl-Q key sequence to detach from the job)
Copied!
Note: The job name that you provide must contain only lowercase letters, number, or hyphens; and must begin with a letter.
When a job is created, it is added to the queue and its status is set to Pending. Once the job starts running, a job ID is assigned to it, and its status is set to Running. All current jobs are also listed on the Neu.ro web interface.
You can view the list of jobs currently running using the command:
neuro ps. This also lists the ID of the jobs. You can terminate a job using the command: neuro kill <job ID>.How can I view all images that I have access to?
Neu.ro lets you create multiple images, and you can view information about the images that you own or have access to from the command prompt. To view all images, you must run the following command:
neuro image ls [OPTIONS]Sample Output
1
> neuro image ls
2
image:neuromation-neuro-tutorial
3
image:neuromation-nero-assistant
Copied!
You can view the tags for an image by running the command:
neuro image tags [OPTIONS] IMAGESample output
1
> neuro image tags image://default/clarytyllc/neuromation-nero-assistant
2
image://default/clarytyllc/neuromation-nero-assistant:v1.5.1
Copied!
Note that you must provide the full URI to view tags for an image. You may want to add tags when you push an image or save an image. For more information, see Upload a custom image to the platform registry.
How can I upload a custom image to the platform registry?
Neu.ro provides a base public Docker image based on deepo. You can customize the base image by installing or configuring packages, or updating settings by providing the docker engine instructions. You can pass instructions for image customization using Dockerfile.
Neu.ro lets you upload your custom images to the platform and then use them to run jobs. You can also share these custom images with your co-workers. It's a best practice to add tags to your image for better tracking.
To upload a custom image, run the following command:
neuro image push [OPTIONS] LOCAL_IMAGE [REMOTE_IMAGE]Parameters
Name
Description
LOCAL_IMAGE
The local custom image that you want to upload. The image name should not contain “image://”.
REMOTE_IMAGE
The remote image to which you want to upload.
Sample Output
1
> neuro push neuromation-nero-assistant image:nero-assistant:v2
2
Pushing image neuromation-nero-assistant => image://default/mrsmariyadavydova/nero-assistant:v2
3
> b7f3b88ae387: Pushed
4
> e6a8e7191cdf: Pushing [=> ] 2.736MB/93.82MB
5
> 9dfa40a0da3b: Pushing [===============> ] 1.219MB/3.966MB
Copied!
After pushing the image, run the
neuro image ls command to check if the push has worked. If the push was successful, you should see the local image as well as the platform image.1
> neuro images
2
image:default/mrsmariyadavydova/nero-assistant:latest
3
image:neuromation-neuro-tutorial
4
image:neuromation-nero-assistant
Copied!
How can I save a running job as a custom image?
There are several ways in which you can create custom images. One of them is creating a custom image from a running job. Before you save a job, you must know its ID or name.
You can use the
neuro job save command to save a job as a custom image:neuro job save [JOB] [IMAGE]Parameters
Name
Description
JOB
The ID or name of the job that you want to save as a custom image.
IMAGE
The commands that you want to pass to the container.
Sample output
1
> neuro job save job363 image:ubuntu-custom
2
Saving job-16339fe4-9559-4c4c-9437-e6e7d5d0721e -> image://default/clarytyllc/ubuntu-custom:latest
3
Creating image image://default/clarytyllc/ubuntu-custom:latest image from the job container
4
Image created
5
Pushing image clarytyllc/ubuntu-custom:latest => image://default/clarytyllc/ubuntu-custom:latest
6
8891751e0a17: Pushed
7
2a19bd70fcd4: Pushed
8
9e53fd489559: Pushed
9
7789f1a3d4e9: Pushed
10
image://default/clarytyllc/ubuntu-custom:latest
Copied!
We have saved the job job363 as a custom image ubuntu-custom.
How can I use an image from a platform registry?
Neu.ro lets you work with jobs, environments, and storage. Jobs are run on environments (or containers) that are isolated with their own storage, CPU, and memory. You can run jobs both on the public Docker registry or a platform registry. To better manage your resources, you can specify the CPU and the amount of memory the job will use.
You can use the
neuro run command to run a job:neuro run [OPTIONS] IMAGE [CMD]Parameters
Name
Description
IMAGE
The full URI of the image on which you want to run the command.
[CMD]
The commands that you want to pass to the container.
Sample output
1
> neuro run -n job363 -s cpu-small image:ubuntu-patched:v2 echo Hello World
2
Job ID: job-21beb932-1cdb-4b55-b286-10a99752a9f1 Status: pending
3
Name: job363
4
Http URL: https://job363--clarytyllc.jobs.default.org.neu.ro
5
Shortcuts:
6
neuro status job363 # check job status
7
neuro logs job363 # monitor job stdout
8
neuro top job363 # display real-time job telemetry
9
neuro exec job363 bash # execute bash shell to the job
10
neuro kill job363 # kill job
11
Status: pending Creating
12
Status: pending Scheduling
13
Status: succeeded
14
Terminal is attached to the remote job, so you receive the job's output.
15
Use 'Ctrl-C' to detach (it will NOT terminate the job), or restart the
16
job with `--detach` option.
17
Hello World
Copied!
We have run a named job job363 using a small CPU resource preset on the patched ubuntu image.
How can I download an image from the platform registry?
Neu.ro lets you pull images from the platform registry. You can specify tags of the images to pull a certain tag; else, the image with the latest tag is pulled.
To pull an image from the platform, run this command:
neuro image pull [OPTIONS] REMOTE_IMAGE [LOCAL_IMAGE]Parameters
Name
Description
REMOTE_IMAGE
The remote image that you want to pull.
[LOCAL_IMAGE]
The local custom image that you want to pull to. The image name should not contain “image://”.
Sample Output
1
> neuro pull image:ubuntu-patched:v1
2
> Pulling image image://default/mrsmariyadavydova/ubuntu-patched:v1 => ubuntu-patched:v1
3
> d51af753c3d3: Downloading [========> ] 4.972MB/28.56MB
4
> fc878cd0a91c: Download complete
5
> 6154df8ff988: Download complete
6
> fee5db0ff82f: Download complete
7
> 8d6a6e6d0908: Download complete
Copied!
How can I share custom images with my teammates?
Neu.ro lets you share your custom image with your team without having to upload the image to a platform. You could opt to push your custom image to the public registry if you want to share your custom image with a large audience.
To share your image, run the command:
neuro share [OPTIONS] URI USER [read|write|manage]The permissions you may give the user for the shared image:
- Read: The user can only view the image and can't make any changes.
- Write: Provided user can make changes to the image.
- Manage: The user can share the image.
Sample command
1
$ neuro share image://default/clarytyllc/neuromation-nero-assistant mrsmariyadavydova manage
Copied!
Operations with images from other clusters
All operations that were described earlier can be performed with images from other clusters.
For example, to push a local
neuromation-nero-assistant image to the platform registry on the <cluster-name> cluster, run:1
$ neuro push neuromation-nero-assistant image:/<cluster-name>/<user-name>/nero-assistant:v2
Copied!
Last modified 6mo ago
Copy link
Contents
How do I run a job in a container from a public registry image?
How can I view all images that I have access to?
How can I upload a custom image to the platform registry?
How can I save a running job as a custom image?
How can I use an image from a platform registry?
How can I download an image from the platform registry?
How can I share custom images with my teammates?
Operations with images from other clusters