Sponsored Content
Skip to content

performance: how can runtime-spec incorporate non container image OCI artifacts lifecycle? #1254

Open

Description

@rchincha

Requirements from various communities:

  1. AI/ML - large models (several GBs), to be pulled and cached and made available to container namespaces.
  2. WASM - runnable non-container images

Activity

  1. rchincha commented on May 28, 2024

    @rchincha
    Author
  2. rchincha commented on May 28, 2024

    @rchincha
    Author
  3. rchincha commented on May 28, 2024

    @rchincha
    Author
  4. utam0k commented on May 29, 2024

    @utam0k
    Member

    AI/ML - large models (several GBs), to be pulled and cached and made available to container namespaces.

    What should we do from the runtime spec side?

    WASM - runnable non-container images

    In my opinion, it's tough to cover all non-container image types in OCI Runtime Spec.

  5. rchincha commented on May 29, 2024

    @rchincha
    Author

    runtime spec already assumes a bundle to pivot_root to, so maybe there is nothing to do here.

    However, perhaps to be aware (currently ideas/possibilities)
    opencontainers/image-spec#1191 (appears outside scope of this spec)

    https://github.com/containerd/runwasi
    ^ would be ideal to select a runtime off of artifactType (again appears outside scope of this spec)

  6. utam0k commented on Jun 16, 2024

    @utam0k
    Member

    ^ would be ideal to select a runtime off of artifactType (again appears outside scope of this spec)

    If you want us to do it, please update the issue or send out the PR.

  7. tianon commented on Jun 19, 2024

    @tianon
    Member

    I agree this is probably out of scope here; Docker, containerd, and even k8s fall somewhere between image and runtime/outside runtime. Image is mostly about how to represent the bits/what they mean and runtime assumes they're unpacked and layered already in a fully opaque way (as noted above).

    On that note though, I believe that containerd already has the primitives necessary for this, and for Docker we've got a proposal at moby/moby#30449 that I haven't seen any active maintainers opposed to -- it just needs an implementation (contributions very welcome). I believe it's even already implemented in BuildKit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions