gpu-llm-benchmarking (sha256:53de437a90cc209aaa1409736f0702fcfde843955d3e66595e2d774fbb10ee58)

Published 2025-07-28 21:21:52 +01:00 by tom in tom/gpu-llm-benchmarking

Pull the image from the command line:

docker pull git.tomfos.tr/tom/gpu-llm-benchmarking@sha256:53de437a90cc209aaa1409736f0702fcfde843955d3e66595e2d774fbb10ee58

Digest

sha256:53de437a90cc209aaa1409736f0702fcfde843955d3e66595e2d774fbb10ee58

For more information on the Container registry, see the documentation.

Script and results for Nvidia GPU benchmarking across various context lengths

ARG RELEASE

ARG LAUNCHPAD_BUILD_ARCH

LABEL org.opencontainers.image.ref.name=ubuntu

LABEL org.opencontainers.image.version=24.04

ADD file:0ebb3dd98809cffc1b5ade76d8ccac01def087e7d7a84a84a33db4aa9090ac67 in /

CMD ["/bin/bash"]

RUN /bin/sh -c apt-get update && apt-get install -y ca-certificates && apt-get clean && rm -rf /var/lib/apt/lists/* # buildkit

COPY /bin /usr/bin # buildkit

ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin

COPY /lib/ollama /usr/lib/ollama # buildkit

ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64

ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility

ENV NVIDIA_VISIBLE_DEVICES=all

ENV OLLAMA_HOST=0.0.0.0:11434

EXPOSE map[11434/tcp:{}]

ENTRYPOINT ["/bin/ollama"]

CMD ["serve"]

RUN /bin/sh -c apt-get update && apt-get install -y apt-utils curl openssh-server tmux git wget less locales sudo software-properties-common rsync && rm -rf /var/lib/apt/lists/* && curl -LsSf https://astral.sh/uv/install.sh | sh # buildkit

ENV PATH=/root/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin

WORKDIR /app

COPY pyproject.toml uv.lock ./ # buildkit

COPY scripts ./scripts/ # buildkit

RUN /bin/sh -c uv sync --no-dev # buildkit

ENTRYPOINT ["/bin/bash" "-c" "echo \"Container ready for Ollama setup and benchmarking.\" && tail -f /dev/null"]

Key	Value
org.opencontainers.image.created	2025-07-28T20:16:11.555Z
org.opencontainers.image.description	Script and results for Nvidia GPU benchmarking across various context lengths
org.opencontainers.image.licenses
org.opencontainers.image.ref.name	ubuntu
org.opencontainers.image.revision	430dc059d4ef1f862d8fea06af6c7e4d9e8d3592
org.opencontainers.image.source	https://git.tomfos.tr/tom/gpu-llm-benchmarking
org.opencontainers.image.title	gpu-llm-benchmarking
org.opencontainers.image.url	https://git.tomfos.tr/tom/gpu-llm-benchmarking
org.opencontainers.image.version	main