preview image

November 2022

Tiny and Secure Docker images for NodeJS Applications

I recently wanted to dockerize a NodeJS application of mine, the backend for piko.space. I wanted to keep the image as small as possible, utilize layer caching, and minimize security risk. But building images like the official guide recommends creates huge (952 MB for a tiny application) images and exposes a large security surface by packing a full install of debian.

Snyk published a blogpost about choosing the right docker images for each use-case while focusing on security. One of their recommendations was using distroless images, which don't include a whole operating system but may lack some dependencies your app might need.

To combat this issue, I'm using a multi-stage build process, where the first stage uses the full node:bullseye container and the second stage pulls the output from the build stage to run it.

I also wanted to minimize dependency install time. For this I'm using pnpm. It also features a command specifically for docker layer caching, pnpm fetch, which uses only the lockfile and ignores irrelevant changes to package.json. This pre-fetches the dependencies into the pnpm cache, so a later full install already has all the dependencies in the file system.

Because PNPM creates symlinks for dependency files, we can't just copy the content of the node_modules to the second stage. The content files needs to be bundled into the build output. This can be accomplished by using esbuild, which can directly transpile TypeScript files and is way quicker at it than tsx. But esbuild skips type checking. We can run type checking in parallel using tsc -noEmit or skip it altogether if you are already using type checking during your development. For this you can use the following command:

tsc -noEmit && esbuild src/index.ts --bundle --platform=node --target=node16 --outfile=bundle.js

The speed should be noticable, espacially in large projects. I included some benchmarks of the piko.space backend codebase:

# run "esbuild" using the above command, 20 run average
Time (mean ± σ):     363.7 ms ±   4.4 ms

# run "tsc -noEmit", 20 runs average
Time (mean ± σ):      2.065 s ±  0.360 s

# run "tsc", 20 runs average
Time (mean ± σ):      2.250 s ±  0.407 s 

This example Dockerfile from my project assumes a monorepo setup, where multiple apps are in the /apps/<app> folder, and we are only packaging the backend app.

###########
# Builder #
###########
FROM node:16-bullseye-slim AS build
RUN npm install -g pnpm

# Fetch dependencies
WORKDIR /app
COPY pnpm-lock.yaml ./
RUN pnpm fetch

# Install dependencies into folders
ADD . ./
RUN pnpm install -r --offline

# Build Monorepo
RUN pnpm run -r build

##########
# Runner #
##########
FROM gcr.io/distroless/nodejs:16
COPY --from=build /app/apps/backend/bundle.js /usr/src/app/
WORKDIR /usr/src/app
CMD ["bundle.js"]

The tsconfig.json configures the build to work with Node 16:

{
  "compilerOptions": {
    "target": "ESNext",
    "useDefineForClassFields": true,
    "lib": ["ESNext"],
    "allowJs": false,
    "skipLibCheck": true,
    "esModuleInterop": false,
    "allowSyntheticDefaultImports": true,
    "strict": true,
    "forceConsistentCasingInFileNames": true,
    "module": "commonjs",
    "moduleResolution": "node",
    "resolveJsonModule": true,
    "isolatedModules": true,
    "outDir": "dist"
  },
  "include": ["src"]
}

This results in a container using only 121 MB in size, roughly 87% smaller than the recommended image. Using the distroless image as a base has some drawbacks. If your dependencies are using other programming languages, like python, etc., you have to install them yourself. Dependencies like prisma which compile code on install need to be handled seperately. But you should probably optimize packaging prisma anyway, as most binaries bundled by it won't be needed by your production app anyways, like the prisma file formatter.

All of this allows for faster deploys and drastically reduced build time. This makes publishing a new version in seconds, not minutes, possible, reducing cycle time and minimizing the gap between production and development. I can deploy a fix almost instantly, and get feedback on changes from real devices so quickly that it actually changed my development workflow. Deploying more often meant I could experiment with small changes and undo them without much friction, which makes the development process way more enjoyable, at least for me.

Thanks for reading! If there is anything you would change about this, I'd be glad to hear about it.