Proxmox Docker Monster! Running 13000 containers on a single host!

Published: 16 April 2023
on channel: VirtualizationHowto
39,078
600

Following up on a blog post that is hot off the press on my site, I wanted to create the video form of this topic. I have been playing around with Proxmox and Docker containers in the lab. With my SuperMicro E300-9D hardware with 16 cores and 128 GB of memory, how many containers can you run?

Subscribe to the channel:    / @virtualizationhowto  

My blog:
https://www.virtualizationhowto.com
_____________________________________________________

Social Media:
  / vspinmaster  

LinkedIn:
  / brandon-lee-vht  

Github:
https://github.com/brandonleegit

Introduction - 0:10
How many containers can you run? 0:50
Docker Swarm to initialize thousands of containers - 1:00
Creating a Docker host template - 1:20
Experimenting with LXC vs virtual machines - 1:39
The memory configuration and what I settled upon - 2:15
Creating a single node Docker swarm host and service, as well as scaling replicas - 2:34
Alterating between nginx and redis containers - 3:00
How did I decide on 1000 containers for each virtual machine? 3:38
Workaround for the maximum connections to the Linux bridge - 4:29
Bringing up the 10th and 11th hosts up - 5:00
Initializing the Docker Swarm host - 5:40
Scaling the host to 1000 containers - 6:40
Containers starting to scale up - 7:10
Checking out the host hardware performance - 7:23
Reached 10000 Docker containers running on the Proxmox host - 8:00
We hit 10000, can we go higher? 8:23
Bringing up the additional Docker container hosts - 8:50
Also spun up host 11, on way to 13000 containers - 9:17
CPU is pegged at 100% but still have memory headroom - 9:34
100% CPU usage and over 90% memory usage - 10:17
We made it! 13000 containers - 10:35
Proxmox allows you to run Docker, LXC, and even Docker on the host itself - 11:20
Can't believe achieved 13,000 containers, concluding thoughts - 11:50

Read the written blog post covering this experiment in the home lab!

https://www.virtualizationhowto.com/2...


Watch video Proxmox Docker Monster! Running 13000 containers on a single host! online without registration, duration hours minute second in high quality. This video was added by user VirtualizationHowto 16 April 2023, don't forget to share it with your friends and acquaintances, it has been viewed on our site 39,078 once and liked it 600 people.