packer-kvm - GitLite

KO | EN

gitlite — search

#python #ai #llm #golang #machine-learning #rust #macos #nodejs #windows #kubernetes #awesome-list #vue #pytorch #open-source

packer-kvm

(★ 233)

Create VM templates with Packer for usage with Libvirt/KVM virtualization : AlmaLinux 9, AlmaLinux 10, Centos 9, Rocky 9, Rocky 10, Fedora 40, Noble (Ubuntu 2404), Debian 12 (Bookworm).

파일 탐색기

최종 버전 다운로드 (.zip)

- - main.yml
- FUNDING.yml
- playbook.yml
- - builder.tf
- - builder.tf
- README.md
- - almalinux8-kickstart.cfg
  - centos7-kickstart.cfg
  - centos8-kickstart.cfg
  - debian-preseed.cfg
  - fedora33-kickstart.cfg
  - fedora34-kickstart.cfg
  - fedora35-kickstart.cfg
  - kali-preseed.cfg
  - rocky8-kickstart.cfg
  - ubuntu1804-preseed.cfg
- almalinux8.json
- almalinux8.pkr.hcl
- almalinux9.json
- bionic.json
- bionic.pkr.hcl
- centos7.json
- centos7.pkr.hcl
- centos8.json
- centos8.pkr.hcl
- centos9.json
- debian11.json
- debian11.pkr.hcl
- fedora33.json
- fedora34.json
- fedora35.json
- fedora35.pkr.hcl
- focal.json
- focal.pkr.hcl
- jammy.json
- jammy.pkr.hcl
- kali20211.json
- rocky8.json
- rocky8.pkr.hcl
- ubuntu2004.pkr.hcl
- ubuntu2204.pkr.hcl
- - meta-data
  - user-data
- almalinux10-kickstart.cfg
- almalinux9-kickstart.cfg
- centos9-kickstart.cfg
- debian12-preseed.cfg
- fedora40-kickstart.cfg
- rocky10-kickstart.cfg
- rocky9-kickstart.cfg
- - README.md
- push-image.sh
- id_rsa
- id_rsa.pub
.gitignore
almalinux10.pkr.hcl
almalinux9.pkr.hcl
build-packer-templates.yaml
build.sh
centos9.pkr.hcl
debian12.pkr.hcl
Dockerfile
fedora40.pkr.hcl
imagename
launch.sh
LICENSE
README.md
rocky10.pkr.hcl
rocky9.pkr.hcl
setup.sh
test_vm.sh
ubuntu2404.pkr.hcl

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# packer-kvm

Create VM templates with Packer for usage with Libvirt/KVM virtualization : AlmaLinux 9, Almalinux 10, Rocky 9, Rocky 10, Fedora 40, Noble (Ubuntu 2404), Debian 12 (Bookworm).

Only for education and learning purposes. Do not use it in production.

## Packer Concepts

Packer is an open source tool for creating identical machine images for multiple platforms from a single source configuration called a  template. ([Introduction to Packer, What is Packer?](https://www.packer.io/intro#what-is-packer)). It uses different plugins as builders, provisioners or post-processors.

While the JSON format template is still supported, certain new features in the Packer core will only be implemented for the newer HCL2 format. Therefore, this project has been updated to [HCL2](https://www.packer.io/docs/templates/hcl_templates).

_Builders_ are responsible for creating machines and generating images from them for various platforms. For example, there are separate builders for EC2, VMware, VirtualBox, Qemu, etc. Packer comes with many builders by default, and can also be extended to add new builders. ([Builders](https://www.packer.io/docs/builders))

Packer can enable an http server to serve kickstart, preseed or cloud-init configuration files at boot.

_Provisioners_ use builtin and third-party software to install and configure the machine image after booting. ([Provisioners](https://www.packer.io/docs/provisioners))

_Post-processors_ run after the image is built by the builder and provisioned by the provisioner(s). ([Post-Processors](https://www.packer.io/docs/post-processors))

## Proof of Concept to generate Linux qemu images

This is a Packer "Proof of Concept" with :

* qemu/kvm as image _builder_ (qcow2)
* "shell" and "ansible-local" as _provisionners_
* "shell-local" as _post-processor_ to generate a [gns3a appliance file](https://docs.gns3.com/1MAdxz0BSEAfGM7tA-w-o3TMmf8XOx7nBf0z6d9nRz_c/index.html), checksum and upload to a server

Optionnal :

* run this inside a docker container
* build your own container

Enjoy those images with :

* Libvirt native tools
* Terraform as IaC tool with a third party Libvirtd Provider plugin

The built images are intended to be published on a S3 bucket.

## Pre-requisites

The run this project with success, you need a virtualization server and some softwares installed :

* Libvirt/KVM, Packer and aws s3 cli
* Docker (to run the build inside a container)

Use `./setup.sh` for a quick setup of Libvirt/KVM, Packer and `aws s3 cli` but please read before the following manual instructions.

For Docker usage, install it and put your aws S3 credits in your `~/.profile`.

Anyway, you can remove the post-processor in your image JSON template to avoid S3 upload attemps.

### AWS S3

Configure your S3 credits :

```bash
echo "export AWS_ACCESS_KEY=<your AWS_ACCESS_KEY>" >> ~/.profile
echo "export AWS_SECRET_KEY=<your AWS_SECRET_KEY>" >> ~/.profile
source ~/.profile
```

### Libvirt and Packer

Install Livirt/KVM on your server :

```bash
if [ -f /etc/debian_version ]; then
apt-get update && apt-get -y upgrade
apt-get -y install qemu-kvm libvirt-dev virtinst virt-viewer libguestfs-tools virt-manager uuid-runtime curl linux-source libosinfo-bin
virsh net-start default
virsh net-autostart default
elif [ -f /etc/redhat-release ]; then
yum -y install epel-release
yum -y upgrade
yum -y group install "Virtualization Host"
yum -y install virt-manager libvirt virt-install qemu-kvm xauth dejavu-lgc-sans-fonts virt-top libguestfs-tools virt-viewer virt-manager curl
ln -s /usr/libexec/qemu-kvm /usr/bin/qemu-system-x86_64
fi
```

Install the Packer binary :

```bash
yum -y install wget unzip || apt update && apt -y install wget unzip
latest=$(curl -L -s https://releases.hashicorp.com/packer | grep 'packer_' | sed 's/^.*<.*\">packer_\(.*\)<\/a>/\1/' | head -1)
wget https://releases.hashicorp.com/packer/${latest}/packer_${latest}_linux_amd64.zip
unzip packer*.zip
chmod +x packer
mv packer /usr/local/bin/
```

Install the plugins:

```bash
packer plugins install github.com/hashicorp/qemu
packer plugins install github.com/hashicorp/ansible
```

### Docker

Get Docker and docker-compose :

```bash
curl -fsSL https://get.docker.com -o get-docker.sh && sh get-docker.sh
if [ -f /etc/debian_version ]; then
apt-get update && apt-get -y install python3-pip
elif [ -f /etc/redhat-release ]; then
yum -y install python3-pip
fi
pip3 install docker-compose
```

## Build with Packer

Each HCL file is a template for a distribution :

* [almalinux9.pkr.hcl](https://github.com/goffinet/packer-kvm/blob/master/almalinux9.pkr.hcl)
* [almalinux10.pkr.hcl](https://github.com/goffinet/packer-kvm/blob/master/almalinux10.pkr.hcl)
* [centos10.pkr.hcl](https://github.com/goffinet/packdder-kvm/blob/master/centos10.pkr.hcl)
* [rocky9.pkr.hcl](https://github.com/goffinet/packer-kvm/blob/master/rocky9.pkr.hcl)
* [rocky10.pkr.hcl](https://github.com/goffinet/packer-kvm/blob/master/rocky10.pkr.hcl)
* [centos9.pkr.hcl](https://github.com/goffinet/packer-kvm/blob/master/centos9.pkr.hcl)
* [fedora40.pkr.hcl](https://github.com/goffinet/packer-kvm/blob/master/fedora40.pkr.hcl)
* [ubuntu2404.pkr.hcl](https://github.com/goffinet/packer-kvm/blob/master/ubuntu2404.pkr.hcl)
* [debian12.pkr.hcl](https://github.com/goffinet/packer-kvm/blob/master/debian12.pkr.hcl)

For example :

```bash
packer build almalinux9.pkr.hcl
```

nota bene: those file are generated by the ansible playbook `build-packer-templates.yaml`.

## Build with Docker qemu based image

`goffinet/packer-qemu` is a Docker image for building qemu images with packer and is available on Docker Hub.

```bash
docker run --rm \
  -e PACKER_LOG=1 \
  -e PACKER_LOG_PATH="packer-docker.log" \
  -it \
  --privileged \
  --cap-add=ALL -v /lib/modules:/lib/modules \
  -v `pwd`:/opt/ \
  -e AWS_ACCESS_KEY=$AWS_ACCESS_KEY \
  -e AWS_SECRET_KEY=$AWS_SECRET_KEY \
  -w /opt/ goffinet/packer-qemu build almalinux9.pkr.hcl
```

The script `build.sh` do it with the template filename as first argument.

```bash
./build.sh almalinux9.pkr.hcl
```

To build the image localy with the [Dockerfile](https://github.com/goffinet/packer-kvm/blob/master/Dockerfile) :

```bash
docker build -t packer-qemu .
```

## Packing monitoring

Packer use VNC to launch a temporary VM, you can check this window with a VNC client like `vinagre`.

You can have more details from Packet with the env var configured : `PACKER_LOG=1`.

## Cloud images for qemu/KVM/Libvirt built with Packer

I build images for qemu/KVM with this project and I [publish them](http://download.goffinet.org/kvm/index.html) for use in those other IaC projects: [Kcli](https://kcli.readthedocs.io/en/latest/#) or [Terraform with Libvirt/KVM provider](https://github.com/goffinet/terraform-libvirt).

- [almalinux9.qcow2](http://download.goffinet.org/kvm/almalinux9.qcow2) [[md5sum]](http://download.goffinet.org/kvm/almalinux9.qcow2.md5sum) [[sha256sum]](http://download.goffinet.org/kvm/almalinux9.qcow2.sha256sum)
- [almalinux10.qcow2](http://download.goffinet.org/kvm/almalinux10.qcow2) [[md5sum]](http://download.goffinet.org/kvm/almalinux10.qcow2.md5sum) [[sha256sum]](http://download.goffinet.org/kvm/almalinux10.qcow2.sha256sum)
- [ubuntu2204.qcow2 (Jammy)](http://download.goffinet.org/kvm/ubuntu2204.qcow2) [[md5sum]](http://download.goffinet.org/kvm/ubuntu2204.qcow2.md5sum) [[sha256sum]](http://download.goffinet.org/kvm/ubuntu2204.qcow2.sha256sum)
- [rocky9.qcow2](http://download.goffinet.org/kvm/rocky9.qcow2) [[md5sum]](http://download.goffinet.org/kvm/rocky9.qcow2.md5sum) [[sha256sum]](http://download.goffinet.org/kvm/rocky9.qcow2.sha256sum)
- [rocky10.qcow2](http://download.goffinet.org/kvm/rocky10.qcow2) [[md5sum]](http://download.goffinet.org/kvm/rocky10.qcow2.md5sum) [[sha256sum]](http://download.goffinet.org/kvm/rocky10.qcow2.sha256sum)
- [fedora40.qcow2](http://download.goffinet.org/kvm/fedora40.qcow2) [[md5sum]](http://download.goffinet.org/kvm/fedora40.qcow2.md5sum) [[sha256sum]](http://download.goffinet.org/kvm/fedora40.qcow2.sha256sum)
- [ubuntu2404.qcow2 (Noble)](http://download.goffinet.org/kvm/ubuntu2404.qcow2) [[md5sum]](http://download.goffinet.org/kvm/ubuntu2404.qcow2.md5sum) [[sha256sum]](http://download.goffinet.org/kvm/ubuntu2404.qcow2.sha256sum)
- [debian12.qcow2 (Bookworm)](http://download.goffinet.org/kvm/debian12.qcow2) [[md5sum]](http://download.goffinet.org/kvm/debian12.qcow2.md5sum) [[sha256sum]](http://download.goffinet.org/kvm/debian12.qcow2.sha256sum)

You can easily download them to `/var/lib/libvirt/images` with this script :

```bash
curl -s -o /usr/local/bin/download-images.sh https://raw.githubusercontent.com/goffinet/virt-scripts/master/download-images.sh
chmod +x /usr/local/bin/download-images.sh
download-images.sh
```

## How to exploit those built images

How to exploit those built images?

- In the old way with Libvirt and some bash scripts
- In a beter way with a tool like Terraform

This is always beter to know how Libvirt is working. Can you read fundamentals about [KVM virtualization in french](https://linux.goffinet.org/administration/virtualisation-kvm/).

### Enjoy with Libvirt

Please use the [kcli](https://kcli.readthedocs.io/en/latest/#) project.

For example:

```bash
image="almalinux10"
# Get kcli tool
curl https://raw.githubusercontent.com/karmab/kcli/main/install.sh | sudo bash
# Get the image
kcli download image -P url=http://download.goffinet.org/kvm/${image}.qcow2 ${image}
# Create a test vm
kcli create vm -i ${image} -P memory=2048 -P numcpus=1 -P disks=[50] ${image}
# Test SSH connexion and delete the test VM
chmod 600 sshkeys/id_rsa
sleep 30 && if [ "$(kcli ssh -u root -i sshkeys/id_rsa ${image} 'echo test')" == "test"  ] ; then echo SUCCESS ; else echo ERROR ; kcli delete vm -y ${image} ; fi
```

### Enjoy with Terraform (with libvirt)

> This section should be revised

[https://github.com/goffinet/terraform-libvirt](https://github.com/goffinet/terraform-libvirt)

Install Terraform 0.13 with a third party Libvirt provider plugin :

```bash
echo "security_driver = \"none\"" >> /etc/libvirt/qemu.conf
systemctl restart libvirtd
sudo yum -y install wget unzip || sudo apt update && sudo apt -y install wget unzip
wget https://releases.hashicorp.com/terraform/0.13.2/terraform_0.13.2_linux_amd64.zip
unzip terraform_0.13.2_linux_amd64.zip
chmod +x terraform
mv terraform /usr/local/bin/
wget https://github.com/dmacvicar/terraform-provider-libvirt/releases/download/v0.6.2/terraform-provider-libvirt-0.6.2+git.1585292411.8cbe9ad0.Ubuntu_18.04.amd64.tar.gz
tar xvf terraform-provider-libvirt-0.6.2+git.1585292411.8cbe9ad0.Ubuntu_18.04.amd64.tar.gz
mkdir -p ~/.local/share/terraform/plugins/registry.terraform.io/dmacvicar/libvirt/0.6.2/linux_amd64
cp -r terraform-provider-libvirt ~/.local/share/terraform/plugins/registry.terraform.io/dmacvicar/libvirt/0.6.2/linux_amd64/
```

Compose your libvirt infrastructure :

```bash
git clone https://github.com/goffinet/terraform-libvirt
cd terraform-libvirt/ubuntu_cloudinit
terraform plan
cd ../count
terraform plan
```

## Customization

### To customize post-processing

The `scripts/push-image.sh` generate somme meta-data and push the generated image to a pre-defined S3 Bucket.

To customize this process, you can change the content as it :

```bash
#!/bin/bash

name=$IMAGE_NAME
version=$IMAGE_VERSION
image="${name}${version}"
echo "artifacts/qemu/${image} post-processing ..."
```

Anyway, you can remove the post-processor in your image JSON template to avoid this script call.

### Customize SSH keys

To generate the ssh keys for provisionning and put it in the `sshkeys/` folder :

```bash
ssh-keygen -q -t rsa -N '' -C 'packer-kvm-default-key' -f sshkeys/id_rsa
```

To get the default ssh private key :

```bash
curl https://raw.githubusercontent.com/goffinet/packer-kvm/master/sshkeys/id_rsa
```

To get the default ssh public key :

```bash
curl https://raw.githubusercontent.com/goffinet/packer-kvm/master/sshkeys/id_rsa.pub
```

### How are these Packer templates produced?

An `build-packer-templates.yaml` Ansible playbook generates the files for each distribution using a custom [`build_packer_templates`](https://github.com/goffinet/packer-kvm/tree/master/roles/build_packer_templates) role.

## ToDo

- [ ] unique model : for efficience, a unique template should be sufficient with a data source with these elements (https://devops.stackexchange.com/q/4312).
- [ ] random secret for provisonning (https://www.packer.io/docs/templates/engine#template-variables)
- [ ] remove swap post-processing
- [ ] add versions of post-processing and images meta-datas
- [ ] include Windows templates: see [rgl/windows-vagrant](https://github.com/rgl/windows-vagrant)

Wath are the variants in those templates?

- the `iso_urls` and the `iso_checksum` template parameters
- the `ssh_username`, `ssh_password` and `ssh_private_key_file` template parameters as well as `sshkey` in kickstart files.
- the `boot_command` and provisioner commands as template parameters
- the configuration file type : kickstart, preseed or cloud-init

## Initials credits

* [https://github.com/idi-ops/packer-kvm-centos](https://github.com/idi-ops/packer-kvm-centos)
* [https://github.com/jakobadam/packer-qemu-templates](https://github.com/jakobadam/packer-qemu-templates)
* [https://github.com/leonkyneur/packer-qemu](https://github.com/leonkyneur/packer-qemu)
* [https://github.com/kaorimatz/packer-templates](https://github.com/kaorimatz/packer-templates)
* [https://github.com/bramford/packer-debian9](https://github.com/bramford/packer-debian9)
* [https://github.com/bpetit/packer-templates](https://github.com/bpetit/packer-templates)
* [https://github.com/NeCTAR-RC/nectar-images/](https://github.com/NeCTAR-RC/nectar-images/)