crane

KO | EN

gitlite — search

#python #hacktoberfest #typescript #android #machine-learning #rust #docker #macos #windows #kubernetes #vue #pytorch #openai #mcp

(★ 55)

Tool for migrating Kubernetes workloads, and their data, between clusters.

crane Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Crane

**Important: This repository is under active development including breaking changes. If you are looking for the `crane` you used in last few years, use the [old-main](https://github.com/migtools/crane/tree/old-main) branch or [v0.0.6](https://github.com/migtools/crane/releases/tag/v0.0.6) tag.**

---

## Intro
Crane is a migration tool under the [Konveyor](https://www.konveyor.io/) community that helps application owners migrate Kubernetes workloads and their state between clusters.

## Build and Test Status

| Branch | Build & unit tests (after merge) | E2E CI (after merge) | E2E Nightly (cron) |
| :----- | :------------------------------- | :------------------- | :----------------- |
| main | [![Go](https://github.com/migtools/crane/actions/workflows/go.yml/badge.svg?branch=main&event=push)](https://github.com/migtools/crane/actions/workflows/go.yml?query=branch%3Amain+event%3Apush) | [![Tier0 CI](https://github.com/migtools/crane/actions/workflows/run-e2e-tier0-tests.yml/badge.svg?branch=main&event=push)](https://github.com/migtools/crane/actions/workflows/run-e2e-tier0-tests.yml?query=branch%3Amain+event%3Apush)<br>[![Tier1 CI](https://github.com/migtools/crane/actions/workflows/run-e2e-tier1-tests.yml/badge.svg?branch=main&event=push)](https://github.com/migtools/crane/actions/workflows/run-e2e-tier1-tests.yml?query=branch%3Amain+event%3Apush) | [![Tier0 Nightly](https://github.com/migtools/crane/actions/workflows/run-e2e-tier0-tests.yml/badge.svg?branch=main&event=schedule)](https://github.com/migtools/crane/actions/workflows/run-e2e-tier0-tests.yml?query=branch%3Amain+event%3Aschedule)<br>[![Tier1 Nightly](https://github.com/migtools/crane/actions/workflows/run-e2e-tier1-tests.yml/badge.svg?branch=main&event=schedule)](https://github.com/migtools/crane/actions/workflows/run-e2e-tier1-tests.yml?query=branch%3Amain+event%3Aschedule) |
| release-0.10 | [![Go](https://github.com/migtools/crane/actions/workflows/go.yml/badge.svg?branch=release-0.10&event=push)](https://github.com/migtools/crane/actions/workflows/go.yml?query=branch%3Arelease-0.10+event%3Apush) | [![Tier0 CI](https://github.com/migtools/crane/actions/workflows/run-e2e-tier0-tests.yml/badge.svg?branch=release-0.10&event=push)](https://github.com/migtools/crane/actions/workflows/run-e2e-tier0-tests.yml?query=branch%3Arelease-0.10+event%3Apush)<br>[![Tier1 CI](https://github.com/migtools/crane/actions/workflows/run-e2e-tier1-tests.yml/badge.svg?branch=release-0.10&event=push)](https://github.com/migtools/crane/actions/workflows/run-e2e-tier1-tests.yml?query=branch%3Arelease-0.10+event%3Apush) | [![Tier0 Nightly](https://github.com/migtools/crane/actions/workflows/nightly-release-0.10-e2e-tier0.yml/badge.svg?event=schedule)](https://github.com/migtools/crane/actions/workflows/nightly-release-0.10-e2e-tier0.yml)<br>[![Tier1 Nightly](https://github.com/migtools/crane/actions/workflows/nightly-release-0.10-e2e-tier1.yml/badge.svg?event=schedule)](https://github.com/migtools/crane/actions/workflows/nightly-release-0.10-e2e-tier1.yml) |

## YouTube Demo
[![Alt text](https://img.youtube.com/vi/PoSivlgVLf8/0.jpg)](https://www.youtube.com/watch?v=PoSivlgVLf8)

## Overview

Migrating an application between Kubernetes clusters may be more nuanced than one would imagine.  In an ideal situation, this would be as simple as applying the YAML manifests to the new cluster and adjusting DNS records to redirect external traffic, yet often there is more that is needed.  Below are a few of the common concerns that need to be addressed:
* _YAML manifests_ - do we have the original YAML manifests stored in version control or accessible so we can reapply to the new cluster?
* _Configuration Drift_ - if we do have the YAML manifests, do we have confidence they are still accurate and represent the application as it’s running in the cluster? Perhaps the application has been running for a period of time, been modified, and we no longer have confidence we can reproduce it exactly as it’s currently running.
* _State_ - we may need to address persisted state that has been generated inside of the cluster, either small elements of state such as generated certificates stored in a Secret, data stored in Custom Resources, or gigabytes of data in persistent volumes.  
* _Customizations needed for new environment_ - we may be migrating across cloud vendors or environments that require transformations to the applications so they run in the new environment.

Crane helps users do more than just handle a point in time migration of a workload, it is intended to help users adopt current best practices such as onboarding to GitOps by reconstructing redeployable YAML manifests from inspecting a running application.  The project is the result of several years of experience performing large-scale production Kubernetes migrations and addressing the lessons learned.

Crane follows the Unix philosophy of building small sharply focused tools that can be assembled in powerful ways.  It is designed with transparency and ease-of-diagnostics in mind. It drives migration through a pipeline of non-destructive tasks that output results to disk so the operation can be easily audited and versioned without impacting live workloads. The tasks can be run repeatedly and will output consistent results given the same inputs without side-effects on the system at large.

Crane is composed of several repositories:
* [konveyor/crane](https://github.com/konveyor/crane): (this repo) The command line tool that migrates applications to the terminal.
* [konveyor/crane-lib](https://github.com/konveyor/crane-lib): The brains behind Crane functionality responsible for transforming resources.
* [konveyor/crane-plugins](https://github.com/konveyor/crane-plugins): Collection of plugins from the Konveyor community based on experience from performing Kube migrations.
* [konveyor/crane-plugin-openshift](https://github.com/konveyor/crane-plugin-openshift): An optional plugin specifically tailored to manage OpenShift migration workloads and an example of a repeatable best-practice.
* [migtools/pvc-transfer](https://github.com/migtools/pvc-transfer): The library that powers the Persistent Volume migration ability, shared with the [VolSync](https://volsync.readthedocs.io/en/stable/index.html) project.  State migration of Persistent Volumes is handled by rsync allowing storage migrations between different storage classes.  
* [konveyor/crane-runner](https://github.com/konveyor/crane-runner): A collection of resources showing how to leverage Tekton to build migration workflows with Crane
* [konveyor/crane-ui-plugin](https://github.com/konveyor/crane-ui-plugin): A dynamic UI plugin for the [openshift/console](https://github.com/openshift/console)
* [konveyor/mtrho-operator](https://github.com/konveyor/mtrho-operator): An Operator which deploys Crane in an opinionated manner leveraging Tekton for migrating applications

How does it work? Crane works by:
1) Inspecting a running application and exporting all associated resources
2) Leveraging a library of plugins to aid in transforming the exported manifests to yield redeployable manifests
3) Applying the transformed manifests into the destination cluster
4) Optionally orchestrating persistent state migrations

## Downloads

## Install

* Obtain the `crane` binary from either:
    * Download a prebuilt binary from the links in the `Downloads` section above.
    * Clone this repo and build the crane binary via: `go build -o crane main.go`
  * Install the `crane` binary in your `$PATH`

## Usage Example
1. `$ kubectl create namespace guestbook`
1. `$ kubectl --namespace guestbook apply -k github.com/konveyor/crane-runner/examples/resources/guestbook`
1. `$ crane export -n guestbook`
  * Discovers and exports all resources in the 'guestbook' namespace
  * A directory 'export/resources/guestbook' is populated with the raw YAML content of each exported resource 
  * Example:
    * `$ cat export/resources/guestbook/Secret_guestbook_builder-dockercfg-5ztj6.yaml`

kind: Secret
            apiVersion: v1
            metadata:
              name: builder-dockercfg-5ztj6
              namespace: guestbook
              resourceVersion: "3213488"
              uid: 8fb75dcd-68b2-4939-bfb9-1c8241a7b146
              ... 
            data:
              .dockercfg: < ...SNIP.... >

4. `$ crane transform`
  * A directory `transform/10_KubernetesPlugin/` is created with a Kustomize layout:
    * `input/` - Exported resources grouped by type
    * `patches/` - JSONPatch operations to clean resources
    * `kustomization.yaml` - Kustomize configuration
  * The built-in Kubernetes plugin generates patches to remove live/runtime metadata
  * Example: 
    * `$ cat transform/10_KubernetesPlugin/patches/guestbook--v1--Secret--builder-dockercfg-5ztj6.patch.yaml`

- op: remove
              path: /metadata/uid
            - op: remove
              path: /metadata/resourceVersion
            - op: remove
              path: /metadata/creationTimestamp
          
      * These patches remove server-managed fields that would conflict when applying to a new cluster.
    * `$ cat transform/10_KubernetesPlugin/input/secret.yaml` - Contains the original exported Secret with all metadata

5. `$ crane apply`
  * Runs embedded kustomize on the transform stage to apply patches
  * Outputs clean, declarative YAML to `output/output.yaml`
  * Example:
    * `$ cat output/output.yaml`

---
            apiVersion: v1
            kind: Secret
            metadata:
              name: builder-dockercfg-5ztj6
              namespace: guestbook
            data:
              .dockercfg: < ...SNIP.... >

* Note that the fields `metadata.uid`, `metadata.resourceVersion`, and `metadata.creationTimestamp` have been removed.
6. The content in `output/output.yaml` is now ready to be deployed to the target cluster or checked into Git for GitOps workflows:
    * `$ kubectl apply -f output/output.yaml`

## Documentation

For comprehensive documentation, see the [docs/](docs/README.md) directory:

- [Installation](docs/installation.md)
- [Command Reference](docs/README.md#command-reference) — export, transform, apply, validate, transfer-pvc
- [Contributing](CONTRIBUTING.md) | [Development Guide](docs/development/README.md)

## Further Examples

Please see [konveyor/crane-runner/main/examples](https://github.com/konveyor/crane-runner/tree/main/examples#readme) for further scenarios to explore what can be done with Crane + Tekton for migrating applications.

## Known issues

- v0.0.2 (alpha1)
  - The new-namespace optional arg (and associated functionality) in the
    built-in kubernetes plugin is incomplete. `metadata.namespace` will be
    modified, but other required changes will not be made. It will be
    removed from this plugin in the next release and expanded
    functionality will most likely be added via a separate (optional)
    plugin.

crane

crane Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

crane

crane Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README