ci-cd-workflow

KO | EN

gitlite — search

#python #typescript #llm #machine-learning #rust #docker #java #windows #awesome #vue #awesome-list #ios #openai #open-source

(★ 13)

This repo is a containerized workflow of an application, a ci-cd pipeline to deploy the application to either a staging or production server and also with monitoring setup using prometheus with data aggregated from cAdvisor and Pecona MMS (for monitoring MySQL instance), visualized with Grafana.

ci-cd-workflow 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# CI/CD Workflow Simulation using Docker

This repo is a containerized workflow of an application, a ci-cd pipeline to deploy the application
to either a staging or production server and also with monitoring setup using prometheus with 
data aggregated from cAdvisor and MySQLD Exporter (for monitoring MySQL instance), visualized with Grafana.

It starts the simulation from the `./application` folder, this folder simulates a git repo, a folder
on your machine, basically where you code or store codes, it is the starting point and this code will be
delivered to either the staging or production environment using Jenkins as the CI/CD pipeline.

When you access Jenkins, You have access to a dashboard that you can kickstart a blue ocean deployment. 
This checks out the code, installs all dependencies and setup, runs the tests and then prompts you to 
choose either the production or staging server and then simulates a deploy to the server which can be 
accessed on your browser (see more at SETUP section).

The filesystem for the staging server can be found at `./filesystem/staging` and production server 
filesystem at `./filesystem/production` all in this same folder but they will be access differently at
`production.ci-workflow.test:82` and `staging.ci-workflow.test:81` respectfully after we are done setting up.

## Base Requirements
While this might sound very intuitive but it is worthy of mention that you need to have docker installed
on the machine you want to run this simulation on.

## Steps to set up simulation

After cloning this repository, it is advised to run the `./setup.sh` script as sudo once.
this will copy the `.env.example` file to `.env` that has the docker environment keys
and setup the staging and production url in the hosts file.

## Jenkinsfile
This project has a `Jenkinsfile` in the root folder and this will be used to create a pipeline. A pipeline
is a series of stages that will be processed mostly starts from the code repo and ends on the selected server.

To see an explaination of our Jenkinsfile please refer to the Jenkins Config Section.

After bringing the project up, using `docker-compose up -d`, navigate on your browser to `localhost:{JENKINS_PORT}`
and after a few seconds you will see a login screen, input the credentials:
- Username: admin
- Password: admin

After gaining access to the web interface, you will need to create a new pipeline.

![Jenkins Desktop](https://i.ibb.co/vJrxhxH/jenkins.png)

On the homepage as above, 
- Click on `Create a job`
- Give the job a name (No spaces prefered) and choose the `Pipeline` option
- Click Ok
- On the new page, give a description or leave it empty
- Scroll to the end of the page and you'll see a Pipeline script textbox
- Paste in the content of `./Jenkinfile`
- Click save.

On doing the above, you will be redirected to a new page, click n open blue ocean by the side and run the job.

Note: If youre asked for an admin token while setting up, check `./docker/jenkins/data/secrets/initialAdminPassword`

## NGINX Configs for staging and production servers

We have two instances of Nginx that is sets up to serve the production and staging content,
the urls are:
 - `production.ci-workflow.test:{PRODUCTION_PORT}`
 - `staging.ci-workflow.test:{STAGING_PORT}`

The ports are provided to avoid conflicts on the host machine, you can also use proxy pass to
avoid specifying the port on the browser but that would need another instance of nginx and we didn't
want that, at least not now.

### Config for PRODUCTION
This file can be found at `./docker/nginx/production/default.conf` and the two important configs
are:
```
server_name production.ci-workflow.test;
root /var/www/html/production/public;
```

if you want to serve your production contents on another url, please update the server name details
and to serve the files in a different folder, update the root directory.

### Config for STAGING
This file can be found at `./docker/nginx/staging/default.conf` and the two important configs
are:
```
server_name staging.ci-workflow.test;
root /var/www/html/staging/public;
```

if you want to serve your production contents on another url, please update the server name details
and to serve the files in a different folder, update the root directory.

## Jenkins Config

The Jenkinsfile used for this project can be found in the root directory and provides steps for the 
CI/CD pipeline.

```
pipeline {
    agent any

stages {
        stage('Setup') {
            steps {
                script {
                    ...
                }
            }
        }
        stage('Build') {
            steps {
                script {
                    ...
                }
            }
        }

stage('Test') {
            steps {
                script {
                   ...
                }
            }
        }

stage ('Deploy') {
            ...

steps {
              ...
            }
        }
    }
}

```

This defines four steps:
- Setup - simulates cloning the project to the jenkins workspace
- Build - runs composer install and env setups etc
- Test - runs tests on the project
- Deploy - asks for a server to deploy to and deploys

How to use this file will be mentioned in the setup section of Jenkins.

## Dockerfile Services Used

The docker file has 8 services running

- Prometheus
- Grafana
- cAdvisor
- Jenkins
- 2 instances of Nginx (Staging and Production)
- PHP
- MySQL
- MySQLD Exporter

## What is cAdvisor?

cAdvisor stands for container advisor and was developed then open-sourced by Google.
Its job is to collect and aggregate data on docker containers - so if you're running your
application and you need the metrics for the container to probably monitor on a monitoring
platform like Prometheus (in our case) then cAdvisor gives you every detail you need.

It has a web based interface and can be access at: localhost:{CADVISOR_PORT} (substitute the port number for the one defined in your env file)
the UI is pretty intuitive.

## What is Jenkins

Jenkins is yet another open source tool that is widely utilized for CI/CD pipelines. It helps to automate
building, testing and deploying softwares.

It handles all this process to an almost intuitive web interface which can be access at: localhost:{JENKINS_PORT} (substitute the port number for the one defined in your env file)

Setting up Jenkins for the first time would require a password which can be found inside the `./docker/jenkins/secrets/initialAdminPassword` file 
and then follow the prompts to complete the setup.

## What is Prometheus
Prometheus is a real time time-series data aggregator, it gets data from sources and allows you to work with that data
either for monitoring or as a muster point to passing multiple data sources as one to another tool, in our case Grafana.
It is a critical monitoring tool and has gained popularity over time.

## What is Grafana
Grafana is a data monitoring and visualization tool, it's strength is the visualization in my opinion, it has ability to create
sophisticated dashboards. Metrics monitored can be analyzed and also alerts can be setup for it.

## What is Nginx
Nginx is a popular web server and can also be used as a reverse proxy tool, but we are using it as a 
web server in this context.

To see it in use as a reverse proxy, please check this other example i made
[Using Nginx as load balancer](https://github.com/elishaukpong/load-balancer-docker)

## What is PHP
This is a tool for processing php scripts and very useful in web development and can be embedded into HTML

## What is MySQL
An open-source relational database management system (RDBMS) based on Structured Query Language (SQL). 
It's widely used for web databases and supports various database operations, including data storage, 
retrieval, and management.

ci-cd-workflow

ci-cd-workflow 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

ci-cd-workflow

ci-cd-workflow 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README