vke

KO | EN

gitlite — search

#python #hacktoberfest #ai #typescript #golang #rust #deep-learning #linux #macos #windows #pytorch #security #ios #openai

(★ 25)

This project is a Kubernetes Engine project developed with RKE2 for Openstack

vke 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

[![Contributors][contributors-shield]][contributors-url]
[![Forks][forks-shield]][forks-url]
[![Stargazers][stars-shield]][stars-url]
[![Issues][issues-shield]][issues-url]
[![MIT License][license-shield]][license-url]

<br />
<div align="center">

<h3 align="center">vMind Kubernetes Engine for OpenStack</h3>
  <p align="center">
     A middleware service that orchestrates the end-to-end deployment of Kubernetes clusters on OpenStack infrastructure, leveraging RKE2 to provide a fully managed and ready-to-use Kubernetes cluster solution.
    <br />
  </p>
</div>
<br />

## Getting Started

To run the application, follow these steps:

### Prerequisites

- Go 1.21+ installed on your system.
- An active OpenStack account with valid credentials.
- MySQL 8.0.36+ installed on your system and accessible.
- Logstash 8.x+ for log aggregation (optional - application works without it).

### Installation

#### Create Database

```
    mysql -h MYSQL_ADDRESS -u DATABSE_USER --password=YOUR_PASS --database=YOUR_DB < scripts/vke.sql 
    ```

**Note:** The `vke.sql` file includes the `errors` and `resources` tables for cluster error logging and resource tracking. If you're updating an existing database, you can run the separate migrations:

```
    # Add errors table
    mysql -h MYSQL_ADDRESS -u DATABSE_USER --password=YOUR_PASS --database=YOUR_DB < scripts/add_errors_table.sql
    
    # Add resources table
    mysql -h MYSQL_ADDRESS -u DATABSE_USER --password=YOUR_PASS --database=YOUR_DB < scripts/add_resources_table.sql
    
    # Add node groups taint support
    mysql -h MYSQL_ADDRESS -u DATABSE_USER --password=YOUR_PASS --database=YOUR_DB < scripts/add_node_groups_taints.sql
    ```

#### Logstash Setup (Optional - Recommended for Production)

For production environments, we recommend using Logstash for log aggregation. The application sends logs via UDP to Logstash, which then forwards them to OpenSearch/Elasticsearch. **The application works perfectly without Logstash - it will fall back to console output.**

1. Install Logstash OpenSearch output plugin:
   ```sh
   /usr/share/logstash/bin/logstash-plugin install logstash-output-opensearch
   ```

2. Use the provided Logstash configuration:
   ```sh
   cp logstash.conf /etc/logstash/conf.d/vke-api.conf
   ```

3. Start Logstash:
   ```sh
   sudo systemctl start logstash
   sudo systemctl enable logstash
   ```

#### Configuring and Running the Application Locally
1. Clone the repo
   ```sh
   git clone https://github.com/vmindtech/vke.git
   cd vke
   ```

2. Environment Configuration
    Create a configuration file (e.g., config-development.json or config-production.json) with the following structure:

**Basic Configuration (Console Logging):**
   ```json
   {
     "APP_NAME" : "vke",
     "PORT" : "80",
     "ENV" : "development",
     "VERSION" : "1.0.0",
     "MYSQL_URL": "USER:PASS@tcp(MYSQL_ADDRESS:3306)/DATABASE?charset=utf8&parseTime=true&loc=Europe%2FIstanbul",
     "COMPUTE_ENDPOINT": "https://OPENSTACK_DOMAIN:8774",
     "NETWORK_ENDPOINT": "https://OPENSTACK_DOMAIN:9696",
     "LOAD_BALANCER_ENDPOINT": "https://OPENSTACK_DOMAIN:9876",
     "IDENTITY_ENDPOINT": "https://OPENSTACK_DOMAIN:5000",
     "CLOUDFLARE_AUTH_TOKEN": "YOUR_CLOUDFLARE_TOKEN",
     "CLOUDFLARE_ZONE_ID": "YOUR_CLOUDFLARE_ZONE_ID",
     "CLOUDFLARE_DOMAIN": "YOUR_DOMAIN_FOR_DNS_RECORD",
     "PUBLIC_NETWORK_ID": "PUCLIC_NETWORK_UUID",
     "IMAGE_REF": "UBUNTU20.04-IMAGE-UUID",
     "NOVA_MICRO_VERSION": "2.88",
     "ENDPOINT":  "YOUR_VKE_API_PUBLIC_ADDRESS exp: http://vmind.com.tr/api/v1",
     "VKE_AGENT_VERSION": "1.0.0",
     "CLUSTER_AUTOSCALER_VERSION": "0.73",
     "CLOUD_PROVIDER_VKE_VERSION": "2.29.2",
     "OPENSTACK_LOADBALANCER_ADMIN_ROLE": "load-balancer_admin",
     "OPENSTACK_USER_OR_MEMBER_ROLE": "member"
   }
   ```

**Advanced Configuration (with Logstash):**
   ```json
   {
     "APP_NAME" : "vke",
     "PORT" : "80",
     "ENV" : "production",
     "VERSION" : "1.0.0",
     "MYSQL_URL": "USER:PASS@tcp(MYSQL_ADDRESS:3306)/DATABASE?charset=utf8&parseTime=true&loc=Europe%2FIstanbul",
     "COMPUTE_ENDPOINT": "https://OPENSTACK_DOMAIN:8774",
     "NETWORK_ENDPOINT": "https://OPENSTACK_DOMAIN:9696",
     "LOAD_BALANCER_ENDPOINT": "https://OPENSTACK_DOMAIN:9876",
     "IDENTITY_ENDPOINT": "https://OPENSTACK_DOMAIN:5000",
     "CLOUDFLARE_AUTH_TOKEN": "YOUR_CLOUDFLARE_TOKEN",
     "CLOUDFLARE_ZONE_ID": "YOUR_CLOUDFLARE_ZONE_ID",
     "CLOUDFLARE_DOMAIN": "YOUR_DOMAIN_FOR_DNS_RECORD",
     "PUBLIC_NETWORK_ID": "PUCLIC_NETWORK_UUID",
     "IMAGE_REF": "UBUNTU20.04-IMAGE-UUID",
     "NOVA_MICRO_VERSION": "2.88",
     "ENDPOINT":  "YOUR_VKE_API_PUBLIC_ADDRESS exp: http://vmind.com.tr/api/v1",
     "VKE_AGENT_VERSION": "1.0.0",
     "CLUSTER_AUTOSCALER_VERSION": "0.73",
     "CLOUD_PROVIDER_VKE_VERSION": "2.29.2",
     "OPENSTACK_LOADBALANCER_ADMIN_ROLE": "load-balancer_admin",
     "OPENSTACK_USER_OR_MEMBER_ROLE": "member",
     "LOGSTASH_HOST": "localhost",
     "LOGSTASH_PORT": 2053
   }
   ```

**Logging Configuration (Optional):**
   - `LOGSTASH_HOST`: Logstash server hostname (optional - defaults to console output)
   - `LOGSTASH_PORT`: Logstash UDP port (optional - defaults to console output)
   
   **Note:** If `LOGSTASH_HOST` is empty or `LOGSTASH_PORT` is 0, the application will automatically use console output. The application is designed to work seamlessly with or without Logstash.

Set the environment variable for your application's environment using the following commands in the terminal:

```sh
    export golang_env=development
    ```
    or

```sh
    export golang_env=production
    ```
    These commands will help you specify the runtime environment for your application.

3. Run the Application

To run the application using Air for automatic reloading during development, use the following command in the terminal:

```sh
    air -c .air.toml
    ```

This command will start the application and automatically reload it whenever code changes are detected, making your development process faster and more efficient.

#### Running the Application with Docker

To run the application with Docker, follow these steps:

1. Build the Docker image or pull it from [Docker Hub](https://hub.docker.com/r/vmindtech/vke-application):
    - To build the Docker image locally:
        ```sh
        docker build -t vmindtech/vke-app .
        ```

- Alternatively, you can pull the ready-made image from Docker Hub:
        ```sh
        docker pull vmindtech/vke-application:tag
        ```
        Replace `tag` with the desired version tag, for example `1.0`.

2. Run the Docker container:
    ```sh
    docker run -ti -v /opt/vke/config-production.json:/config-production.json -e golang_env='production' -p 8080:80 --name vke-application vmindtech/vke-application:tag
    ```
    Replace `tag` with the desired version tag, for example `1.0`.

This command mounts either the `config-production.json` or `config-development.json` file from your host machine into the container, sets the `golang_env` environment variable to 'production' or 'development' accordingly, and forwards requests from port `8080` on your host machine to port `80` inside the Docker container. You can replace `/opt/vke/config-production.json` or `/opt/vke/config-development.json` with the path to your actual configuration file and use any port you prefer.

3. View the application in your browser:
    Navigate to `http://localhost:8080` in your browser to view the application.

4. Stopping and removing the container:
    ```sh
    docker stop vke-application
    docker rm vke-application
    ```

Use the above commands to stop and remove the container when you're done.

Once you've successfully run the application with Docker, you can access it at `http://localhost:8080`.

## Logging System

The application uses a robust logging system with the following features:

### Logstash Integration (Optional)
- **UDP Transport**: Logs are sent via UDP to prevent application crashes when OpenSearch is unavailable
- **Fault Tolerance**: Application continues running even if Logstash/OpenSearch is down
- **Automatic Fallback**: If Logstash is unavailable, logs automatically fall back to console output
- **Structured Logging**: JSON format with timestamps, log levels, and structured fields
- **Error Handling**: Detailed error information with stack traces

### Console Logging (Default)
- **Development Friendly**: Perfect for development and testing
- **No Dependencies**: Works without any external logging infrastructure
- **JSON Format**: Structured logs in JSON format for easy parsing
- **Service Information**: Includes environment and service name in all logs

### Log Levels
- `INFO`: General application information
- `ERROR`: Error conditions that don't stop the application
- `FATAL`: Critical errors that cause application shutdown

### Log Fields
- `@timestamp`: ISO8601 formatted timestamp
- `level`: Log level (info, error, fatal)
- `message`: Log message
- `fields`: Additional structured data
- `environment`: Application environment
- `service`: Service name
- `error_message`: Error details (when applicable)
- `error_type`: Error type information

### Monitoring
When using Logstash, logs are automatically indexed in OpenSearch with the pattern `vke.prod-YYYY.MM.dd` for easy querying and monitoring.

### Configuration Examples

**Development (Console Only):**
```json
{
  "APP_NAME": "vke",
  "ENV": "development"
  // No LOGSTASH_HOST/LOGSTASH_PORT = console output
}
```

**Production (with Logstash):**
```json
{
  "APP_NAME": "vke",
  "ENV": "production",
  "LOGSTASH_HOST": "localhost",
  "LOGSTASH_PORT": 2053
}
```

**Production (with Fallback):**
```json
{
  "APP_NAME": "vke",
  "ENV": "production",
  "LOGSTASH_HOST": "localhost",
  "LOGSTASH_PORT": 2053
}
// If Logstash is down, automatically falls back to console
```

## Database Migrations

The application includes several database migration scripts for updating existing installations:

### Available Migration Commands

```bash
# Add errors table for cluster error logging
make db-add-errors-table

# Add resources table for cluster resource tracking
make db-add-resources-table

# Add taint support to node_groups table
make db-add-node-groups-taints
```

### Manual Migration

You can also run migrations manually:

```bash
# Add errors table
mysql -h MYSQL_ADDRESS -u DATABSE_USER --password=YOUR_PASS --database=YOUR_DB < scripts/add_errors_table.sql

# Add resources table
mysql -h MYSQL_ADDRESS -u DATABSE_USER --password=YOUR_PASS --database=YOUR_DB < scripts/add_resources_table.sql

# Add node groups taint support
mysql -h MYSQL_ADDRESS -u DATABSE_USER --password=YOUR_PASS --database=YOUR_DB < scripts/add_node_groups_taints.sql
```

### Migration Details

- **Errors Table**: Tracks cluster operation errors for monitoring and debugging
- **Resources Table**: Stores cluster-related resources for tracking and management
- **Node Groups Taints**: Adds Kubernetes taint support for node group scheduling

## License

Distributed under the APACHE-2.0 License. See `LICENSE` for more information.

[contributors-shield]: https://img.shields.io/github/contributors/vmindtech/vke?style=for-the-badge
[contributors-url]: https://github.com/vmindtech/vke/graphs/contributors
[forks-shield]: https://img.shields.io/github/forks/vmindtech/vke?style=for-the-badge
[forks-url]: https://github.com/vmindtech/vke/network/members
[stars-shield]: https://img.shields.io/github/stars/vmindtech/vke?style=for-the-badge
[stars-url]: https://github.com/vmindtech/vke/stargazers
[issues-shield]: https://img.shields.io/github/issues/vmindtech/vke?style=for-the-badge
[issues-url]: https://github.com/vmindtech/vke/issues
[license-shield]: https://img.shields.io/github/license/vmindtech/vke?style=for-the-badge
[license-url]: https://github.com/vmindtech/vke/blob/main/LICENSE

vke

vke 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

vke

vke 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README