cc - GitLite

KO | EN

gitlite — search

#javascript #react #typescript #go #android #machine-learning #deep-learning #linux #macos #cli #vue #mcp #openai #open-source

cc

(★ 13)

NSF EarthCube CyberConnector

cc Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

[![Build Status](https://travis-ci.org/CSISS/cc.svg?branch=master)](https://travis-ci.org/CSISS/cc) [![License](https://img.shields.io/github/license/CSISS/cc.svg)](https://github.com/CSISS/cc/blob/master/LICENSE) [![Stars](https://img.shields.io/github/stars/CSISS/cc.svg)](https://github.com/CSISS/cc/stargazers) [![Forks](https://img.shields.io/github/forks/CSISS/cc.svg)](https://github.com/CSISS/cc/network/members) [![Issues](https://img.shields.io/github/issues/CSISS/cc.svg)](https://github.com/CSISS/cc/issues) [![Coverage](https://img.shields.io/badge/covarege-100%25-success.svg)](https://codecov.io/)

# CyberConnector

NSF EarthCube Building Block project

This project aims to connect the existing data sources to the Earth science models so the generation of modeling products could be more automatic and effortless.

[CyberConnector Online Documentation](https://csiss.github.io/cc/)

# Installation

## Prerequisite

Java 1.8+ (mandatory, OpenJDK)

Apache Tomcat 8.0+ (mandatory, web container)

ncWMS 2.4.1+ (mandatory, download ncWMS.war and deploy it into Tomcat webapps folder)

[cc-thredds-pycsw](https://github.com/CSISS/cc-thredds-pycsw) (optional, if you plan to set up your own catalog)

Apache Maven 3.5.0+ (optional, building CyberConnector.war from source)

## Quick Start

### Automated Installer

CyberConnector installer support CentOS, Ubuntu/Debian and Mac OS X operating systems. To get started download the latest source code. The installer script requires two parameters: the Anaconda directory and the data directory paths.

Example usage:

```
cd install
./install.sh /opt/anaconda3 /data
```

### Docker Image

We published a Docker image in DockerHub for docker users. The pull command is:

`docker pull csiss/cc`

The run command is:

`docker run -p 8080:8080 -v DATAPATH:/home/jboss/covaliFiles csiss/cc`

# Modules

COVALI - a sub-system for comparison and validation of atmospheric and other Earth science models (funded by [EarthCube CyberWay](http://cube.csiss.gmu.edu/CyberWay/web/index))

# Usage

## COVALI

Example:

![comparison](https://raw.githubusercontent.com/CSISS/cc/master/docs/comparison_asr_era5.jpg)

General Demo:

![general](https://raw.githubusercontent.com/CSISS/cc/master/docs/covali-demo.gif)

### Roam around the Globe

![roam](https://raw.githubusercontent.com/CSISS/cc/master/docs/ccportal.gif)

COVALI has different projection options and 3-D view to enable multi-perspective viewing the data.

![globe](https://raw.githubusercontent.com/CSISS/cc/master/docs/cc-3d.gif)

### Search Data

#### Search in UCAR server

![ucar](https://raw.githubusercontent.com/CSISS/cc/master/docs/search_ucar.png)

#### Search in the public folder

![local](https://raw.githubusercontent.com/CSISS/cc/master/docs/search_local.png)

Search results are listed in a panel where users can directly download the files or load them into the maps.

![localresult](https://raw.githubusercontent.com/CSISS/cc/master/docs/search_results.png)

### Add Data

COVALI supports visualizing GRIB/NetCDF data on the maps.

![visualization](https://raw.githubusercontent.com/CSISS/cc/master/docs/cc-add-data.gif)

### Settings

COVALI provides a Settings menu to controll the two maps. It allows users to manage the added data layers.

![settings](https://raw.githubusercontent.com/CSISS/cc/master/docs/cc-settings.gif)

### Tools

COVALI provides a number of tools to facilitate the comparison and validation among the data.

#### Animation

Create an animation from multiple data time steps.

![animdemo](https://raw.githubusercontent.com/CSISS/cc/master/docs/animdemo.gif)

#### Statistic Report

Users can draw points or lines on the map to get a statistics on the values on the points or along the lines.

![linestats](https://raw.githubusercontent.com/CSISS/cc/master/docs/line_stats.png)

#### Regridding

Regridding for NetCDF data is supported but requires additional configuration. Regridding uses ESMF (Earth Science Modeling Framework) and xESMF Python libraries.

First, [Anaconda](https://docs.anaconda.com/anaconda/install/) must be installed and it's location must be set in `config.properties` file. For example: `anaconda_path=/opt/anaconda3`

Second, a new environment with correct dependencies must be configured:
```$bash
conda create -n esmpy8 -y
conda install -y -n esmpy8  -c conda-forge "esmf!=*nompi" esmpy xarray=0.14.1 scipy dask netCDF4 xesmf libnetcdf=4.6.2 netcdf4=1.5.1
```

![regridding](https://raw.githubusercontent.com/CSISS/cc/master/site/regridding-demo.gif)

#### NCO Operations

The following NetCDF operators are supported for selected variables in files:

* ncra (Record Average)
* ncbo (Binary Operators: Add, Subtract, Multiply, Divide)
* ncap2 (Scriptable Arithmetic Operator)

![ncra](https://raw.githubusercontent.com/CSISS/cc/master/docs/ncra.png)

![ncbo](https://raw.githubusercontent.com/CSISS/cc/master/docs/ncbo.png)

![ncap2](https://raw.githubusercontent.com/CSISS/cc/master/docs/ncap2.png)

ncdump is supported for providing file information for NCO and Regridding tools:

![ncdump](https://raw.githubusercontent.com/CSISS/cc/master/docs/ncdump.png)

#### Map rotation

Use `Alt+Shift+Drag` to rotate the map.

![rotate](https://raw.githubusercontent.com/CSISS/cc/master/docs/map_rotate.png)

# Demo Site

A demo instance has been deployed on George Mason University server. [here](http://cube.csiss.gmu.edu/CyberConnector/web/covali)

# License

MIT

# Developers

[developer list](authors.md)

# Funders

National Science Foundation (#1740693 and #1440294)

![nsf](https://raw.githubusercontent.com/CSISS/cc/master/docs/logo_nsf.gif)

cc

cc Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

cc

cc Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README