Geochemistrypi

KO | EN

gitlite — search

#javascript #ai #android #machine-learning #rust #deep-learning #macos #nodejs #java #cli #vue #security #ios #open-source

(★ 115)

an open-sourced highly automated machine learning Python framework for data-driven geochemistry discovery

파일 탐색기

최종 버전 다운로드 (.zip)

- - geochemistrypi.yml
  - release.yml
- CODEOWNERES
- - conf.py
  - contact us.rst
  - contributing.rst
  - deployment.rst
  - index.rst
  - model example.rst
- Geochemistry π.ico
- Geochemistry π.png
- Geochemistryπ-Activity Diagram_v1.png
- make.bat
- Makefile
- - __init__.py
  - constants.py
  - dependencies.py
  - router.py
  - schemas.py
  - service.py
  - sql_models.py
  - utils.py
- - __init__.py
  - aggregate.py
  - cli_pipeline.py
  - constants.py
  - dash_pipeline.py
  - datasets.py
  - enum_.py
  - router.py
  - run_time_series.py
  - schemas.py
  - service.py
  - sql_models.py
- - .gitignore
  - .prettierrc.json
  - .stylelintrc.json
  - auto-imports.d.ts
  - components.d.ts
  - env.d.ts
  - eslint.config.js
  - index.html
  - package-lock.json
  - package.json
  - README.md
  - tsconfig.app.json
  - tsconfig.json
  - tsconfig.node.json
  - vite.config.ts
- __init__.py
- _version.py
- automation.py
- cli.py
- database.py
- start_cli_pipeline.py
- start_dash_pipeline.py
- tracking.py
- tracking_cli.py
- - pyproject.toml
  - README.md
  - uv.lock
- development.txt
- production.txt
- - test_classification_cli_contract.py
- installed-wheel-pytest.ini
- test_database_boundary.py
.flake8
.gitignore
.pre-commit-config.yaml
.readthedocs.yaml
Dockerfile
LICENSE
package.json
pyproject.toml
README.md
uv.lock

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

---

**Online Documentation**: <a href="https://geochemistrypi.readthedocs.io" target="_blank">https://geochemistrypi.readthedocs.io</a> &nbsp;|&nbsp;
**Source Code**: <a href="https://github.com/ZJUEarthData/geochemistrypi" target="_blank">https://github.com/ZJUEarthData/geochemistrypi</a>

---

## 📖 Table of Contents

- [✨ Overview](#-overview)
- [⚡ Quick Installation](#-quick-installation)
- [🔄 Quick Update](#-quick-update)
- [📁 Data Preparation](#-data-preparation)
- [🏃 Running Examples](#-running-examples)
- [🗺️ Roadmap](#️-roadmap)
- [🧠 Geochemistry π Mind Map](#-geochemistry-π-mind-map)
- [👥 Team Info](#-team-info)
- [🤝 Join Us](#-join-us-)
- [📚 In-house Materials](#-in-house-materials)
- [🎬 In-house Videos](#-in-house-videos)
- [🙏 Contributors](#-contributors)
- [📊 Project Statistics](#-project-statistics)
- [⭐ Support the Project](#-support-the-project)

## ✨ Overview

Geochemistry π is an **open-sourced highly automated machine learning Python framework** dedicating to build up MLOps level 1 software product for data-driven geochemistry discovery on tabular data.

**🎯 Our goal**: one data-mining run in 5 minutes, ten data-mining runs in 10 minutes.

### 🧩 Core Capabilities

+ **Continuous Training**
+ **Machine Learning Lifecycle Management**
+ **Model Inference**

### 🔑 Key Features

+ **Easy to use:** The automation of data mining process provides the users with simple number options to choose.
+ **Extensible:** It allows appending new algorithms through Scikit-learn with automatic hyper parameter searching by FLAML and Ray.
+ **Traceable**: It integrates MLflow to build special storage mechanism to streamline the end-to-end machine learning lifecycle.

---

**📢 Latest Update**: follow up by clicking `Starred` and `Watch` on our [GitHub repository](https://github.com/ZJUEarthData/geochemistrypi), then get email notifications of the newest features automatically.

💬 **Note**: **Chatbot** driven by multi-agent system is available in the right-bottom corner of [Online Documentation](https://geochemistrypi.readthedocs.io) with a blue button.

---

## 📊 Overview Figures

The following figure is the simplified overview of Geochemistry π:

The following figure is the frontend-backend separation architecture of Geochemistry:

---

## 📄 Citation

**If the software contributes to your research, cite the work as :**

ZhangZhou J\*, He Can\*, Sun Jianhao, Zhao Jianming, Lyu Yang, Wang Shengxin, Zhao Wenyu, Li Anzhou, Ji Xiaohui. Geochemistry π: Automated machine learning python framework for tabular data (2024). Geochemistry, Geophysics, Geosystems, 25, e2023GC011324

📥 Download link: https://agupubs.onlinelibrary.wiley.com/doi/10.1029/2023GC011324

🔗 This project has been **mentioned** in the following articles:

- [Xirui Qiao et al. (2026) - Machine learning thermobarometry: Methods, applications, and a benchmarking protocol - **Lithos**](https://www.sciencedirect.com/science/article/pii/S0024493726002665?via%3Dihub)
- [Fangbin Liu et al. (2026) - Integrating multi-algorithm machine learning with zircon REE geochemistry to trace source-to-sink provenance in the Mekong River Basin - **Geomorphology**](https://www.sciencedirect.com/science/article/pii/S0169555X26001194?via%3Dihub)
- [Jia-Min Lin et al. (2026) - An enhanced machine learning plagioclase-liquid hygrometer for magmatic H2O estimation across different tectonic settings - **GEOLOGICAL SOCIETY OF AMERICA BULLETIN**](https://pubs.geoscienceworld.org/gsa/gsabulletin/article/doi/10.1130/B38631.1/729054/An-enhanced-machine-learning-plagioclase-liquid)
- [Maria-Emanuela Mihailov et al. (2026) - Hydro-Sedimentological Controls on Natural and Anthropogenic Radionuclide Distribution in the Western Black Sea Shelf - **Environments**](https://www.mdpi.com/2076-3298/13/4/184)
- [Ying-Hui Gao et al. (2025) - A systematic evaluation of data preprocessing and model optimization for machine learning algorithms: Using sphalerite trace element data as an example - **Journal of Asian Earth Sciences**](https://www.sciencedirect.com/science/article/pii/S1367912025002433?via%3Dihub)
- [Chufan Zhou et al. (2025) - Advances of machine learning in stable isotope geochemistry - **Journal of Analytical Atomic Spectrometry**](https://pubs.rsc.org/ja/article/40/12/3344/313940/Advances-of-machine-learning-in-stable-isotope)
- [Chun-Tao Liu et al. (2025) - The sub-arc mantle has remained oxidized since the Neoproterozoic oxygenation event - **Nature Communications**](https://www.nature.com/articles/s41467-025-62821-8)
- [Alessandro Musu et al. (2025) - Orange-Volcanoes: A new open and collaborative platform to perform data-driven investigations and machine learning analyses in petrology and volcanology - **Applied Computing and Geosciences**](https://www.nature.com/articles/s41467-025-62821-8)
- [G. A. Shevchenko et al. (2025) - Applications of Data Science Methods in Petroleum Geochemistry: Current State - **Moscow University Geology Bulletin**](https://link.springer.com/article/10.3103/S0145875225700413)
- [Yang LYU et al. (2025) - Storage and analysis of tabular data of mineralogy, petrology and geochemistry: from on-premises to cloud - **Bulletin of Mineralogy Petrology and Geochemistry**](https://www.sciengine.com/BMPG/doi/10.3724/j.issn.1007-2802.20240161)
- [Lin Deng et al. (2025) - Automated machine learning for residential property valuation - **ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE**](https://webofscience.clarivate.cn/wos/woscc/full-record/WOS:001633342400006)
- [Jun-Wei Zhang et al. (2025) - Clustering-Informed Retrieval-Augmented Generation for LLM-Based Log Anomaly Detection - **NAECON 2025 - IEEE National Aerospace and Electronics Conference**](https://www.new-discovery.org.cn/doi?10.61958%2FNDYE8925)
- [Maurizio Petrelli et al. (2024) - Machine Learning in Petrology: State-of-the-Art and Future Perspectives - **JOURNAL OF PETROLOGY**](https://watermark02.silverchair.com/egae036.pdf?token=AQECAHi208BE49Ooan9kkhW_Ercy7Dm3ZL_9Cf3qfKAc485ysgAAA4MwggN_BgkqhkiG9w0BBwagggNwMIIDbAIBADCCA2UGCSqGSIb3DQEHATAeBglghkgBZQMEAS4wEQQMlThym3WIFGRhP7zlAgEQgIIDNj90NL33udKqpylufPSnv1arXxA3F7eVO0mtrESEe3H9tDv7vlo-i0Mulz2ZQEp1xehwO5HSS8H_qvHW9LYEYOOR_G7iVHLMNWKknioOFjUXtxKmT6-tcpQzlLctcPkgckptOj0v5fK6dPs0elcTAyhlDNyXT-UAwIJfl9U__XLxb1BifS9wJpoX6BijOikdUz51bcF19PPo-Bp9Hg9fzBTUcw4Xevos3O_ZOkKE5esUeAavOWYJ2gLKo2l5oxaqaIEE_kOJejIO5J0zJqfDY7xRRe37FzzerHtwmSRM49yrEO2cSahx1knyQFtQOz2TULhGxrXyR-ez-S16jmq_7MnQ7noeqi4uGJHvmkxt_IiVodGICLicy2v9sOoAUV3IHZTUlG3fhj12Mnx8jLcersUWrMTLDoXmtWjRQl_r9A1NS9eWYPL5Z1Qk5IcJ06nqtCDV1y14x_qwvKej71uNtJ5DDXaeXSWJZ8q9NLkAj_b5MdWR6USJF9sgaJ_bZpow2X8BKqw2WKdMsL4CQkdaQ8r5-0oUi4pBB6owl7WvdUkGLaalchz-OZ7GUllByJZfPV28KG3QseZNwKPPdUgWIMK5DZEU9HujYdc9H05mFd8Zbc7itU0ozy1BC3rN00k05ysmYFk3OPgm9TThQs0mZ4vKYPWiVoMyLHtvIz3cwzPle7WHxbKUaJq1h9m_FzWPvwOWvgMTee9CCq153IFi2T9-cMQ4_nPfZikH7WVZFHcAXTtb_WYzzVLkINo0_rwGNaB44EQ5x_pxOUkH6wDhK-Rsd88S1RWLyC9ycA2ri_5rpfi_Oy3Jv1YCzE3lKNH1vqXIi0Y5js7ZmoIwxLAmbsWWWiGmjLRmpXEhluFfQD8kffsZeOowNGrwnAAZ8XzhOirZButcjB4Jsguxl8t_1GM8mQM7SQCxSkt_CQQJCsQb_NQcScZZtVhapo5s_3P23HMn-HfpyrKkBZ_DK4qfVQt1KqYHdFNpuk2EIxg5EWRfsro4OpXBzefotMnBWQmn1E9PcAs5QWzvZuPTKhV8AUWGvwDL7lmp6SDDdtMwyxH-DBuFnG8r2HLpQxK7mVGheErNPwHhAQ)
- [Deng Lin (2024) - Develop an Automated Machine Learning Platform for Residential Property Valuation - **Hong Kong University of Science and Technology (Hong Kong)**](https://www.proquest.com/docview/3143977758?pq-origsite=wos&accountid=178611&sourcetype=Dissertations%20&%20Theses)

---

## 🏆 Recognition

**Related report:**

Geochemistry π was selected for featuring as an Editor’s Highlight in EOS magazine by American Geophysical Union (fewer than 2 percent of paper are selected) and quoted in Geochemical NEWS by Geochemical Society.

🔗 Eos Website: https://eos.org/editor-highlights/machine-learning-for-geochemists-who-dont-want-to-code

---

## 🎥 Video Demo

Have an overview of how our software can accelerate your data-mining experiment.

- Interact with Deepseek to help install the new version of Geochemistry π and upgrade from the old version [[Bilibili]](https://www.bilibili.com/video/BV1regY6sE9s/?spm_id_from=333.1387.homepage.video_card.click) | [[YouTube]](https://www.youtube.com/watch?v=S5PLFnpB1jA)
- Introduction to New Features in Geochemistrypi V0.8.0 - Yunzhou Han and Chufan Zhou [[Bilibili]](https://www.bilibili.com/video/BV14W3T6FEvf/?spm_id_from=333.1387.homepage.video_card.click)
- Geochemistry π v0.7.0 Introduction Video [[Bilibili]](https://www.bilibili.com/video/BV1TorTYVEgn/?vd_source=27944ab3b73a78970c1a52a5dcbb9140) | [[YouTube]](https://www.youtube.com/watch?v=6IVaO_gq22A)
- Geochemistry π v0.7.0 for Regression Demo [[Bilibili]](https://www.bilibili.com/video/BV1VormYvEt8/?spm_id_from=333.1387.homepage.video_card.click&vd_source=27944ab3b73a78970c1a52a5dcbb9140) | [[YouTube]](https://www.youtube.com/watch?v=eTJ-IV1n4QM)
- Geochemistry π v0.7.0 for Classification Demo [[Bilibili]](https://www.bilibili.com/video/BV1ZDrSYjEBv/?spm_id_from=333.1387.homepage.video_card.click&vd_source=27944ab3b73a78970c1a52a5dcbb9140) | [[YouTube]](https://www.youtube.com/watch?v=c_eDI2gVTr0)
- MLflow UI user guide - Geochemistry π v0.5.0 [[Bilibili]](https://b23.tv/CW5Rjmo) | [[YouTube]](https://www.youtube.com/watch?v=Yu1nzNeLfRY)
- Geochemistry π - Download and Run the Beta Version [[Bilibili]](https://www.bilibili.com/video/BV1UM4y1Q7Ju/?spm_id_from=333.999.0.0&vd_source=27944ab3b73a78970c1a52a5dcbb9140) | [[YouTube]](https://www.youtube.com/watch?v=EeVaJ3H7_AU&list=PLy8hNsI55lvh1UHjhVhqNUj3xPdV9sEiM&index=9)
- Geochemistry π - Installation Guide via EXE File [[Bilibili]](https://www.bilibili.com/video/BV1YmFPe4ESQ/?spm_id_from=333.337.search-card.all.click) | [[YouTube]](https://www.youtube.com/watch?v=LW5Cngcal9Q)
- Installing Geochemistry π in Pycharm [[Bilibili]](https://www.bilibili.com/video/BV1jr5Z6hEdZ/?spm_id_from=333.1387.collection.video_card.click)
- Geochemistry π - full range [[Bilibili]](https://space.bilibili.com/616904352/lists/2188618?type=series)

---

## ⚡ Quick Installation

Our software is well tested on **macOS** and **Windows** system with **Python 3.9**. Other systems and Python version are not guaranteed.

### 1. Download via Terminal

One instruction to download on **command line**, such as Terminal on macOS, Power Shell on Windows.

```bash
pip install geochemistrypi
```

Download the latest version to avoid some old version issues, such as dependency downloading.

```bash
pip install "geochemistrypi==0.8.1"
```

One instruction to download on **Jupyter Notebook** or **Google Colab**.

```python
!pip install geochemistrypi
```

Download the latest version to avoid some old version issues, such as dependency downloading.

```python
!pip install "geochemistrypi==0.8.1"
```

The following screenshot shows the downloads by instruction and launching of our software on macOS:

You might run into some issues during installation, please refer to:

- [Geochemistry π - Possible Issues with pip Installation in China - Li Keran]( https://www.bilibili.com/video/BV1Gs4y1d7Cm/)
- [Geochemistry π - How to Fix pip Installation Failures in China - Li Keran]( https://www.bilibili.com/video/BV1zg4y1j7bx/)
- [Geochemistry π - Currently the Fastest Install Method in China — Installing from GitHub Using Requirements - Li Keran]( https://www.bilibili.com/video/BV1pM411V7iR/)
- [Geochemistry π - Command Line Version Operation Demo Video](https://www.bilibili.com/video/BV1Tv4y1C79k/)

### 2. Download via EXE

For Windows users, there is an alternative way to download by one-click via [.exe](https://github.com/ZJUEarthData/Geochemistrypi/releases/download/v0.7.0_exe/geochemistrypi_v0.7.0.exe) file. You can watch this video [[Bilibili]](https://www.bilibili.com/video/BV1YmFPe4ESQ/?spm_id_from=333.337.search-card.all.click) | [[YouTube]](https://www.youtube.com/watch?v=LW5Cngcal9Q) to learn about it.

After downloading, please check the downloaded version of our software:

```bash
geochemistrypi --version
```

> **Note**: For more detail on installation, please refer to our online documentation in **Installation Manual** under the section of **FOR USER**. Over there, we highly recommend to use virtual environment (Conda) to avoid dependency version problems.

---

## 🔄 Quick Update

One instruction to update the software to the latest version on **command line**, such as Terminal on macOS, Power Shell on Windows.

```bash
pip install --upgrade geochemistrypi
```

One instruction to download on **Jupyter Notebook** or **Google Colab**.

```python
!pip install --upgrade geochemistrypi
```

Check the updated version of our software:

```bash
geochemistrypi --version
```

---

## 📁 Data Preparation

In order to utilize the functions provided by our software, your own data set should satisfy:

- be with the suffix **.xlsx** or **.csv**, which is supported by Microsoft Excel.
- be comprise of location information **LATITUDE** and **LONGITUDE**, two columns respectively. It is optional.

If you want to run **classification** algorithm, you data set should satisfy:

- a label column. You can name it as you wish, such as **Label**.

**Column name specification:**

- No restriction on the column names. You can name them as you want except for two special and optional column **LATITUDE** and **LONGITUDE**.
- every column can only one column name. Multi level column names are not allowed.
- Between two columns with values, a completed void column can exists.

### 📦 Built-in Datasets

The following are seven built-in data sets in our software stored on Google Drive and Tencent Docs, have a look on them. For the algorithm you intend to run, you can refer to the data format of the corresponding dataset.

### 📦 Built-in Datasets

| Dataset | Google Drive | Tencent Docs |
|---------|--------------|--------------|
| Data_Regression.xlsx | [Link](https://docs.google.com/spreadsheets/d/13MB4t_2PiZ90tTMJKw7HcBUi2sb3tXej/edit?usp=sharing&ouid=110717816678586054594&rtpof=true&sd=true) | [Link](https://docs.qq.com/document/DQ3VmdWZCTGV3bmpM?&u=6868f96d4a384b309036e04e637e367a) |
| ApplicationData_Regression.xlsx | [Link](https://docs.google.com/spreadsheets/d/1FCek2OOYQD887jfQz21g0ovqVuUJIjVoNI77D-Ufr9Y/edit?usp=sharing) | [Link](https://docs.qq.com/document/DQ3BDeHhxRGNzSXZN) |
| Data_Classification.xlsx | [Link](https://docs.google.com/spreadsheets/d/1xFBCYVmtZfuEAbeBljUlzqBjxVuLAt8x/edit?usp=sharing&ouid=110717816678586054594&rtpof=true&sd=true) | [Link](https://docs.qq.com/document/DQ0JUaUFsZnRaZkNG?&u=6868f96d4a384b309036e04e637e367a) |
| ApplicationData_Classification.xlsx | [Link](https://docs.google.com/spreadsheets/d/1J7QvdvbbHJMlKtiumBgKDW7ALghfQQZyKGEoOqhKQjw/edit?usp=sharing) | [Link](https://docs.qq.com/document/DQ2dnQWtubHRBTGtB) |
| Data_Clustering.xlsx | [Link](https://docs.google.com/spreadsheets/d/1sbuJdOzGNQ2Pk-bVURfPYg1rltyBbn5J/edit?usp=sharing&ouid=110717816678586054594&rtpof=true&sd=true) | [Link](https://docs.qq.com/document/DQ3dKdGtlWkhZS2xR?&u=6868f96d4a384b309036e04e637e367a) |
| Data_Decomposition.xlsx | [Link](https://docs.google.com/spreadsheets/d/1kix82qj5--vhnm8-KhuUBH9dqYH6zcY8/edit?usp=sharing&ouid=110717816678586054594&rtpof=true&sd=true) | [Link](https://docs.qq.com/document/DQ29oZ0lhUGtZUmdN?&u=6868f96d4a384b309036e04e637e367a) |
| Data_AnomalyDetection.xlsx | [Link](https://docs.google.com/spreadsheets/d/1NqTQZCkv74Sn_iOJOKRc-QnJzpaWmnzC_lET_0ZreiQ/edit?usp=sharing) | [Link](https://docs.qq.com/document/DQ2hqQ2N2ZGlOUWlT) |
| Data_Time_Series.xlsx | - | [Link](https://docs.qq.com/sheet/DTGJURWdBeHd0TFhR?u=6868f96d4a384b309036e04e637e367a&tab=000001) |

> **Note**: For more detail on data preparation, please refer to our online documentation in **Model Example** under the section of **FOR USER**.

---

## 🏃 Running Examples

- [Data Preprocessing](https://geochemistrypi.readthedocs.io/en/latest/For%20User/Model%20Example/Data_Preprocessing/Data%20Preprocessing.html)
- [Classfication](https://geochemistrypi.readthedocs.io/en/latest/For%20User/Model%20Example/Classification/classification.html)
- [Regression](https://geochemistrypi.readthedocs.io/en/latest/For%20User/Model%20Example/Regression/Regression.html)
- [Clustering](https://geochemistrypi.readthedocs.io/en/latest/For%20User/Model%20Example/Clustering/Clustering.html)
- [Decomposition](https://geochemistrypi.readthedocs.io/en/latest/For%20User/Model%20Example/Decomposition/decomposition.html)
- [Anomaly Detection](https://geochemistrypi.readthedocs.io/en/latest/For%20User/Model%20Example/Anomaly_Detection/anomaly_detection.html)
- [Time Series](https://geochemistrypi.readthedocs.io/en/latest/For%20User/Model%20Example/Time_Series/time_series.html)
- [Network Analysis](https://geochemistrypi.readthedocs.io/en/latest/For%20User/Model%20Example/Network_Analysis/Network%20Analysis.html)

**How to run:** After successfully downloading, run the instructions as the following examples shown on **command line / Jupyter Notebook / Google Colab**.

Once the software starts, there are two folders `geopi_output` and `geopi_tracking` generated automatically for result storage.

- `geopi_tracking`: It is used by MLflow as the storage for visualized operations in the web interface, which users cannot modify directly.
- `geopi_output`: It is a regular folder aligning with MLflow's storage structure, which users can operate.

From v0.7.0 onwards, there is one new command with the option `--desktop` to read the training data and application from the folder `geopi_input` on desktop.

- `geopi_input`: It is used to put the datasets you want our software to process.

### Case 1: Run with built-in data set for model training and model inference

On command line:

```bash
geochemistrypi data-mining
```

On Jupyter Notebook / Google Colab:

```python
!geochemistrypi data-mining
```

**Note**:

+ There are five built-in data sets corresponding to five kinds of model pattern.
+ The generated output directory `geopi_output` and `geopi_tracking` will be on desktop by default.

### Case 2: Run with your own data set on desktop for model training and model inference

On command line:

```bash
geochemistrypi data-mining --desktop
```

On Jupyter Notebook / Google Colab:

```python
!geochemistrypi data-mining --desktop
```

**Note**:

+ You need to create a directory `geopi_input` on desktop and put the datesets in it. If there is no `geopi_input` on desktop, our software will create one for you with all built-in datasets provided.
+ The generated output directory `geopi_output` and `geopi_tracking` will be on desktop by default.

### Case 3: Run with your own data set without model inference

On command line:

```bash
geochemistrypi data-mining --data your_own_data_set.xlsx
```

On Jupyter Notebook / Google Colab:

```python
!geochemistrypi data-mining --data your_own_data_set.xlsx
```

**Note**:

+ Currently, `.xlsx` and `.csv` files are supported. Please specify the path your data file exists. For Google Colab, don't forget to upload your dataset first.
+ The generated output directory `geopi_output` and `geopi_tracking` will be on the directory where you run this command.

### Case 4: Implement model inference on application data

On command line:

```bash
geochemistrypi data-mining --training your_own_training_data.xlsx --application your_own_application_data.xlsx
```

On Jupyter Notebook / Google Colab:

```python
!geochemistrypi data-mining --training your_own_training_data.xlsx --application your_own_application_data.xlsx
```

**Note**:

+ Please make sure the column names (data schema) in both training data file and application data file are the same. Because the operations you perform via our software on the training data will be record automatically and subsequently applied to the application data in the same order.
+ The training data in our pipeline will be divided into the train set and test set used for training the ML model and evaluating the model's performance. The score includes two types. The first type is the scores from the prediction on the test set while the second type is cv scores from the cross validation on the train set.
+ The generated output directory `geopi_output` and `geopi_tracking` will be on the directory where you run this command.

### Case 5: Activate MLflow web interface

On command line:

```bash
geochemistrypi data-mining --mlflow
```

On Jupyter Notebook / Google Colab:

```python
!geochemistrypi data-mining --mlflow
```

**Note**:

+ Once the command is executed, our software will search `geopi_tracking` directory from the current working directory. If it doesn't exist, then our software will search it on desktop.
+ Copy the URL shown on the console into any browser to open the MLflow web interface. The URL is normally like this http://127.0.0.1:5000. Search MLflow online to see more operations and usages.

---

## 🗺️ Roadmap

### First Phase

It works as a **software application** with a command-line interface (CLI) to automate **data mining** process with frequently-used **machine learning algorithms** and **statistical analysis methods**, which would further lower the threshold for the geochemists.

The highlight is that through choosing **simple number options**, the users are able to implement a full cycle of data mining **without knowledge of** SciPy, NumPy, Pandas, Scikit-learn, FLAML, Ray packages.

The following figure is the activity diagram of automated ML pipeline in Geochemistry π:

Its data section provides feature engineering based on **arithmatic operation**. It allows the users to have a statistic analysis on the data set as well as on the imputation result, which is supported by the combination of **Monte Carlo simulation** and **hypothesis testing**.

Its models section provides both **supervised learning** and **unsupervised learning** methods from **Scikit-learn** framework, including four types of algorithms, regression, classification, clustering, and dimensional reduction. Integrated with **FLAML** and **Ray** framework, it allows the users to run AutoML easily, fastly and cost-effectively on the built-in supervised learning algorithms in our framework.

The following figure is the hierarchical architecture of Geochemistry π:

### Second Phase

Currently, we are building three access ways to provide more user-friendly service, including **web portal**, **CLI package** and **API**. It allows the user to perform **continuous training** and **model inference** by automating the ML pipeline and **machine learning lifecycle management** by unique storage mechanism in different access layers.

The following figure is the system architecture diagram:

The following figure is the customized automated ML pipeline:

The following figure is the design pattern hierarchical architecture:

The following figure is the storage mechanism:

The whole package is under construction and the documentation is progressively evolving.

---

## 🧠 Geochemistry π Mind Map

[→ Click here for more details](https://docs.qq.com/mind/DZnhoa2NPamFYZHR6?u=40ac0718eb494b008b2f072197ea95db&subId=BB08J2&mode=mind)

---

## 👥 Team Info

### Leaders

| Name | Role | Contact |
|------|------|---------|
| [Prof. ZhangZhou (Zhejiang University, China)](https://person.zju.edu.cn/en/zhangzhou) | Project Manager | zhangzhou333@zju.edu.cn |
| Can He (Sany, National University of Singapore, Singapore) | Project Lead | sanyhew1097618435@163.com |
| Jianming Zhao (Jamie, Zhejiang University, China) | Technical Group Head | jmzhao29@gmail.com |
| Yongkang Chan (Kill-virus, Lanzhou University, China) | Product Group Head | kk1361207571@163.com |
| Yang Lyu (Daisy, Zhejiang University, China) | Cloud Product Lead | lyuyang1007@zju.edu.cn |
| Jianhao Sun (Jin, Nanjing University, China) | Project Development Lead | sjh20171502@gmail.com |
| Chufan Zhou (Yoko, Institute of Geochemistry, Chinese Academy of Sciences; University of Chinese Academy of Sciences, China) | Chemical Modeling Lead | 1176733817@qq.com |
| Yunzhou Han (China University of Geosciences Beijing, China) | Multiple output functions Lead | 249308332@qq.com |

### Technical Group

- [Prof. ZhangZhou (Zhejiang University, China)](https://person.zju.edu.cn/en/zhangzhou)
- Jianhao Sun (Jin, Nanjing University, China)
- Mengying Ye (Mary, Jilin University, China)
- Chengtu Li (Trenki, Henan Polytechnic University, Beijing, China)
- Panyan Weng (The University of Sydney, Australia)
- Haibin Lai (Michael, Southern University of Science and Technology, China)
- Siqi Yao (Clara, Dongguan University of Technology, China)
- Yunzhou Han (China University of Geosciences Beijing, China)
- Feiyu Shi (China University of Geosciences Beijing, China)
- Wenxuan Xia (China University of Geosciences Beijing, China)
- Hanbing Gao (China University of Geosciences, Wuhan, China)
- Yuanhang Wang (Hangzhou Dianzi University, China)
- Zhenghao Qu (Yunnan University, China)

### Product Group

- [Prof. ZhangZhou (Zhejiang University, China)](https://person.zju.edu.cn/en/zhangzhou)
- Zhelan Lin (Lan, Fuzhou University, China)
- ShuYi Li (Communication University Of China, Beijing, China)
- Junbo Wang (China University of Geosciences, Beijing, China)
- Haibin Wang (Watson, University of Sydney, Australia)
- Guoqiang Qiu (Elsen, Fuzhou University, China)
- Yating Dong (Yetta, Dongguan University of Technology, China)
- Bailun Jiang (EPSI / Lille University, France)
- Chufan Zhou (Yoko, Institute of Geochemistry, Chinese Academy of Sciences; University of Chinese Academy of Sciences, China)
- Lianfeng Zhou (Yangtze University,China)
- Lingping Zhan (Chang'an University, China)
- Zixuan Zhu (Institute of Geochemistry, Chinese Academy of Sciences; University of Chinese Academy of Sciences, China)
---

## 🤝 Join Us :)

**The recruitment of research interns is ongoing !!!**

**Key Point: All things are done online, remote work (\*^▽^\*)**

### 🎓 What can you learn?

+ Learning the full cycle of data mining (Scikit-learn, Ray, Mlflow) on tabular data, including the algorithms in regression, classification, clustering, and decomposition.
+ Learning to be a qualified Python developer, including any Python programing contents towards data mining, basic software engineering techniques like frontend (React, Typescript, Ant Design scaffold) and backend (SQL & NoSQL database, RESTful API, FastAPI) development, and cooperation tools like Git.

### 🎁 What can you get?

+ Research internship proof and reference letter after working for > 100 hours.
+ Chance to pay a visit to Hangzhou, China, sponsored by ZJU Earth Data.
+ Chance to be guided by the experts from IT companies in Silicon Valley and Hangzhou.
+ Bonus depending on your performance.

### 💼 Current Working Pattern:

+ Online working and cooperation
+ Three weeks per working cycle -> One online meeting per working cycle
+ One cycle report (see below) per cycle - 5 mins to finish

Even if you are not familiar with topics above, but if you are interested in and have plenty of time to do it. That's enough. We have a full-developed training system to help you, as a newbie of data mining or Python developer, learn steps by steps with seniors until you can make a significant contribution to our project.

**🔗 More details about the project and Prof.Zhangzhou?** Please refer to:
- [**English Page**](https://person.zju.edu.cn/en/zhangzhou)
- [**Chinese Page**](https://person.zju.edu.cn/zhangzhou#0)
- [**ResearchGate**](https://www.researchgate.net/profile/J-Zhangzhou-2?ev=hdr_xprf)
- [**Bilibili**](https://space.bilibili.com/616904352?spm_id_from=333.788.b_765f7570696e666f.2)
- [**Youtube**](https://www.youtube.com/@zju_earth_data2668)
- [![ORCID](https://img.shields.io/badge/ORCID-0000--0003--0107--0548-brightgreen?logo=orcid)](https://orcid.org/0000-0003-0107-0548)

**Do you want to contribute to this open-source program?** Contact with your CV: zhangzhou333@zju.edu.cn, sanyhew1097618435@163.com

---

## 📚 In-house Materials

Materials are in both Chinese and English. Others unshown below are internal materials.

1. [Guideline Manual – Geochemistry π (International - Google drive)](https://docs.google.com/document/d/1LjwB5Lazk33E5vbtnFPJio_MyjYQxjEu/edit?usp=sharing&ouid=110717816678586054594&rtpof=true&sd=true)
2. [Guideline Manual – Geochemistry π (China - Tencent Docs)](https://docs.qq.com/doc/DQ21IZUdVQktqRWpm?&u=6868f96d4a384b309036e04e637e367a)
3. [Learning Steps for Newbies – Geochemistry π (International - Google drive)](https://docs.google.com/document/d/1GQO-SXwEx_8midr362pqfxNZtfUf-nA6/edit?usp=sharing&ouid=110717816678586054594&rtpof=true&sd=true)
4. [Learning Steps for Newbies - Geochemistry π (China - Tencent Docs)](https://docs.qq.com/doc/DTlVEakt2WnJrdkN1?&u=6868f96d4a384b309036e04e637e367a)
5. [Code Specification v2.1.2 - Geochemistry π (International - Google drive)](https://drive.google.com/file/d/12UPrGqrj9hl0_vK8r-m6xykh_6052OtI/view?usp=sharing)
6. [Code Specification v2.1.2 - Geochemistry π (China - Tencent Docs)](https://docs.qq.com/pdf/DQ2pmc1l1Z2t3QVFa?&u=6868f96d4a384b309036e04e637e367a)
7. [Cycle Report - Geochemistry π (International - Google drive)](https://drive.google.com/file/d/1JPZoSLcPRqzu6LDvw8wLQkV2GfJoER51/view?usp=sharing)
8. [Cycle Report - Geochemistry π (China - Tencent Docs)](https://docs.qq.com/pdf/DQ25VSGNlbGx4UkFZ?&u=6868f96d4a384b309036e04e637e367a)

---

## 🎬 In-house Videos

Technical record videos are on Bilibili and Youtube synchronously while other meeting videos are internal materials. More Videos will be recorded soon.

1. [ZJU_Earth_Data Introduction (Geochemical Data, Python, Geochemistry π) - Prof. Zhang](https://www.bilibili.com/video/BV1Lf4y1w7EK?spm_id_from=333.999.0.0)
2. [How to Collaborate and Provide Bug Report on Geochemistry π Through GitHub - Can He (Sany)](https://www.youtube.com/watch?v=1DWoEsqsfvQ&list=PLy8hNsI55lvh1UHjhVhqNUj3xPdV9sEiM&index=3)
3. [Geochemistry π - Download and Run the Beta Version](https://www.youtube.com/watch?v=EeVaJ3H7_AU&list=PLy8hNsI55lvh1UHjhVhqNUj3xPdV9sEiM&index=9)
4. [How to Create and Use Virtual Environment on Geochemistry π - Can He (Sany)](https://www.youtube.com/watch?v=4KFi7OXxD-c&list=PLy8hNsI55lvh1UHjhVhqNUj3xPdV9sEiM&index=4)
5. [How to use Github-Desktop in conflict resolution - Qiuhao Zhao (Brad)](https://www.youtube.com/watch?v=KT1g5JpuUVI&list=PLy8hNsI55lvh1UHjhVhqNUj3xPdV9sEiM)
6. [Virtual Environment &amp; Packages On Windows - Jianming Zhao (Jamie)](https://www.youtube.com/watch?v=e4VqSBuNp_o&list=PLy8hNsI55lvh1UHjhVhqNUj3xPdV9sEiM&index=2)
7. [Git Workflow &amp; Coordinating Synchronization - Jianming Zhao (Jamie)](https://www.bilibili.com/video/BV1Sa4y1f74k?spm_id_from=333.999.0.0&vd_source=9adcf2c5fdeffe1d11c89d441ef598ba)
8. [Geochemistry π framework analysis - Jianhao Sun (Jin)](https://www.bilibili.com/video/BV1GTUMBhEo6/?spm_id_from=333.1387.collection.video_card.click&vd_source=cb3969d68c6d244384e336ba1783ea14)

---

## 🙏 Contributors

- Mengqi Gao (China University of Geosciences, Beijing, China)
- Shengxin Wang (Samson, Lanzhou University, China)
- Wenyu Zhao (Molly, Zhejiang University, China)
- Qiuhao Zhao (Brad, Zhejiang University, China)
- Kaixin Zheng (Hayne, Sun Yat-sen University, China)
- Ruitao Chang (China University of Geosciences Beijing, China)
- Yucheng Yan (Andy, University of Sydney, Australia)
- Anzhou Li (Andrian, Zhejiang University, China)
- Keran Li (Kirk, Chengdu University of Technology, China)
- Dan Hu (Notre Dame University, United States)
- Xunxin Liu (Tante, China University of Geosciences, Wuhan, China)
- Fang Li (liv, Shenzhen University, China)
- Xin Li (The University of Manchester, United Kingdom)
- Ting Liu (Kira, Sun Yat-sen University, China)
- Xirui Zhu (Rae, University of York, United Kingdom)
- Aixiwake·Janganuer (Ayshuak, Sun Yat-sen University, China)
- Zhenglin Xu (Garry, Jilin University, China)
- Jianing Wang (National University of Singapore, Singapore)
- Junchi Liao (Roceda, University of Electronic Science and Technology of China, China)

---

## 📊 Project Statistics

---

## ⭐ Support the Project

If Geochemistry π has been helpful to your research or work, please consider giving us a ⭐️ on [GitHub](https://github.com/ZJUEarthData/Geochemistrypi) — it helps others discover the project and motivates us to keep improving!

We welcome all forms of contributions, including bug reports, feature suggestions, documentation improvements, and code contributions.

---

Built with ❤️ by the Geochemistry π team

Geochemistrypi

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Geochemistrypi

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README