searchgoose

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

(★ 25)

🦢 Elasticsearch-like simple, lightweight, distributed RESTful search-engine using bleve written in go 🔍

searchgoose Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<div align="center">
  <br/>
  <img src="./docs/images/logo-words.png" width="250"/>
  <br/>
  <br/>
  <p>
    🦢 Simple, distributed, lightweight<br>
    RESTful search engine implementation written in go 🔍
  </p>
  <p>
    <a href="https://gitter.im/searchgoose/community">
      <img src="https://badges.gitter.im/Join%20Chat.svg"/>
    </a>
    <a href="https://goreportcard.com/report/github.com/actumn/searchgoose">
      <img src="https://goreportcard.com/badge/github.com/gocelery/gocelery"/>
    </a>
    <a href="https://github.com/actumn/searchgoose/blob/master/LICENSE">
      <img src="https://img.shields.io/badge/license-MIT-blue.svg"/>
    </a>
  </p>
</div>

---
## Introduction
Searchgoose is simple distributed **RESTful search engine** supporting  searching and indexing data. For Study purposes, mostly understanding the implementation details of how [elasticearch](https://github.com/elastic/elasticsearch) is built, focusing on clustering distributed system and supporting full-text search using [bleve](https://github.com/blevesearch/bleve). Searchgoose aims to provide fast and flexible data handling by solving the problems of the existing relational database, which is bothering tasks to search and divide string data. To solve this problem, this project uses a data structure called an **inverted index** that supports fast full-text searches. It also implements raft-like algorithm and quorum-based voting system for discovery and election service in clustering mode.

## Architecture
![alt text](https://raw.githubusercontent.com/actumn/searchgoose/master/docs/images/architecture01.png)

![alt text](https://raw.githubusercontent.com/actumn/searchgoose/master/docs/images/architecture02.png)

## REST API
### Cluster API
- [/_nodes](https://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-nodes-info.html)
- [/_nodes/stats](https://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-nodes-stats.html)
- [/_cluster/health](https://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-health.html)
- [/_cluster/state](https://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-state.html)
- [/_cluster/stats](https://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-stats.html)

### Index / Document API
- [/{index}](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-get-index.html)
- [/{index}/_doc](https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-get.html)
- [/{index}/_search](https://www.elastic.co/guide/en/elasticsearch/reference/current/search-search.html)
- [/{index}/_refresh](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-refresh.html)

## Build 
### DockerFile
```shell script
$ docker build . --rm --tag searchgoose:latest
```

### Makefile
```shell script
$ make build
```

## Run
### Single mode
```shell script
$ go run main.go -transport.port=8180 -http.port=8080
```
### Clustering mode
```shell script
$ go run main.go -node.name=sg-node-01 -transport.port=8180 -http.port=8080
$ go run main.go -node.name=sg-node-02 -seed_hosts=127.0.0.1:8180 -transport.port=8179 -http.port=8081
$ go run main.go -node.name=sg-node-03 -seed_hosts=127.0.0.1:8180 -transport.port=8181 -http.port=8082
```

## API
To try any of the below queries you can use the above example quries

### Create Index

```
PUT /test15
content-type: application/json

{
  "settings": {
    "number_of_shards": 3
  },
  "mappings": {
    "properties": {
      "field1": {
        "type": "text"
      }
    }
  }
}
```

### Document Index
```
PUT /test15/_doc/4
content-type: application/json

{
  "field1": "test",
  "field2": "test2"
}
```

### Search
```
POST /test15/_search
content-type: application/json

{
  "size": 100,
  "query": {
    "match": {
      "field1": "field test"
    } 
  }
}
```

## Example
![alt text](https://raw.githubusercontent.com/actumn/searchgoose/master/docs/images/example.png)
The above image describes Searchgoose test application using [Guttenberg-Search](https://github.com/triestpa/Guttenberg-Search).

## Visualization
![alt text](https://raw.githubusercontent.com/actumn/searchgoose/master/docs/images/elastic-hq.png)
The above image describes simplified interface for managing and monitoring Searchgoose clusters by [elasticsearch-HQ](https://github.com/ElasticHQ/elasticsearch-HQ).

searchgoose

searchgoose Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

searchgoose

searchgoose Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README