sftp-go

KO | EN

gitlite — search

#javascript #python #react #ai #typescript #llm #golang #go #android #macos #nodejs #kubernetes #security #openai

(★ 23)

No description available.

sftp-go 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# SFTP Pipeline

A high-performance Go library for parallel SFTP file transfers with concurrent reading and processing capabilities.

## Features

- **Parallel SFTP Reads**: Configurable number of concurrent SFTP connections for reading files
- **Concurrent Processing**: Process downloaded files with multiple worker goroutines
- **Buffered Pipeline**: Configurable buffer size between read and processing stages
- **Error Handling**: Tracks failed transfers separately from successful ones
- **Performance Metrics**: Reports transfer time and success/failure statistics

## Installation

```bash
go get github.com/MYK12397/sftp-pipeline
```

## Usage

### Basic Examples

```go
 // Write to local disk
 TransferFiles(sftpClient, jobs, func(r FileResult) error{
     return os.WriteFile("/data/"+r.ID, r.Data, 0644)
 })

//upload to cloud storage
TransferFiles(sftpClient, jobs, func(r FileResult) error{
     return cloudClient.Upload(r.ID, r.Data)
 })

TransferFiles(sftpClient, jobs, func(r FileResult) error{
     text := extractText(r.Data)
     return cloudClient.Upload(r.ID, r.Data)
 })
```
## Configuration

The `PipelineCfg` struct controls the pipeline behavior:

- **SFTPRreaders**: Number of goroutines reading from SFTP (default: 80)
- **Workers**: Number of goroutines processing files (default: 10)
- **BufferSize**: Channel buffer size (default: 10)

sftp-go

sftp-go 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

sftp-go

sftp-go 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README