serverless_csv_processing

KO | EN

gitlite — search

#javascript #python #hacktoberfest #ai #llm #deep-learning #linux #nodejs #java #windows #cli #vue #mcp #open-source

serverless_csv_processing

(★ 9)

No description available.

serverless_csv_processing 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Building An Async CSV Parser

Recently, I wrote how to parse a big CSV file in Rust [here](https://dfrasca.hashnode.dev/rust-csv-processing), and I have also made a comparison against other languages, especially with javascript [here](https://dfrasca.hashnode.dev/rust-for-javascript-developers-csv-comparison) and running locally on my machine Rust resulted ten times faster.

This project is concentrated on the backend side of the application.

The full article is [here](https://dfrasca.hashnode.dev/rust-building-an-async-csv-parser)

## How it works ##

![picture](https://github.com/ymwjbxxq/serverless_csv_processing/blob/main/readme/csv.png)

- The [IMDb Datasets](https://www.imdb.com/interfaces/) file title.basics.tsv.gz is uploaded
- Amazon S3 emit the event to Amazon EventBridge
- Amazon EventBridge event will trigger AWS Lambda
- AWS Lambda downalod the file in memory and processe it.

## HOW TO DEPLOY ##

The project will deploy the following AWS services:

- Amazon S3
- Amazon EventBridge
- AWS Lambda

Assuming that your computer is setup, you need to build

```
make build
```

We can deploy all the applications. I use

> --profile test

Inside my MakeFile, and you may remove it.

```
make deploy
```

### Cleanup ###
```
make delete
```

serverless_csv_processing

serverless_csv_processing 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

serverless_csv_processing

serverless_csv_processing 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README