aws-s3-fast-upload

KO | EN

gitlite — search

#python #java #python3 #arduino #golang #machine-learning #rust #html #flask #javascript #seismology #nodejs

aws-s3-fast-upload

★ 19 Open GitHub ↗

Upload Large Files to AWS-S3 with Lightning Fast Speed - Parallel Chunk Upload

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Uploading Large Files to AWS-S3 with Lightning Fast Speed - Parallel Chunk Upload

This project demonstrates two techniques for uploading large files to AWS-S3: one where chunks are created on the frontend and uploaded using the AWS multipart API, and another where chunks are created on the backend and uploaded using the AWS SDK 3 upload parallel technique.

## Technique 1:

Creating Chunks on Frontend, then sending them to Backend and uploading to S3 bucket using AWS multipart upload API.

### Backend Code

Backend Folder: backend

To run this code: Install the required npm modules, by running the below command.
```
npm install
```

Create a .env file by copying the sample.env file and updating the necessary values.

Finally run the code using below command
```
npm start
```
  
### Frontend Code

Folder Folder: frontend

To run this code:

Install http-server globally using npm by running `npm install -g http-server`

Navigate to the frontend folder.

Start the server by running `http-server`

Open the provided URL in your web browser.

## Technique 2:

Uploading complete file from frontend then Creating Chunks on Backend and doing parallel upload using AWS SDK 3

### Backend Code

Backend Folder: backend2

To run this code: Install the required npm modules, by running the below command.
```
npm install
```

Create a .env file by copying the sample.env file and updating the necessary values.

Finally run the code using below command
```
npm start
```
  
### Frontend Code

Folder Folder: frontend2

To run this code:

Install http-server globally using npm by running `npm install -g http-server`

Navigate to the frontend folder.

Start the server by running `http-server`

Open the provided URL in your web browser.

## Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

aws-s3-fast-upload

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README