Spark2CassandraBulkLoad

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

Spark2CassandraBulkLoad

★ 11 Open GitHub ↗

Spark Library for Bulk Loading into Cassandra

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Spark2CassandraBulkLoad

[![Hits](https://hits.seeyoufarm.com/api/count/incr/badge.svg?url=https%3A%2F%2Fgithub.com%2Fjoswlv%2FSpark2CassandraBulkLoad)](https://hits.seeyoufarm.com)
[![Build Status](https://travis-ci.org/joswlv/Spark2CassandraBulkLoad.svg?branch=master)](https://travis-ci.org/joswlv/Spark2CassandraBulkLoad.svg?branch=master) 
[ ![Download](https://api.bintray.com/packages/joswlv/spark-utils/Spark2CassandraBulkLoad/images/download.svg?version=1.0.3) ](https://bintray.com/joswlv/spark-utils/Spark2CassandraBulkLoad/1.0.3/link)

Spark Library for Bulk Loading into Cassandra

This project refers to [Spark2Cassandra](https://github.com/jparkie/Spark2Cassandra)

Upgrade utility(spark, cassandra) version.

## Features

1. Convert rdd or dataframe to SSTableFile.
2. Stream the SSTableFile to Cassandra nodes.

## Requirements

Spark2CassandraBulkLoad supports Spark 2.x and above.

| Spark2CassandraBulkLoad Version | Spark Cassandra connector Version | Cassandra Java Driver Version | JDK Version |
| ------------------------| ----------------- | ----- | ----------- |
| `1.X.X`                 | `[2.0, 2.5)`          | `[,4.0)` | `1.8+`        |

## Downloads

#### SBT

```scala
libraryDependencies += "com.joswlv.spark.cassandra.bulk" %% "Spark2CassandraBulkLoad" % "1.0.3"
```

#### Maven (JCenter)
```xml
<dependency>
	<groupId>com.joswlv.spark.cassandra.bulk</groupId>
	<artifactId>Spark2CassandraBulkLoad</artifactId>
	<version>1.0.3</version>
</dependency>
```

### gradle

```groovy
compile 'com.joswlv.spark.cassandra.bulk:Spark2CassandraBulkLoad:1.0.3'
```

## Usage

### Bulk Loading into Cassandra

```scala
// Import the following to have access to the `bulkLoadToCass()` function for RDDs or DataFrames.
import com.joswlv.spark.cassandra.bulk.rdd._
import com.joswlv.spark.cassandra.bulk.sql._

// Specify the `keyspaceName` and the `tableName` to write.
rdd.bulkLoadToCass(
  keyspaceName = "keyspaceName",
  tableName = "tableName"
)

// Specify the `keyspaceName` and the `tableName` to write.
df.bulkLoadToCass(
  keyspaceName = "keyspaceName",
  tableName = "tableName"
)
```

Spark2CassandraBulkLoad

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README