• Stars
    star
    211
  • Rank 186,867 (Top 4 %)
  • Language
    Scala
  • License
    Apache License 2.0
  • Created about 9 years ago
  • Updated 3 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Snowflake Data Source for Apache Spark.

spark-snowflake

Snowflake Data Source for Apache Spark.

Build Status codecov License

The main version of spark-snowflake works with Spark 2.4. For use with Spark 2.3 and 2.2, please use tag vx.x.x-spark_2.3 and vx.x.x-spark_2.2.

To use it, provide the dependency for Spark in the form of net.snowflake:spark-snowflake_$SCALA_VERSION:$RELEASE, e.g. net.snowflake:spark-snowflake_2.11:2.2.2. See Maven Central for more info.

For a version working with Spark 1.5 and 1.6, please use branch-1.x. Artifacts of that version are also available in the Snowflake UI.

For a user manual and more information, see the official documentation.

For developer notes, see README-DEV

Acknowledgments

This project was originally forked from the spark-redshift project. We also occasionally port relevant patches from it. We would like to acknowledge and thank the developers of that project, in particular Josh Rosen.

More Repositories

1

snowflake-connector-python

Snowflake Connector for Python
Python
574
star
2

gosnowflake

Go Snowflake Driver
Go
291
star
3

snowpark-python

Snowflake Snowpark Python API
Python
253
star
4

snowflake-sqlalchemy

Snowflake SQLAlchemy
Python
231
star
5

SnowAlert

Security Analytics Using The Snowflake Data Warehouse
Python
181
star
6

snowflake-connector-net

Snowflake Connector for .NET
C#
175
star
7

snowflake-jdbc

Snowflake JDBC Driver
Java
172
star
8

snowflake-cli

Snowflake CLI is an open-source command-line tool explicitly designed for developer-centric workloads in addition to SQL operations.
Python
168
star
9

snowflake-kafka-connector

Snowflake Kafka Connector (Sink Connector)
Java
135
star
10

snowflake-connector-nodejs

NodeJS driver
JavaScript
119
star
11

polaris-catalog

Polaris Catalog is an open source catalog for Apache Iceberg
90
star
12

snowflake-ingest-java

Java SDK for the Snowflake Ingest Service -
Java
66
star
13

dplyr-snowflakedb

SnowflakeDB backend for dplyr
R
65
star
14

snowflake-ingest-python

A Python API for Asynchronously Loading Data into Snowflake DB -
Python
59
star
15

pdo_snowflake

PHP PDO driver for snowflake
C
58
star
16

snowflake-ml-python

Python
38
star
17

libsnowflakeclient

Snowflake Connector for C/C++
C
25
star
18

connectors-native-sdk

Snowflake Native SDK for Connectors
Java
25
star
19

native-apps-examples

Public-facing example applications built using the Snowflake Native App Framework
Python
22
star
20

snowpark-java-scala

Snowflake Snowpark Java & Scala API
Scala
18
star
21

snowflake-hive-metastore-connector

Java
13
star
22

snowflake-s3compat-api-test-suite

S3Compat API Test Suite
Java
12
star
23

snowflake-telemetry-python

Python
7
star
24

snowflake-rest-api-specs

Public rest api specs for Snowflake
4
star
25

snowflake-common

3
star
26

native-apps-templates

Official Snowflake CLI templates released for the Snowflake Native App Framework
Python
3
star
27

homebrew-snowflake-cli

Ruby
1
star
28

reusable-workflows

A reusable workflow that will be used by repositories to run semgrep on each PR
1
star
29

snowflake-hibernate

Snowflake SQL dialect definition for Hibernate ORM
Java
1
star