• Stars
    star
    133
  • Rank 262,722 (Top 6 %)
  • Language
    Scala
  • License
    Apache License 2.0
  • Created over 3 years ago
  • Updated 14 days ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Compositional, type-safe schema definitions, which enable auto-derivation of codecs and migrations.

ZIO Schema

ZIO Schema is a ZIO-based library for modeling the schema of data structures as first-class values.

Development CI Badge Sonatype Releases Sonatype Snapshots javadoc ZIO Schema

Introduction

Schema is a structure of a data type. ZIO Schema reifies the concept of structure for data types. It makes a high-level description of any data type and makes them as first-class values.

Creating a schema for a data type helps us to write codecs for that data type. So this library can be a host of functionalities useful for writing codecs and protocols like JSON, Protobuf, CSV, and so forth.

With schema descriptions that can be automatically derived for case classes and sealed traits, ZIO Schema will be going to provide powerful features for free (Note that the project is in the development stage and all these features are not supported yet):

  • Codecs for any supported protocol (JSON, protobuf, etc.), so data structures can be serialized and deserialized in a principled way
  • Diffing, patching, merging, and other generic-data-based operations
  • Migration of data structures from one schema to another compatible schema
  • Derivation of arbitrary type classes (Eq, Show, Ord, etc.) from the structure of the data

When our data structures need to be serialized, deserialized, persisted, or transported across the wire, then ZIO Schema lets us focus on data modeling and automatically tackle all the low-level, messy details for us.

ZIO Schema is used by a growing number of ZIO libraries, including ZIO Flow, ZIO Redis, ZIO Web, ZIO SQL and ZIO DynamoDB.

Installation

In order to use this library, we need to add the following lines in our build.sbt file:

libraryDependencies += "dev.zio" %% "zio-schema"          % "0.4.11"
libraryDependencies += "dev.zio" %% "zio-schema-bson"     % "0.4.11"
libraryDependencies += "dev.zio" %% "zio-schema-json"     % "0.4.11"
libraryDependencies += "dev.zio" %% "zio-schema-protobuf" % "0.4.11"

// Required for automatic generic derivation of schemas
libraryDependencies += "dev.zio" %% "zio-schema-derivation" % "0.4.11",
libraryDependencies += "org.scala-lang" % "scala-reflect"  % scalaVersion.value % "provided"

Example

In this simple example first, we create a schema for Person and then run the diff operation on two instances of the Person data type, and finally we encode a Person instance using Protobuf protocol:

import zio.console.putStrLn
import zio.schema.codec.ProtobufCodec._
import zio.schema.{DeriveSchema, Schema}
import zio.stream.ZStream
import zio.{Chunk, ExitCode, URIO}

final case class Person(name: String, age: Int, id: String)
object Person {
  implicit val schema: Schema[Person] = DeriveSchema.gen[Person]
}

Person.schema

import zio.schema.syntax._

Person("Alex", 31, "0123").diff(Person("Alex", 31, "124"))

def toHex(chunk: Chunk[Byte]): String =
  chunk.toArray.map("%02X".format(_)).mkString

zio.Runtime.default.unsafe.run(
  ZStream
    .succeed(Person("Thomas", 23, "2354"))
    .transduce(
      encoder(Person.schema)
    )
    .runCollect
    .flatMap(x => putStrLn(s"Encoded data with protobuf codec: ${toHex(x)}"))
).getOrThrowFiberFailure()

Resources

Documentation

Learn more on the ZIO Schema homepage!

Contributing

For the general guidelines, see ZIO contributor's guide.

TL;DR

Before you submit a PR, make sure your tests are passing, and that the code is properly formatted

sbt prepare

sbt test

Code of Conduct

See the Code of Conduct

Support

Come chat with us on Badge-Discord.

License

License

More Repositories

1

zio

ZIO — A type-safe, composable library for async and concurrent programming in Scala
Scala
3,984
star
2

zio-quill

Compile-time Language Integrated Queries for Scala
Scala
2,136
star
3

zio-http

A next-generation Scala framework for building scalable, correct, and efficient HTTP clients and servers
Scala
732
star
4

zio-prelude

A lightweight, distinctly Scala take on functional abstractions, with tight ZIO integration
Scala
437
star
5

zio-json

Fast, secure JSON library with tight ZIO integration.
Scala
401
star
6

zio-kafka

A Kafka client for ZIO and ZIO Streams
Scala
332
star
7

zio-actors

A high-performance, purely-functional library for building, composing, and supervising typed actors based on ZIO
Scala
266
star
8

zio-microservice

ZIO-powered microservices via HTTP and other protocols.
Scala
238
star
9

zio-sql

Type-safe, composable SQL for ZIO applications
Scala
233
star
10

zio-config

Easily use and document any config from anywhere in ZIO apps
Scala
223
star
11

zio-intellij

A companion IntelliJ IDEA plugin for the ZIO library ecosystem.
Scala
210
star
12

zio-keeper

A ZIO library for building distributed systems
Scala
198
star
13

zio-protoquill

Quill for Scala 3
Scala
195
star
14

zio-nio

A small, unopinionated ZIO interface to NIO.
Scala
188
star
15

zio-logging

Powerful logging for ZIO 2.0 applications, with compatibility with many logging backends out-of-the-box.
Scala
171
star
16

zio-akka-cluster

ZIO wrapper for Akka Cluster
Scala
164
star
17

interop-cats

ZIO instances for cats-effect type classes
Scala
158
star
18

zio-direct

Direct-Style Programming for ZIO
Scala
150
star
19

zio-query

Add efficient pipelining, batching, and caching to any data source
Scala
145
star
20

zio-aws

Low level ZIO interface for the full AWS
Scala
137
star
21

zio-flow

Resilient, distributed applications powered by ZIO
Scala
136
star
22

izumi-reflect

TypeTag without scala-reflect. Supports Scala 2 and Scala 3.
Scala
134
star
23

zio-cli

Rapidly build powerful command-line applications powered by ZIO
Scala
126
star
24

zio-redis

A ZIO-based redis client
Scala
118
star
25

zio-telemetry

ZIO-powered OpenTelemetry library
Scala
109
star
26

zio-petclinic

An idiomatic pet clinic application written with ZIO.
Scala
102
star
27

zio-zmx

Monitoring, Metrics and Diagnostics for ZIO
Scala
85
star
28

zio-cache

A ZIO native cache with a simple and compositional interface
Scala
84
star
29

zio-sqs

ZIO-powered client for AWS SQS
Scala
83
star
30

zio-shield

Enforce best coding practices with ZIO
Scala
82
star
31

zio-jdbc

A small, idiomatic ZIO interface to JDBC.
Scala
80
star
32

zio-openai

Scala
65
star
33

zio-process

A simple ZIO library for interacting with external processes and command-line programs
Scala
64
star
34

zio-analytics

Distributed stream processing using ZIO
Scala
61
star
35

zio-metrics-legacy

⛔️ DEPRECATED
Scala
57
star
36

zio-quickstarts

A minimal quickstart ZIO application for writing a RESTful Web Service
Scala
56
star
37

zio-optics

Easily modify parts of larger data structures
Scala
56
star
38

interop-reactive-streams

Interoperability Layer Between ZIO and Reactive Streams
Scala
47
star
39

zio-s3

An S3 client for ZIO
Scala
41
star
40

zio-lambda

AWS Lambda Runtime built with ZIO
Scala
39
star
41

zio-dynamodb

Simple, type-safe, and efficient access to DynamoDB
Scala
38
star
42

zio-amqp

ZIO-based AMQP client for Scala
Scala
33
star
43

zio-connect

Sources, Sinks and Pipelines for channeling data
Scala
33
star
44

zio-macros

Macros to scrap ZIO boilerplate
Scala
32
star
45

zio-rocksdb

A ZIO-based interface to RocksDB.
Scala
32
star
46

zio-metrics-connectors

Monitoring, Metrics and Diagnostics for ZIO
Scala
30
star
47

zio-ftp

A simple, idiomatic (S)FTP client for ZIO
Scala
30
star
48

zio-crypto

Fast, secure cryptographic primitives in a ZIO & ZIO Streams friendly package.
Scala
29
star
49

zio-parser

Scala
28
star
50

zio-mock

Scala
27
star
51

zio-constraintless

An advanced library for building DSLs that allows defering the existence of type class instances until interpretation.
Scala
26
star
52

zio-codec

High-performance codecs for ZIO applications
Scala
23
star
53

zio-project-seed.g8

giter8 template used to start new ZIO projects for the ZIO organization
Scala
22
star
54

zio-webhooks

A microlibrary for reliable and persistent webhook delivery
Scala
20
star
55

zio-lambda-old

ZIO-powered custom runtime for AWS Lambda
Scala
19
star
56

zio-profiling

Scala
18
star
57

zio-gcp

A ZIO-based interface to Google Cloud API
Scala
18
star
58

zio-insight-ui

TypeScript
17
star
59

interop-java

Scala
17
star
60

caliban-deriving

Full-featured, robust deriving for Caliban.
Scala
16
star
61

zio-insight

Toolset for ZIO developers
Scala
16
star
62

zio-test-intellij

An optional ZIO Test runner support module for the ZIO IntelliJ plugin
Shell
16
star
63

zio-delegate

Scala
14
star
64

interop-twitter

Scala
14
star
65

zio-wasm

WASM AST and syntax based on zio-parser.
Scala
14
star
66

zio-deriving

Scala
11
star
67

zio-memberlist

Cluster membership and failure detection
Scala
11
star
68

zio-sbt

SBT Plugins For ZIO Projects
Scala
11
star
69

interop-monix

Scala
8
star
70

zio-spark

A simple, type-safe ZIO interface to Spark
Scala
8
star
71

interop-scalaz

Scala
7
star
72

interop-guava

Scala
6
star
73

zio-concurrent

Concurrency utilities for ZIO.
JavaScript
6
star
74

zio-morphir

Scala
5
star
75

zio-uring

Scala
5
star
76

interop-future

Scala
5
star
77

zio-quickstart-graphql-webservice

Quickstart for Writing GraphQL Servers
Scala
4
star
78

zio-cron

ZIO Cron
3
star
79

zio-bson

BSON library with tight ZIO integration
Scala
3
star
80

zio-simple-seed.g8

Scala
3
star
81

zio-meta

Scala
2
star
82

zio-quickstart-hello-world

A minimal working example of ZIO Application
Scala
2
star
83

zio-direct-intellij

Scala
2
star
84

zio-insight-server

Scala
2
star
85

zio-distributed

The future home of ZIO Distributed!
Scala
1
star
86

zio-docs

Experimenting with a new way of maintaining dev.zio
JavaScript
1
star