• Stars
    star
    23,274
  • Rank 976 (Top 0.02 %)
  • Language
    C
  • License
    GNU Affero Genera...
  • Created over 5 years ago
  • Updated 3 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

TDengine

Build Status Build status Coverage Status CII Best Practices
Twitter Follow YouTube Channel Discord Community LinkedIn StackOverflow

English | 简体中文

What Is TDengine?

TDengine is a next generation data historian purpose-built for Industry 4.0 and Industrial IoT. It enables real-time data ingestion, storage, analysis, and distribution of petabytes per day, generated by billions of sensors and data collectors. With TDengine making big data affordable and accessible, digital transformation has never been easier.

TDengine seamlessly integrates with AI-enabled analytics and other third-party tools, with its open ecosystem offering a holistic solution for manufacturers to drive actionable insights and operational efficiency in the IIoT era.

Our mission is to democratize industrial data systems and give people the freedom to use their data however it benefits them most. We are determined to unchain traditional industries from the legacy data infrastructure that has held back digital transformation and move toward a future in which silos are broken down, data is easily centralized and shared, and the benefits of revolutionary technologies like AI are as accessible to the industrial sector as they are to big tech.

Learn more about our offerings:

  • TDengine OSS, a high-performance open-source time-series database
  • TDengine Enterprise, a next generation data historian for Industry 4.0 and the Industrial IoT
  • TDengine Cloud, a fully managed cloud service for industrial big data

Documentation

For user manual, system design and architecture, please refer to TDengine Documentation.

Building

At the moment, TDengine server supports running on Linux/Windows/macOS systems. Any application can also choose the RESTful interface provided by taosAdapter to connect the taosd service . TDengine supports X64/ARM64 CPU, and it will support MIPS64, Alpha64, ARM32, RISC-V and other CPU architectures in the future. Right now we don't support build with cross-compiling environment.

You can choose to install through source code, container, installation package or Kubernetes. This quick guide only applies to installing from source.

TDengine provide a few useful tools such as taosBenchmark (was named taosdemo) and taosdump. They were part of TDengine. By default, TDengine compiling does not include taosTools. You can use cmake .. -DBUILD_TOOLS=true to make them be compiled with TDengine.

To build TDengine, use CMake 3.13.0 or higher versions in the project directory.

Install build tools

Ubuntu 18.04 and above or Debian

sudo apt-get install -y gcc cmake build-essential git libssl-dev libgflags2.2 libgflags-dev

Install build dependencies for taosTools

To build the taosTools on Ubuntu/Debian, the following packages need to be installed.

sudo apt install build-essential libjansson-dev libsnappy-dev liblzma-dev libz-dev zlib1g pkg-config

CentOS 7.9

sudo yum install epel-release
sudo yum update
sudo yum install -y gcc gcc-c++ make cmake3 gflags git openssl-devel
sudo ln -sf /usr/bin/cmake3 /usr/bin/cmake

CentOS 8/Fedora/Rocky Linux

sudo dnf install -y gcc gcc-c++ make cmake epel-release gflags git openssl-devel

Install build dependencies for taosTools on CentOS

CentOS 7.9

sudo yum install -y zlib-devel zlib-static xz-devel snappy-devel jansson jansson-devel pkgconfig libatomic libatomic-static libstdc++-static openssl-devel

CentOS 8/Fedora/Rocky Linux

sudo yum install -y epel-release
sudo yum install -y dnf-plugins-core
sudo yum config-manager --set-enabled powertools
sudo yum install -y zlib-devel zlib-static xz-devel snappy-devel jansson jansson-devel pkgconfig libatomic libatomic-static libstdc++-static openssl-devel

Note: Since snappy lacks pkg-config support (refer to link), it leads a cmake prompt libsnappy not found. But snappy still works well.

If the PowerTools installation fails, you can try to use:

sudo yum config-manager --set-enabled powertools

For CentOS + devtoolset

Besides above dependencies, please run following commands:

sudo yum install centos-release-scl
sudo yum install devtoolset-9 devtoolset-9-libatomic-devel
scl enable devtoolset-9 -- bash

macOS

brew install argp-standalone gflags pkgconfig

Setup golang environment

TDengine includes a few components like taosAdapter developed by Go language. Please refer to golang.org official documentation for golang environment setup.

Please use version 1.20+. For the user in China, we recommend using a proxy to accelerate package downloading.

go env -w GO111MODULE=on
go env -w GOPROXY=https://goproxy.cn,direct

The default will not build taosAdapter, but you can use the following command to build taosAdapter as the service for RESTful interface.

cmake .. -DBUILD_HTTP=false

Setup rust environment

TDengine includes a few components developed by Rust language. Please refer to rust-lang.org official documentation for rust environment setup.

Get the source codes

First of all, you may clone the source codes from github:

git clone https://github.com/taosdata/TDengine.git
cd TDengine

You can modify the file ~/.gitconfig to use ssh protocol instead of https for better download speed. You will need to upload ssh public key to GitHub first. Please refer to GitHub official documentation for detail.

[url "[email protected]:"]
    insteadOf = https://github.com/

Special Note

JDBC Connector, Go Connector,Python Connector,Node.js Connector,C# Connector ,Rust Connector and Grafana plugin has been moved to standalone repository.

Build TDengine

On Linux platform

You can run the bash script build.sh to build both TDengine and taosTools including taosBenchmark and taosdump as below:

./build.sh

It equals to execute following commands:

mkdir debug
cd debug
cmake .. -DBUILD_TOOLS=true -DBUILD_CONTRIB=true
make

You can use Jemalloc as memory allocator instead of glibc:

apt install autoconf
cmake .. -DJEMALLOC_ENABLED=true

TDengine build script can detect the host machine's architecture on X86-64, X86, arm64 platform. You can also specify CPUTYPE option like aarch64 too if the detection result is not correct:

aarch64:

cmake .. -DCPUTYPE=aarch64 && cmake --build .

On Windows platform

If you use the Visual Studio 2013, please open a command window by executing "cmd.exe". Please specify "amd64" for 64 bits Windows or specify "x86" for 32 bits Windows when you execute vcvarsall.bat.

mkdir debug && cd debug
"C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\vcvarsall.bat" < amd64 | x86 >
cmake .. -G "NMake Makefiles"
nmake

If you use the Visual Studio 2019 or 2017:

please open a command window by executing "cmd.exe". Please specify "x64" for 64 bits Windows or specify "x86" for 32 bits Windows when you execute vcvarsall.bat.

mkdir debug && cd debug
"c:\Program Files (x86)\Microsoft Visual Studio\2019\Community\VC\Auxiliary\Build\vcvarsall.bat" < x64 | x86 >
cmake .. -G "NMake Makefiles"
nmake

Or, you can simply open a command window by clicking Windows Start -> "Visual Studio < 2019 | 2017 >" folder -> "x64 Native Tools Command Prompt for VS < 2019 | 2017 >" or "x86 Native Tools Command Prompt for VS < 2019 | 2017 >" depends what architecture your Windows is, then execute commands as follows:

mkdir debug && cd debug
cmake .. -G "NMake Makefiles"
nmake

On macOS platform

Please install XCode command line tools and cmake. Verified with XCode 11.4+ on Catalina and Big Sur.

mkdir debug && cd debug
cmake .. && cmake --build .

Installing

On Linux platform

After building successfully, TDengine can be installed by

sudo make install

Users can find more information about directories installed on the system in the directory and files section.

Installing from source code will also configure service management for TDengine.Users can also choose to install from packages for it.

To start the service after installation, in a terminal, use:

sudo systemctl start taosd

Then users can use the TDengine CLI to connect the TDengine server. In a terminal, use:

taos

If TDengine CLI connects the server successfully, welcome messages and version info are printed. Otherwise, an error message is shown.

On Windows platform

After building successfully, TDengine can be installed by:

nmake install

On macOS platform

After building successfully, TDengine can be installed by:

sudo make install

Users can find more information about directories installed on the system in the directory and files section.

Installing from source code will also configure service management for TDengine.Users can also choose to install from packages for it.

To start the service after installation, double-click the /applications/TDengine to start the program, or in a terminal, use:

sudo launchctl start com.tdengine.taosd

Then users can use the TDengine CLI to connect the TDengine server. In a terminal, use:

taos

If TDengine CLI connects the server successfully, welcome messages and version info are printed. Otherwise, an error message is shown.

Quick Run

If you don't want to run TDengine as a service, you can run it in current shell. For example, to quickly start a TDengine server after building, run the command below in terminal: (We take Linux as an example, command on Windows will be taosd.exe)

./build/bin/taosd -c test/cfg

In another terminal, use the TDengine CLI to connect the server:

./build/bin/taos -c test/cfg

option "-c test/cfg" specifies the system configuration file directory.

Try TDengine

It is easy to run SQL commands from TDengine CLI which is the same as other SQL databases.

CREATE DATABASE demo;
USE demo;
CREATE TABLE t (ts TIMESTAMP, speed INT);
INSERT INTO t VALUES('2019-07-15 00:00:00', 10);
INSERT INTO t VALUES('2019-07-15 01:00:00', 20);
SELECT * FROM t;
          ts          |   speed   |
===================================
 19-07-15 00:00:00.000|         10|
 19-07-15 01:00:00.000|         20|
Query OK, 2 row(s) in set (0.001700s)

Developing with TDengine

Client Libraries

TDengine provides abundant developing tools for users to develop on TDengine. Follow the links below to find your desired connectors and relevant documentation.

Contribute to TDengine

Please follow the contribution guidelines to contribute to the project.

Join the TDengine Community

For more information about TDengine, you can follow us on social media and join our Discord server:

More Repositories

1

taos-connector-csharp

EntityFramework, EF Core, ADO.NET, ORM,Stmt,TDengine
C#
171
star
2

driver-go

taos go driver
Go
88
star
3

grafanaplugin

TDengine datasource plugin for grafana
TypeScript
61
star
4

taosadapter

Taos Adapter for TDengine
Go
56
star
5

TDengine-Operator

Setup TDengine on Kubenetes https://taosdata.github.io/TDengine-Operator
Shell
55
star
6

awesome-tdengine

🎉 A curated list of awesome projects related to TDengine
53
star
7

taos-connector-python

TDengine connector for Python
Python
46
star
8

taos-connector-jdbc

Connecting Java Application With a TDengine Database.
Java
41
star
9

taos-connector-rust

TDengine connector for Rust
Rust
30
star
10

Bailongma

An data transporter for tdengine
Go
24
star
11

taos-tools

taos-tools are some useful tool collections for TDengine.
C
24
star
12

taos-connector-dotnet

TDegnine connector for .Net
C#
22
star
13

libtaos-rs

Rust
20
star
14

blm3

Go
17
star
15

kafka-connect-tdengine

Java
15
star
16

bailongma-rs

TDengine adapters for prometheus
Rust
13
star
17

timeseriesdatabase-comparisons

Shell
12
star
18

taos-connector-node

TDengine connector for Node.js.
JavaScript
12
star
19

taos_odbc

odbc connector for tdengine
C
10
star
20

go-demo-kafka

TDengine Demo Series - Consume Messages from Kafka
Go
9
star
21

tdengine_gorm

Go
9
star
22

vscode-tdengine

visual studio code extension for TDengine
JavaScript
9
star
23

official_website

This is the repository including all source codes of https://www.taosdata.com/.
JavaScript
7
star
24

taoskeeper

Go
6
star
25

go-utils

Go
5
star
26

TSZ

Error-bounded Lossy Data Compressor For Float Double
C
5
star
27

taosws-rs

Rust
4
star
28

homebrew-tdengine

Ruby
4
star
29

tsbs

Time Series Benchmark Suite forked from TimeScale
Go
3
star
30

gds-connector

TDengine connector for Google Data Studio
JavaScript
3
star
31

tdengine-modeling-and-querying-101

101 Examples of TDengine Modeling and Querying.
2
star
32

eii-tdengine-connector

Go
2
star
33

tdengine-playground

Playground of TDengine
Vue
2
star
34

.github

TAOS Data Public Organization Profile
2
star
35

subscribeDemo-java

Java
2
star
36

flink-connector-tdengine

flink connector tdengin
Java
1
star