alibaba/x-deeplearning

Stars
4,185
Rank 10,348 (Top 0.3 %)
Language PureBasic
License
Apache License 2.0
Created almost 6 years ago
Updated almost 2 years ago

alibaba/x-deeplearning

alibaba

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

An industrial deep learning framework for high-dimension sparse data

概述

X-DeepLearning(简称XDL)是面向高维稀疏数据场景（如广告/推荐/搜索等）深度优化的一整套解决方案。XDL1.2版本已于近期发布，主要特性包括：

针对大batch/低并发场景的性能优化：在此类场景下性能提升50-100%
存储及通信优化：参数无需人工干预自动全局分配，请求合并，彻底消除ps的计算/存储/通信热点
完整的流式训练特性：包括特征准入，特征淘汰，模型增量导出，特征counting统计等
Fix了若干1.0中的小bugs

完整介绍请参考XDL1.2 release note

1. XDL训练引擎

2. XDL算法解决方案

快速开始

3. Blaze预估引擎

快速开始

4. 深度树匹配模型 TDM 匹配召回引擎

快速开始

联系我们

欢迎通过issue和邮件组([email protected] )联系我们
我们正在寻求合作伙伴，有志于获得XDL企业级支持计划的公司或团队，可以联系[email protected]，与我们进一步商谈。

FAQ

License

XDL使用Apache-2.0许可

致谢

XDL项目由阿里妈妈事业部荣誉出品，核心贡献团队包括阿里妈妈工程平台、算法平台、定向广告技术团队、搜索广告技术团队等，同时XDL项目也得到了阿里巴巴计算平台事业部（特别是PAI团队）的帮助。

arthas

Alibaba Java Diagnostic Tool Arthas/Alibaba Java诊断利器Arthas

easyexcel

快速、简洁、解决大文件内存溢出的java处理Excel工具

p3c

Alibaba Java Coding Guidelines pmd implements and IDE plugin

nacos

an easy-to-use dynamic service discovery, configuration and service management platform for building cloud native applications.

canal

阿里巴巴 MySQL binlog 增量订阅&消费组件

druid

阿里云计算平台DataWorks(https://help.aliyun.com/document_detail/137663.html) 团队出品，为监控而生的数据库连接池

spring-cloud-alibaba

Spring Cloud Alibaba provides a one-stop solution for application development for the distributed solutions of Alibaba middleware.

fastjson

FASTJSON 2.0.x has been released, faster and more secure, recommend you upgrade.

flutter-go

flutter 开发者帮助 APP，包含 flutter 常用 140+ 组件的demo 演示与中文文档

Sentinel

A powerful flow control component enabling reliability, resilience and monitoring for microservices. (面向云原生微服务的高可用流控防护组件)

weex

A framework for building Mobile cross-platform UI

ice

🚀 ice.js: The Progressive App Framework Based On React（基于 React 的渐进式应用框架）

DataX

DataX是阿里云DataWorks数据集成的开源版本。

lowcode-engine

An enterprise-class low-code technology stack with scale-out design / 一套面向扩展设计的企业级低代码技术体系

ARouter

💪 A framework for assisting in the renovation of Android componentization (帮助 Android App 进行组件化改造的路由框架)

hooks

A high-quality & reliable React Hooks library. https://ahooks.pages.dev/

tengine

A distribution of Nginx with some advanced features

formily

📱🚀 🧩 Cross Device & High Performance Normal Form/Dynamic(JSON Schema) Form/Form Builder -- Support React/React Native/Vue 2/Vue 3

vlayout

Project vlayout is a powerfull LayoutManager extension for RecyclerView, it provides a group of layouts for RecyclerView. Make it able to handle a complicate situation when grid, list and other layouts in the same recyclerview.

COLA

🥤 COLA: Clean Object-oriented & Layered Architecture

MNN

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

ali-dbhub

已迁移新仓库，此版本将不再维护

atlas

A powerful Android Dynamic Component Framework.

otter

阿里巴巴分布式数据库同步系统(解决中美异地机房)

rax

🐰 Rax is a progressive framework for building universal application. https://rax.js.org

anyproxy

A fully configurable http/https proxy in NodeJS

fish-redux

An assembled flutter application framework.

x-render

🚴‍♀️ 阿里 - 很易用的中后台「表单 / 表格 / 图表」解决方案

flutter_boost

FlutterBoost is a Flutter plugin which enables hybrid integration of Flutter for your existing native apps with minimum efforts

AndFix

AndFix is a library that offer hot-fix for Android App.

transmittable-thread-local

📌 TransmittableThreadLocal (TTL), the missing Java™ std lib(simple & 0-dependency) for framework/middleware, provide an enhanced InheritableThreadLocal that transmits values between threads even using thread pooling components.

jvm-sandbox

Real - time non-invasive AOP framework container based on JVM

BizCharts

Powerful data visualization library based on G2 and React.

freeline

A super fast build tool for Android, an alternative to Instant Run

UltraViewPager

UltraViewPager is an extension for ViewPager to provide multiple features in a single ViewPager.

jetcache

JetCache is a Java cache framework.

AliSQL

AliSQL is a MySQL branch originated from Alibaba Group. Fetch document from Release Notes at bottom.

AliOS-Things

面向IoT领域的、高可伸缩的物联网操作系统，可去官网了解更多信息https://www.aliyun.com/product/aliosthings

dexposed

dexposed enable 'god' mode for single android application.

butterfly

🦋Butterfly，A JavaScript/React/Vue2 Diagramming library which concentrate on flow layout field. (基于JavaScript/React/Vue2的流程图组件)

QLExpress

QLExpress is a powerful, lightweight, dynamic language for the Java platform aimed at improving developers’ productivity in different business scenes.

BeeHive

🐝 BeeHive is a solution for iOS Application module programs, it absorbed the Spring Framework API service concept to avoid coupling between modules.

HandyJSON

A handy swift json-object serialization/deserialization library

Tangram-Android

Tangram is a modular UI solution for building native page dynamically including Tangram for Android, Tangram for iOS and even backend CMS. This project provides the sdk on Android.

coobjc

coobjc provides coroutine support for Objective-C and Swift. We added await method、generator and actor model like C#、Javascript and Kotlin. For convenience, we added coroutine categories for some Foundation and UIKit API in cokit framework like NSFileManager, JSON, NSData, UIImage etc. We also add tuple support in coobjc.

jstorm

Enterprise Stream Process Engine

dragonwell8

Alibaba Dragonwell8 JDK

LuaViewSDK

A cross-platform framework to build native, dynamic and swift user interface - 强大轻巧灵活的客户端动态化解决方案

fastjson2

🚄 FASTJSON2 is a Java JSON library with excellent performance.

Alink

Alink is the Machine Learning algorithm platform based on Flink, developed by the PAI team of Alibaba computing platform.

f2etest

F2etest是一个面向前端、测试、产品等岗位的多浏览器兼容性测试整体解决方案。

GGEditor

A visual graph editor based on G6 and React

GraphScope

🔨 🍇 💻 🚀 GraphScope: A One-Stop Large-Scale Graph Computing System from Alibaba | 一站式图计算系统

designable

🧩 Make everything designable 🧩

cobar

a proxy for sharding databases and tables

macaca

Automation solution for multi-platform. 多端自动化解决方案

lightproxy

💎 Cross platform Web debugging proxy

pont

🌉数据服务层解决方案

higress

🤖 AI Gateway | AI Native API Gateway

euler

A distributed graph deep learning framework.

sentinel-golang

Sentinel Go enables reliability and resiliency for Go microservices

beidou

🌌 Isomorphic framework for server-rendered React apps

ChatUI

The UI design language and React library for Conversational UI

pipcook

Machine learning platform for Web developers

kiwi

🐤 Kiwi-国际化翻译全流程解决方案

yugong

阿里巴巴去Oracle数据迁移同步工具(全量+增量,目标支持MySQL/DRDS)

jvm-sandbox-repeater

A Java server-side recording and playback solution based on JVM-Sandbox

tsar

Taobao System Activity Reporter

tidevice

tidevice can be used to communicate with iPhone device

TProfiler

TProfiler是一个可以在生产环境长期使用的性能分析工具

tair

A distributed key-value storage system developed by Alibaba Group

dubbo-spring-boot-starter

Dubbo Spring Boot Starter

RedisShake

redis-shake is a tool for synchronizing data between two redis databases. Redis-shake 是一个用于在两个 redis之间同步数据的工具，满足用户非常灵活的同步、迁移需求。

uirecorder

UI Recorder is a multi-platform UI test recorder.

EasyNLP

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab

LVS

A distribution of Linux Virtual Server with some advanced features. It introduces a new packet forwarding method - FULLNAT other than NAT/Tunneling/DirectRouting, and defense mechanism against synflooding attack - SYNPROXY.

GCanvas

A lightweight cross-platform graphics rendering engine. (超轻量的跨平台图形引擎) https://alibaba.github.io/GCanvas

alpha

Alpha是一个基于PERT图构建的Android异步启动框架，它简单，高效，功能完善。在应用启动的时候，我们通常会有很多工作需要做，为了提高启动速度，我们会尽可能让这些工作并发进行。但这些工作之间可能存在前后依赖的关系，所以我们又需要想办法保证他们执行顺序的正确性。Alpha就是为此而设计的，使用者只需定义好自己的task，并描述它依赖的task，将它添加到Project中。框架会自动并发有序地执行这些task，并将执行的结果抛出来。

Tangram-iOS

Tangram is a modular UI solution for building native page dynamically, including Tangram for Android, Tangram for iOS and even backend CMS. This project provides the sdk on iOS platform.

testable-mock

换种思路写Mock，让单元测试更简单

compileflow

🎨 core business process engine of Alibaba Halo platform, best process engine for trade scenes. | 一个高性能流程编排引擎

SREWorks

Cloud Native DataOps & AIOps Platform | 云原生数智运维平台

EasyCV

An all-in-one toolkit for computer vision

LazyScrollView

An iOS ScrollView to resolve the problem of reusability in views.

EasyRec

A framework for large scale recommendation algorithms.

ilogtail

Fast and Lightweight Observability Data Collector

MongoShake

MongoShake is a universal data replication platform based on MongoDB's oplog. Redundant replication and active-active replication are two most important functions. 基于mongodb oplog的集群复制工具，可以满足迁移和同步的需求，进一步实现灾备和多活功能。

xquic

XQUIC Library released by Alibaba is a cross-platform implementation of QUIC and HTTP/3 protocol.

lowcode-demo

An enterprise-class low-code technology stack with scale-out design / 一套面向扩展设计的企业级低代码技术体系

async_simple

Simple, light-weight and easy-to-use asynchronous components

havenask

clusterdata

cluster data collected from production clusters in Alibaba for cluster management research

Jupyter Notebook

mdrill

for千亿数据即席分析

kt-connect

A toolkit for Integrating with your kubernetes dev environment more efficiently

Virtualview-Android

A light way to build UI in custom XML.

yalantinglibs

A collection of modern C++ libraries, include coro_rpc, struct_pack, struct_json, struct_xml, struct_pb, easylog, async_simple

tb_tddl

react-intl-universal

Internationalize React apps. Not only for Component but also for Vanilla JS.

data-juicer

A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！