Scalable & Secure

Open Source

Open Source is in our DNA

We believe in the open source community and invests in moving open source projects forward.

Over the last 15 years, we have invented an open data protocol adopted by Apple, Uber and thousands of other companies, created one of the world’s largest Hadoop user communities, and brought Linux to the Fortune 100.

We know first – hand that open source makes software more accessible, developers more connected, and the world a little smaller. We strive to give back to the community and welcome your contributions to our projects.

Invented by Treasure Data Engineers

With 600+ plugins and native support for Docker and Kubernetes, Fluentd is one of the most popular tools for log management.

2020欧洲杯APPEmbulk is an open source data loader to move massive data across storage systems, software services, file formats and data centers.

Apache Hivemall democratizes machine learning by bringing cutting edge ML algorithms to the fingertips of SQL analysts.

2020欧洲杯APPMessagePack is an efficient binary serialization format. It lets you exchange data among multiple languages like JSON. But it’s faster and smaller.

Digdag is a simple tool that helps you to build, run, schedule, and monitor complex pipelines of tasks. It handles dependency resolution so that tasks run in series or in parallel.

2020欧洲杯APPFluent Bit is an open source data collector, which allows you to collect data from different sources, unify it and send it to multiple destinations.

MONKEY

2020欧洲杯APPFast, lightweight and scalable web server

JEROMQ

2020欧洲杯APPZeroMQ in Pure Java

PYENV

Simple Python environment manager

SNAPPY – JAVA

2020欧洲杯APPThe Java implementation of Google’s Snappy compressor/decompressor

NORIKRA

Schemaless stream processing in SQL

HTTPCLIENT

2020欧洲杯APPRuby http client library

Causes We Proudly Sponsor

Projects We Contribute To

2020欧洲杯APPContributed the Logging Driver for Fluentd

Contributed the logging capabilities with Fluentd

Two of our engineers are committers

Various contributions including MySQL support

Various contributions including MLLib and Spark SQL

One of the largest contributors among Facebook and Starburst