• Stars
    star
    119
  • Rank 297,930 (Top 6 %)
  • Language
    C
  • Created almost 16 years ago
  • Updated almost 8 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

An easy to use, tiny, public domain, C wrapper library around Igor Pavlov's work that can be used to compress and extract lzma files.
Overview

Easylzma is a C library and command line tools for LZMA compression and 
decompression.  It uses a Igor Pavlov's reference implementation and SDK
written in C.

License

All the cruft you find here is public domain.  You don't have to credit
anyone to use this code, but my personal request is that you mention
Igor Pavlov for his hard, high quality work.

Project Goals

1. A tiny C wrapper and portable build system around a subset of
   Igor Pavlov's public domain LZMA compression and decompression
   implementation.
2. A tiny and straighforward API
3. Support for multiple different prominent LZMA file formats (see section on
   file formats below)
4. easy to build and use everywhere (doze and nix alike)
5. public domain licensing through and through.  (hats off to Igor)

Current State:

THIS IS A WORK IN PROGRESS.  The code here should be considered pre-alpha,
and this should only be used by tinkerers or hackers at this point.  Once
feature completion is attained this message will be updated.  See the
TODO file distributed with the source for remaining work to be done.

Platforms Supported

0.0.2 has been successfully compiled and run basic round trip testing
on the following platforms & compilers:

  * win32 - visual studio 2005
  * osx - 10.4 & 10.5 (intel)
  * netbsd ppc - 4.0.1 with gcc 4.1.2
    (NOTE: memory allocation errors when dict size is default)
  * freebsd 6.1 - amd64 gcc 3.4.4

Features

XXX: write me (and the code)

Usage

XXX: write me (and the code)

The Saga of LZMA File Formats, and a couple cents.

As far as I can tell, there are at least four different ways to put LZMA
compressed data in a stream:

1. The LZMA-Alone format, which consists of a 13 byte header including
   compression properties, dictionary size, and the uncompressed size of
   the file, followed by compressed data.  This format has some support
   in Igor Pavlov's reference implementation and is in widespread use, as
   it's supported by lzmautils: http://tukaani.org/lzma/

   The canonical (afaict) implementation of this format (lzmautis) is
   BSD licensed.

2. The lzip format (http://www.nongnu.org/lzip/lzip.html) - which
   includes a CRC footer and leading "magic number".  The former
   affords data integrity gaurantees, while the latter simplifies
   heuristic determination of file format.  This format looks to have
   reasonably widespread usage, though not quite as significant as
   LZMA-Alone.

   The only implementation of this format I can find (lzip) is GPL licensed.

3. the xz format ( http://tukaani.org/xz/xz-file-format.txt ) which is
   a more complex representation that includes CRC support and a magic
   number.  This format is to be supported by the next iteration of
   XZ Utils which is currently in beta.  The source may be obtained
   here: git://ctrl.tukaani.org/xz.git

   This format will address some criticisms to the LZMA-Alone format and
   was developed collaboratively by Lasse Collin (the current maintainer
   of XZ utils) and Igor Pavlov (the author of 7zip and the refrence
   implementation of LZMA).

   The xz format will employ LZMA2 which consists of extensions on top
   of LZMA, in the xz utils maintainer's words:

   "The primary compression algorithm in .xz is currently LZMA2, which
    is an extension on top of the orignal LZMA to fix a few practical
    issues, like adding support for flushing the encoder (equivalent
    to zlib's Z_SYNC_FLUSH), which isn't possible with the original
    LZMA."

   Again, maintainers words, regarding licensing:

   "XZ Utils currently contains a zlib-like compression library and a 
    gzip-like command line tool. It's currently under LGPLv2.1+ but I will 
    put it into the public domain before the first stable release."

4. The 7zip disk format which can contain multiple files possibly stored in
   LZMA compressed format.

Given the state of things, the goal of this project is to develop something
based on the existing formats, and quickly leverage code generated by the XZ
Utils project, or simply kill this thing if that project produces something
that's easy to embed and has a clean API at a similar level of abstraction
as easylzma.

lloyd - sometime in oh nine.

More Repositories

1

node-memwatch

A NodeJS library to keep an eye on your memory usage, and discover and isolate leaks.
C++
2,482
star
2

yajl

A fast streaming JSON parsing library in C.
C
2,116
star
3

JSONSelect

CSS-like selectors for JSON
JavaScript
1,590
star
4

node-toobusy

Build Node.JS servers that don't fall over.
JavaScript
1,304
star
5

node-compute-cluster

NodeJS library for distributing computation across multiple processes.
JavaScript
444
star
6

orderly

The reference implementation of orderly: a schema language for JSON.
C
220
star
7

myfavoritebeer.org

A demonstration of how to use BrowserID.
JavaScript
102
star
8

connect-etagify

etagify is connect middleware to add ETag headers to cachable but non-static content.
JavaScript
49
star
9

ircloggr

A system for producing web accessible IRC logs, in node.js.
JavaScript
34
star
10

connect-select

Server side filtering of JSON responses using JSONSelect
JavaScript
33
star
11

ass

A node.js code coverage library which aggregates stats cross process.
JavaScript
22
star
12

JSONSelectTests

Conformance tests for the JSONSelect selector language
22
star
13

persona.js

Use Persona for authentication, the easy way
22
star
14

node-browserid

A nodejs library that verifies BrowserID assertions.
JavaScript
21
star
15

wnram

Go
20
star
16

urlparse.js

URL parsing in javascript with validation, normalization, and matching.
JavaScript
17
star
17

fully_loaded_node

A presentation for http://node.ph which explores scaling CPU bound Node.JS services.
16
star
18

docstract

Parses documentation out of javascript source and outputs JSON.
Python
15
star
19

awsbox-helloworld

A hello world application that demonstrates deploying on awsbox
JavaScript
9
star
20

goj

A fast JSON scanner in go.
Go
8
star
21

lloyd.io

lloyd's blog and website
HTML
8
star
22

blobastorus

A happy little open source dinosaur that offers free itty bitty bits of json cloud storage for webby html5y apps.
JavaScript
8
star
23

myfavoritebooze.org

Another example site that uses BrowserID.
JavaScript
8
star
24

node-cpusage

CPU Sage is a NodeJS library that let's you query the current processes cpu usage.
JavaScript
8
star
25

node.js-persona-example

A minimalist Persona Integration example in Node.JS
JavaScript
7
star
26

yajl_vs_rapidjson

quick and dirty performance comparison of two json parsers.
C++
6
star
27

bakery

A ports system for software projects. Add software by adding "recipes". Build software by placing an "order".
C
6
star
28

gobbledygook

A localization debugging tool that translates strings into legible gobbledygook. In javaScript.
JavaScript
6
star
29

littlepass

(EXPERIMENT) Awesome machine generated passwords for little ones, worldwide?
Python
5
star
30

connect-browserid

nothing to see here.
JavaScript
5
star
31

awsbox-socketio-example

An example of running websockets via socket.io on top of awsbox
JavaScript
4
star
32

notathing

a thing that's not a thing, and probably will never be a thing.
JavaScript
4
star
33

node_leak

tracking down a memory leak in node?
JavaScript
4
star
34

wtfpl

say less.
4
star
35

popcornjs.org

a static clone of popcornjs.org that I can hack on
JavaScript
4
star
36

myfavoriteshow.org

An example site that uses BrowserID to let users sign up for a mailing list.
JavaScript
4
star
37

scrapify

the thing that does the stuff!
Python
3
star
38

browserid-keysigner

JavaScript
3
star
39

mephitidae

JavaScript
3
star
40

throwdown

help, I can't stop creating github repositories!
3
star
41

nice.js

JavaScript
2
star
42

lloyd.github.com

my page
2
star
43

restwork

(EXPERIMENTAL) A minimalist framework for building awesome REST APIs in node.js servers.
JavaScript
2
star
44

postMessagePerf

A little exploration of postMessage throughput
2
star
45

leery

a thing that does some stuff, but not yet.
JavaScript
2
star
46

mozhacks.org

A meta-hack
JavaScript
2
star
47

photovat

nothing to see here.
Python
2
star
48

dotPlan

lloyd's .plan. inspired by pfinette, in turn inspired by John Carmack
2
star
49

chromeless-unplugged

wip
JavaScript
2
star
50

jsga.me

there is nothing to see here.
JavaScript
2
star
51

browserid_ncfs

nothing to see here.
2
star
52

test_travis_ci

a test repo for broken IRC notifications to some servers in travis-ci
2
star
53

connect-postprocess

Experimental middleware for connect that helps intercept and mutate responses.
JavaScript
2
star
54

crash-mozillians

a hacked up lil command line tool to help debug sasl-browserid. not really interesting.
JavaScript
2
star
55

persona-preso

A presentation of persona for DenverJS
JavaScript
1
star
56

cloudwatch2statsd

a dirty hack, maybe general later.
JavaScript
1
star
57

connect-minify

EXPERIMENTAL: lightweight connect middleware for automagic on-the fly combination and minification of resources
JavaScript
1
star
58

testidp.org

JavaScript
1
star
59

i-am-a-dissenter

1
star
60

servedir

a trivial static webserver to serve a directory
Go
1
star
61

mehmeh

C
1
star
62

simulated_infobars

code experiment in simulating infobars in chrome extensions
JavaScript
1
star
63

personatra.in

A simple web based calendar which helps people understand the phases of Persona "trains"
JavaScript
1
star
64

prioritize.io

nothing to see here.
JavaScript
1
star