Scriptorium 📜

• Game Scripting Languages benchmarked.
• Using latest versions at the time of writing (Jul 2015)
• Total solutions evaluated: 50

Results

Rank	Language	Flavor	Time	Relative Lua speed	Score
1	C	vc	0.074 s.		1808 pt
2	Lua	luajit	0.111 s.		1203 pt
3	Terra	terra	0.121 s.		1107 pt
4	C	c4-jit	0.136 s.		986 pt
5	C	libtcc	0.151 s.		886 pt
6	Pawn	pawn-asm	0.384 s.		349 pt
7	Lua	luajit-nojit	0.521 s.		257 pt
8	Pawn	pawn	0.719 s.		186 pt
9	TinyVM	tinyvm	0.786 s.		170 pt
10	Scheme	chibi	1.009 s.		132 pt
11	Neko	nekovm	1.104 s.		121 pt
12	Lua	lua	1.341 s.		100 pt
13	Ruby	tinyrb(ist)	1.441 s.		93 pt
14	GameMonkey	gamemonkey	1.691 s.		79 pt
15	Angelscript	angelscript-jit	1.859 s.		72 pt
16	Wren	wren	1.997 s.		67 pt
17	Lily	lily	2.005 s.		66 pt
18	Angelscript	angelscript	2.039 s.		65 pt
19	Ruby	mruby	2.098 s.		63 pt
20	Squirrel	squirrel	2.126 s.		63 pt
21	Scheme	s7	2.136 s.		62 pt
22	C	c4	2.538 s.		52 pt
23	Python	micropython	2.842 s.		47 pt
24	Dao	dao	2.876 s.		46 pt
25	QuakeC	gmqcc	3.060 s.		43 pt
26	ObjectScript	objectscript	3.108 s.		43 pt
27	SGScript	sgscript	4.620 s.		29 pt
28	Java	Jog	4.675 s.		28 pt
29	JetScript	JetScript	4.810 s.		27 pt
30	Lisp	minilisp	6.951 s.		19 pt
31	Lisp	aria	8.010 s.		16 pt
32	JavaScript	duktape	9.544 s.		14 pt
33	Tcl	jim	12.280 s.		10 pt
34	GML	gml	16.443 s.		8 pt
35	MiniScheme	MiniScheme	17.345 s.		7 pt
36	PSL	psl	17.645 s.		7 pt
37	Python	tinypy(panda)	21.799 s.		6 pt
38	Scheme	s9	33.160 s.		4 pt
39	C	picoC	36.625 s.		3 pt
40	JX9	jx9	43.598 s.		3 pt
41	PHP	ph7	46.029 s.		2 pt
42	JTC	jtc	47.021 s.		2 pt
43	JavaScript	v7	51.940 s.		2 pt
44	Scheme	tinyscheme	65.398 s.		2 pt
45	Lisp	paren	72.901 s.		1 pt
46	Lisp	lispy90	91.767 s.		1 pt
47	Tcl	picol	151.527 s.		0 pt
48	ChaiScript	chaiscript	175.038 s.		0 pt
49	JavaScript	42tiny-js	227.170 s.		0 pt
50	Tcl	lil	555.976 s.		0 pt

• AMD A10 3.8 GHz, 8 GiB, Windows 7 64bit.
• Compiled on VS2015 RC if possible, VS2013 elsewhere.
• Take it with a grain of salt.

Language requirements

• must embed from C++.
• must be self-contained (no BOOST, no LLVM backends).
• must compile on vs2015 (or vs2013 at least).
• must link statically.
• must not require (heavy) makefiles/cygwin/build-systems to build.
• must use jit/optimizations if available.

Test requirements

• must compare fair between languages. for example:
  • must not use yield/coroutines on recursive fibonacci test.
  • must disable threading if possible (not all languages are thread-safe)
  • etc

Upcoming (soon)

• creating a class to handle them all (relevant)
• @todo {
• add exe size
• add iteration benchmarks
• add string benchmarks
• add script->native round trip
• add native->script round trip
• add memory consumption
• add memory leaks
• add time to set up
• add final thoughts
• also, create a score chart, based on:
  • small
  • clean
  • type (interpreted/bytecode/jit)
  • fast
  • containers
  • OO
  • closures
  • bindings
  • 32/64bit
  • threading
  • thread-safety
  • coroutines/greenlets
  • debug capabilities
  • zero-configuration based (drag-n-drop files on solution/project)
  • ...
• }

To evaluate (someday... maybe)

• http://catpad.net/michael/jvm/
• http://jamvm.sourceforge.net/
• https://oss.readytalk.com/avian/
• https://qore.org/downloads ?
• http://www.codeproject.com/Articles/24029/Home-Made-Java-Virtual-Machine
• http://www.harbaum.org/till/nanovm/index.shtml
• http://www.kiffer.be/open-mika.html
• https://code.google.com/archive/p/tart
• https://github.com/aardappel/lobster
• https://github.com/andyfischer/circa
• https://github.com/chameco/Solid
• https://github.com/clever-lang/clever
• https://github.com/evanw/skew
• https://github.com/ex/Killa
• https://github.com/gregtour/duck-lang
• https://github.com/H2CO3/Sparkling
• https://github.com/JarrettBillingsley/Croc
• https://github.com/jeorgun/Vivaldi
• https://github.com/kimtg/arcadia
• https://github.com/kimtg/ToyLisp
• https://github.com/LukasBanana/XieXie-2
• https://github.com/nim-lang/Nim (or https://github.com/nim-lang/csources)
• https://github.com/noct/expr
• https://github.com/parrot/parrot
• https://github.com/perl11/potion
• https://github.com/proglangclass/vm
• https://github.com/red/red
• https://github.com/scross99/locic
• https://github.com/stevedekorte/io
• https://github.com/timburks/nu
• https://github.com/zeux/aike
• https://github.com/dotnet/coreclr
• http://www.mono-project.com/
• https://en.wikipedia.org/wiki/P-code
• http://www.dwheeler.com/6502/oneelkruns/qforth.html
• https://robovm.com/
• http://www.lejos.org/ (or http://tinyvm.sourceforge.net/)
• http://dmitry.gr/index.php?r=05.Projects&proj=12.%20uJ%20-%20a%20micro%20JVM
• https://github.com/dartino/sdk
• https://github.com/RuntimeCompiledCPlusPlus/RuntimeCompiledCPlusPlus
• https://github.com/NETMF/netmf-interpreter

License

• initial tests by Lewis Van Winkle (2009) (Public Domain)
• makefiles, bench code, compilation fixes & most tests put into public domain (@r-lyeh)