• Stars
    star
    167
  • Rank 221,816 (Top 5 %)
  • Language
    JavaScript
  • License
    MIT License
  • Created over 9 years ago
  • Updated about 7 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Converts output of various profiling/sampling tools to the .cpuprofile format so it can be loaded into Chrome DevTools.

cpuprofilify build status

testling badge

Converts output of various profiling/sampling tools to the .cpuprofile format so it can be loaded into Chrome DevTools.

screenshot

Table of Contents generated with DocToc

Installation

npm install -g cpuprofilify

Instructions

cpuprofilify installs two binary scripts:

  • profile_1ms.d: DTrace script that samples your process, use either of the following to generate a trace
    • sudo profile_1ms.d -c 'node --perf-basic-prof <app>' | cpuprofilify > out.cpuprofile
    • sudo profile_1ms.d -p <process id> | cpuprofilify > out.cpuprofile
  • cpuprofilify: which will convert a perf or DTrace trace into a .cpuprofile importable into Chrome DevTools
    • perf record -e cycles:u -g -- node --perf-basic-prof <app> && perf script | cpuprofilify > out.cpuprofile

Use the perf record and perf script commands on Linux to generate input to cpuprofilify and the provided profile_1ms.d script to do so on OSX via dtrace.

Example

using DTrace script

# In Terminal A
➝  sudo profile_1ms.d -c 'node --perf-basic-prof example/fibonacci' | \
      cpuprofilify > /tmp/example.cpuprofile
pid <process-pid>
HTTP server listening on port 8000

# In Terminal B
➝  ab -n 6 -c 2 http://:::8000/1000/
This is ApacheBench, Version 2.3 <$Revision: 1554214 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking :: (be patient).....done
[ .. ]

➝  sudo kill <process-pid>

Now open /tmp/example.cpuprofile in Chrome DevTools Profiles - Load

NOTE: in order to try the above example please clone this repository.

Usage

cat trace.txt | cpuprofilify <options> > my.cpuprofile

  Converts the given trace taking according to the given opttions


OPTIONS:

--unresolveds  , --nounresolveds    unresolved addresses like `0x1a23c` are filtered from the trace unless this flag is set (default: false)
--sysinternals , --nosysinternals   sysinternals like `__lib_c_start...` are filtered from the trace unless this flag is set (default: false)
--v8internals  , --nov8internals    v8internals like `v8::internal::...` are filtered from the trace unless this flag is set (default: false)
--v8gc         , --nov8gc           when v8internals are filtered, garbage collection info is as well unless this flag set  (default: true)

--shortStack      , --noshortStack        stacks that have only one line are ignored unless this flag is set (default: false)
--optimizationinfo, --nooptimizationinfo  JS optimization info is removed unless this flag is set (default: false)


--type                              type of input `perf|dtrace`. If not supplied it will be detected.
--help                              print this help

EXAMPLE:

  Generate cpuprofile from DTrace data with default options
  using higher switchrate in order to deal with large amount of data being emitted

    sudo profile_1ms.d -x switchrate=1000hz  -c <command> | cpuprofilify > out.cpuprofile

  Generate cpuprofile from DTrace data with default options keeping v8 internals

    sudo profile_1ms.d -c <command> | cpuprofilify --v8internals > out.cpuprofile

  Generate cpuprofile from DTrace data with default options filtering v8 gc events

    sudo profile_1ms.d -c <command> | cpuprofilify --nov8gc > out.cpuprofile

cpuprofilify and perf

use this on any system that doesn't have DTrace, but perf instead like Linux

perf record -e cycles:u -g -- node --perf-basic-prof myapp.js
perf script | cpuprofilify > out.cpuprofile

API

CpuProfilifier()

Creates new CpuProfilifier

Source:

CpuProfilifier::convert(trace, opts) → {Object}

Converts the given trace taking according to the given opts.

var cpuprofilifier = require('cpuprofilifier');
var cpuprofile = cpuprofilifier().convert(trace);
fs.writeFileSync('/tmp/my.cpuprofile', JSON.stringify(cpuprofile));
Parameters:
Name Type Argument Description
trace Array.<String>

a trace generated via perf script or the profile_1ms.d DTrace script

opts Object <optional>
Properties
Name Type Description
map string

a map containing symbols information, if not given it will be read from /tmp/perf-.map.

type string

type of input perf|dtrace. If not supplied it will be detected.

shortStack Boolean

stacks that have only one line are ignored unless this flag is set

optimizationinfo Boolean

JS optimization info is removed unless this flag is set (default: false)

unresolveds Boolean

unresolved addresses like 0x1a23c are filtered from the trace unless this flag is set (default: false)

sysinternals Boolean

sysinternals like __lib_c_start... are filtered from the trace unless this flag is set (default: false)

v8internals Boolean

v8internals like v8::internal::... are filtered from the trace unless this flag is set (default: false)

v8gc Boolean

when v8internals are filtered, garbage collection info is as well unless this flag set (default: true)

Source:
Returns:

an cpuprofile presentation of the given trace

Type
Object

generated with docme

License

MIT

More Repositories

1

doctoc

📜 Generates table of contents for markdown files inside local git repository. Links are compatible with anchors generated by github or other sites.
JavaScript
4,176
star
2

proxyquire

🔮 Proxies nodejs require in order to allow overriding dependencies during testing.
JavaScript
2,741
star
3

v8-perf

⏱️ Notes and resources related to v8 and thus Node.js performance
JavaScript
2,193
star
4

deoptigate

⏱️ Investigates v8/Node.js function deoptimizations.
JavaScript
1,148
star
5

brace

📔 browserify compatible version of the ace editor.
JavaScript
1,056
star
6

browserify-shim

📩 Makes CommonJS incompatible files browserifyable.
JavaScript
935
star
7

learnuv

Learn uv for fun and profit, a self guided workshop to the library that powers Node.js.
C
711
star
8

es6ify

browserify >=v2 transform to compile JavaScript.next (ES6) to JavaScript.current (ES5) on the fly.
JavaScript
595
star
9

visulator

A machine emulator that visualizes how each instruction is processed
JavaScript
381
star
10

exorcist

Externalizes the source map found inside a stream to an external .js.map file
JavaScript
332
star
11

parse-link-header

Parses a link header and returns paging information for each contained link.
JavaScript
298
star
12

libuv-dox

Documenting types and methods of libuv, mostly by reading 'uv.h'.
247
star
13

rid-examples

Examples showing how to use Rid in order to build Dart/Flutter apps integrated with Rust.
Dart
215
star
14

replpad

Pipes content of files to a node repl whenever they change to enable a highly interactive coding experience.
JavaScript
213
star
15

browserify-ftw

Converts an entire project that uses requirejs amd into on that uses nodejs common modules so it can be browserified.
JavaScript
188
star
16

cardinal

Syntax highlights JavaScript code with ANSI colors to be printed to the terminal.
JavaScript
175
star
17

turbolizer

Turbolizer tool from the v8 repository with added support to preload a profile
JavaScript
175
star
18

convert-source-map

Converts a source-map from/to different formats.
JavaScript
168
star
19

flamegraph

Generates flamegraphs with Node.js or in the browser.
HTML
164
star
20

proxyquireify

browserify >= v2 version of proxyquire. Mocks out browserify's require to allow stubbing out dependencies while testing.
JavaScript
153
star
21

batufo

UFO mutli-player game using Flutter.
Dart
152
star
22

spok

Checks a given object against a given specification to keep you from writing boilerplate tests.
TypeScript
147
star
23

v8-flags

Configures v8 flags at runtime.
C
119
star
24

wasm2js

Compile WebAssembly .wasm files to a commonjs module.
JavaScript
110
star
25

browserify-markdown-editor

A demo showing how to build a markdown editor with browserify and marked.
JavaScript
91
star
26

combine-source-map

Add source maps of multiple files, offset them and then combine them into one source map.
JavaScript
78
star
27

nad

Node Addon Developer, a tool to inject your addon code into a copy of the node codebase in order to integrate with IDEs and debuggers easily.
JavaScript
76
star
28

irish-pub

Feel like npm is drunk or maybe you are and want to verify what gets published via `npm publish`? irish-pub has you covered.
JavaScript
69
star
29

hypernal

Renders terminal output as html to simplify reusing server side modules in the browser.
JavaScript
64
star
30

rid

Rust integrated Dart framework providing an easy way to build Flutter apps with Rust.
Rust
64
star
31

exposify

browserify transform that exposes globals added via a script tag as modules so they can be required.
JavaScript
63
star
32

nif

node --inspect a file and open devtool url in chrome via chrome-cli.
JavaScript
59
star
33

active-handles

Prints out information about the process's active handles, including function source and location
JavaScript
58
star
34

doctoc-web

This is the source of the DocToc web application.
JavaScript
56
star
35

traceviewify

Converts .cpuprofile format to trace viewer JSON object format to allow analysing the data in chrome://tracing.
JavaScript
55
star
36

readline-vim

Adds vim bindings to nodejs readline.
JavaScript
55
star
37

docme

Generates github compatible API documentation from your project's jsdocs and adds them to your Readme.
JavaScript
54
star
38

bunyan-format

Writable stream that formats bunyan records that are piped into it
JavaScript
51
star
39

wicked

Generates github wiki compatible API documentation from your project's jsdocs and adds them to your wiki.
JavaScript
49
star
40

lldb-jbt

Adds JavaScript symbols to lldb stack traces
Python
48
star
41

phe

Poker hand evaluator
JavaScript
47
star
42

d3-gauge

Gauge visualization built on top of d3.
CSS
45
star
43

dev-null

/dev/null for node streams
JavaScript
43
star
44

WebToInk

Downloads and converts a properly set up Html book or a blog into mobi format
Haskell
40
star
45

docmac

Install docker on Mac including VirtualBox and boot2docker dependencies with one simple command.
Shell
39
star
46

stack-mapper

Initialize it with a source map, then feed it error stacks to have the trace locations mapped to the original files.
JavaScript
39
star
47

stream-viz

Visualizes streams in the browser.
JavaScript
37
star
48

dotfiles

My vim and bash related dotfiles.
Shell
36
star
49

iojs-inspect-entire-stack

Demonstrating how to inspect the entire io.js stack
JavaScript
36
star
50

hermit

Prints html in the terminal using colors and simple layout to reflect the document structure.
JavaScript
36
star
51

v8-map-processor

Processes and visualizes maps (aka hidden classes) created by v8 during execution.
HTML
35
star
52

mold-source-map

Mold a source map that is almost perfect for you into one that is.
JavaScript
35
star
53

bromote

Tool to setup and require remote scripts with browserify.
JavaScript
35
star
54

log.h

Minimal yet colorful logging lib.
C
34
star
55

inline-source-map

Adds source mappings and base64 encodes them, so they can be inlined in your generated file.
JavaScript
34
star
56

testlingify

Adds github hooks and browser config for testling.
JavaScript
33
star
57

browserify-swap

A transform that swaps out modules according to a config in your package.json selected via an environment variable.
JavaScript
32
star
58

v8-profiling

Exploring how to hook into the various v8 profilers
C++
32
star
59

scriptie-talkie

Makes your code tell you what the intermediate results are when executing a script.
JavaScript
31
star
60

ee.c

EventEmitter in C.
C
30
star
61

resolve-bin

Resolves the full path to the bin file of a given package by inspecting the \"bin\" field in its package.json.
JavaScript
30
star
62

node-syntaxhighlighter

Node friendly version of Alex Gorbachev's great SyntaxHighlighter.
CSS
29
star
63

v8-runtime-functions

Exposing and documenting v8 runtime functions.
JavaScript
27
star
64

hyperwatch

Streams server side log messages to the browser and renders them inside your page.
JavaScript
27
star
65

sass-resolve

Resolves all sass files in current project and all dependencies to create one sass file which includes them all.
JavaScript
26
star
66

ansicolors

Functions that surround a string with ansicolor codes so it prints in color.
JavaScript
26
star
67

dockerify

Prepares any tarball containing a project so that a docker image can be built from it.
JavaScript
26
star
68

spinup

Spins up multiple versions of your app, each in its own docker container
JavaScript
25
star
69

redeyed

Takes JavaScript code, along with a config and returns the original code with tokens wrapped and/or replaced as configured.
JavaScript
25
star
70

anchor-markdown-header

Generates an anchor for a markdown header.
JavaScript
25
star
71

nasmx

The NASMX Project (manually maintained mirror) Documentation: https://thlorenz.github.io/nasmx
Assembly
25
star
72

find-parent-dir

Finds the first parent directory that contains a given file or directory.
JavaScript
24
star
73

dox

Notes and cheat sheets on various topics
DTrace
23
star
74

benchgraph

Runs {io,node}.js benchmarks and generates pretty graphs
JavaScript
22
star
75

kebab

Half queue half pubsub. Super small (< 30 loc) and simple queue that supports subscribers.
JavaScript
22
star
76

pong.asm

pong game written in assembly for i386 (32-bit) architecture.
Assembly
22
star
77

linuxasmtools

This package is part of AsmTools (a collection of programs for assembler development on Linux X86 cpu's.)
Assembly
22
star
78

peacock

JavaScript syntax highlighter that generates pygments compatible html and therefore supports pygments styles.
CSS
22
star
79

talks

Numerous talks I gave at meetups and conferences some based on reveal.js.
HTML
20
star
80

valiquire

Validates that all require statements in a project point to an existing path and are correctly cased.
JavaScript
20
star
81

prange

Parses poker hand range short notation into a range array.
JavaScript
19
star
82

jsdoc-githubify

A transform that adapts html files generated with jsdoc to be rendered in a github wiki or readme.
JavaScript
19
star
83

chromium-remote-debugging-proxy

A proxy that sits in between a chromium devtools frontend and the remote chromium being debugged and logs requests, responses and websocket messages that are exchanged.
JavaScript
19
star
84

ocat

Inspect an object various ways in order to easily generate test cases.
JavaScript
17
star
85

v8-sandbox

C++
17
star
86

hhp

Poker HandHistory Parser
JavaScript
16
star
87

node-traceur

Mirror of experimental ES6 to ES5 compiler that is kept in sync with code on google.
JavaScript
16
star
88

v8-ic-processor

Processes and visualizes IC (inline cache) information collected for functions in your application
HTML
16
star
89

pec

Poker equity calculator. Compares two combos or one combo against a range to compute winning equity.
JavaScript
16
star
90

floodgate

Throttles a stream to pass one value per given interval.
JavaScript
16
star
91

level-dump

Dumps all values and/or keys of a level db or a sublevel to the console.
JavaScript
15
star
92

tap-stream

Taps a nodejs stream and logs the data that's coming through
JavaScript
14
star
93

parse-key

Parses strings into key objects of the same format as the ones emitted by nodejs readline.
JavaScript
14
star
94

dockops

docker convenience functions on top of dockerode
JavaScript
14
star
95

nf-rated

Store and process Netflix movies including IMDB rating.
Rust
14
star
96

lib.asm

Collection of assembly routines in one place to facilitate reuse.
Assembly
13
star
97

sql-escape-string

Simple SQL string escape.
JavaScript
13
star
98

caching-coffeeify

A coffeeify version that caches previously compiled coffee-script to optimize the coffee-script compilation step.
JavaScript
13
star
99

cathode

Example for react server side rendering without the fluff
JavaScript
11
star
100

dog

Developer blOGgin Engine, markdown based, made to be simple and fast, yet feature rich.
JavaScript
11
star