Add environment (env {}) parser-level support

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Revert "Remove leading underscores from identifiers directly in lexer"

This reverts commit f071e095a2a8f76dd78becfa103b952af68e148d.

The reason why the underscores are needed in the first place is because
we want to make sure sequences and variants to not have clash between
fields called e.g. "stream" and the dynamic scope
"stream.event.header.". Therefore, we need to keep the leading
underscores as part of the internal identifier representation.

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Remove leading underscores from identifiers directly in lexer

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix: do not remove field names when adding fields

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

API : iterator namespace cleanup

For coherence, rename babeltrace_iter to bt_iter, and
trace_collection_pos to bt_iter_pos.

Signed-off-by: Julien Desfossez <julien.desfossez@efficios.com>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Time offset: use trace offset average

Use the average offset for a given clock across all trace descriptions
as offset for the trace collection. This ensures that the time-stamps
stay invariant for a given trace collection: it won't change if the
traversal order of the trace directories change.

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

API : trace_handle

Add the trace_handle structure to allow the user to manipulate a trace.
Will be useful for getting information on specific trace files and
remove traces from a trace_collection without rebuilding the
trace_collection entirely.

Signed-off-by: Julien Desfossez <julien.desfossez@efficios.com>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Print event discarded at end of stream

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Discarded event time range is between last packet event and timestamp_end

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Print time range during which events have been dropped

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Print events discarded

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add clock offset support

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Warn user of clock offsets do not match

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add clocks to trace collection

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

clock: show as time of day

- todo: implement offset at trace collection level.

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Implement clock mapping within integer type

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Implement clock IR generation

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add warning tests

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Relax unknown field handling: warn instead of error

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix erroneous use of "-n" for additional fields, add "-f"

The -n option is for enabling "field name" printing.
Add a new "-f" option for enabling optional fields.

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Output warnings and errors to stderr

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix double typedef of bt_event_name

Reported-by: Tan Dung Le Tran <tan.dung.le.tran@ericsson.com>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Parse clock descriptions

Parse basic clock descriptions and integer "map = identifiers...;".

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

API : split iterator headers from babeltrace.h

Removed the iterator specific prototypes from babeltrace.h
No change in functionnality.

Signed-off-by: Julien Desfossez <julien.desfossez@efficios.com>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add missing context.h/context.c

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Introduce contexts

The context is an object in which the trace_collection is opened. The
iterator (and later callbacks) depend on the context. This patch, does
not modify the behaviour, it is just the introduction of the contexts.
Also moved convert_trace() in the converter code since it is not a
public API function.

Signed-off-by: Julien Desfossez <julien.desfossez@efficios.com>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix parallel build for lib/

When we have a dependency from a library on another library (with
LIBADD), we need to put the lib we depend on in another directory, and
build that directory prior to the current directory. This is what is
done in the http://sourceware.org/autobook/autobook/autobook_92.html
"11.5 Convenience Libraries" example.

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Organise libbabeltrace

Move the library from converter/ to lib/.

Split functionnalities into separate files :
- babeltrace.c
- iterator.c
- callbacks.c

New internal include files for shared structures between iterator and
callbacks :
- include/babeltrace/callbacks-internal.h
- include/babeltrace/iterator-internal.h

No new functionnalities, just a cleanup of the structure.

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Export the format.h header

This header is necessary to open traces since it deals with the various
formats available.
Install it in the include/babeltrace/ folder and make sure it is
included when we include babeltrace.h

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Create the babeltrace include dir on install

And for now just install babeltrace.h in it.

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

callbacks: use correct type for element size

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

callbacks: Fix set size array size

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix callback chain array usage

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add time delta to ctf-text

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

ctf-text: show timestamp in sec.nsec

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix wrong variable error check

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Use the generic call to move_pos_slow

Replace two hardcoded calls to ctf_move_pos_slow by calls to the
function pointer registered when opening a trace.

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Version 0.8

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add loglevel support

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Update libpopt dependency to 1.13

After careful review of popt cvs tree, after cross-correlation of CHANGE
file with source code POPT_ARGFLAG_OPTIONAL updates, identified that the
updates to this part of the code end at 1.13.

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Document dependency on libpopt >= 1.8

ref: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=285666

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Describe libtool version dependency

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

AC_PROG_LIBTOOL is deprecated in favor of LT_INIT

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Use realpath for path

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Helper function to extract string from fields

Following the same principle as get_char_array and get_(un)signed_int,
this function returns a char* to a string from an event field.

[ Edit by Mathieu Desnoyers: add header prototype. ]

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Use realpath on trace collection path

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

allow printing domains when no procname are present, handle various / patterns

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add trace:domain,trace:procname,trace:pid support

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add "-n trace" option to print trace name

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Do not install ctf-parser-test

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Make ctf open errors more verbose

With many files, it is useful to know the cause of open errors, e.g.

File stream openat(): Too many open files

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

configure.ac: add check for popt library

The popt library is used by babeltrace but isn't checked in
configure.ac, so the compilation fails due to popt.h being missing if
popt is not already installed on the system.

Signed-off-by: Thomas Petazzoni <thomas.petazzoni@free-electrons.com>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Show field names by default, enhance --names option

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Move opt_field_names/babeltrace_verbose/babeltrace_debug into lib

Introduce BABELTRACE_VERBOSE and BABELTRACE_DEBUG env. var.

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add mmap trace reading

This set of functions allows a client to open a trace that is not stored
on tracefiles but instead is in memory.
Since the parameters required for such an operation are really different
than typical traces, we define the open_mmap_trace function.
This patch also introduces the mmap_stream structure and
mmap_stream_list that represents a list of FDs readable by mmap.

[ Edit by Mathieu Desnoyers: cleanup ]

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Pass stream pointer with callback caller data

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Version 0.7

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add missing stdint.h

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Use integer extraction functions

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Extract int and char arrays from fields

Three helper functions to ease the extraction of basic types from event
fields. For now we support signed and unsigned integers and strings.
Other functions could be added following the same principle for other
types.

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add parameters to callbacks

This patchs adds a new structure that is passed by the library as the
first parameter of each callback call. As of now it only provides a
pointer to the current event. Now we also pass the pointer to the
private data registered when the callback is added.

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix float support

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix type cast warning

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Integer support: add missing signed casts

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Remove underscore prefix from field names (pretty-print)

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix sequence iteration

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix sequence field name use after free

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix support for empty streams

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Optional file pointer to metadata

For some use-cases it may be useful to control the file pointer to the
metadata instead of lookup absolutely for a file named "metadata" in the
trace directory. If the pointer is NULL, we fallback to the original
mode.

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Specify callback to move packet in open_trace

This patch adds a new parameter to open_trace to allow the user to
specify the function to call when babeltrace needs to switch packet.
This patch is a first step for the mmap reading code integration.

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Free the callbacks on iter_destroy

[ edit : use TRUE instead of 1 ]

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add callback support

This patchs provides the code to add callbacks per event or for each
events. For now the priority is not handled so the callbacks are
processed in a FIFO manner and global callbacks are processed before
per-event callbacks.

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Basic seek support

For now just mimic the previous behaviour of babeltrace but with a basic
seek structure.
We define the babeltrace_iter_seek that seeks each file_stream of an
iterator to a given position and the babeltrace_filestream_seek function
that does the actual seek on the file_stream and can be used internally.

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add callback API

Implementation still has to be done.

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Enhance babeltrace API with position save/restore

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Remove unused structure forward declarations

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Remove stale local .c struct declarations (unused)

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Annotate branches in ctf.c event reading/writing code

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Annotate prio heap likely branch

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Annotate likely/unlikely branches in headers

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Update version to 0.6

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Export the babeltrace API in babeltrace.h

Rename the previous babeltrace.h as babeltrace-internal.h

[ Edit by Mathieu Desnoyers: API cleanup. ]

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix support for gold linker: inappropriate dep removal of plugins

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add missing converter/babeltrace-api.h

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Babeltrace public API

Add a new library to allow external tools to read traces.
Updated convert_trace to use this API.

[ Edit by Mathieu Desnoyers: add error value checks, update comments ]

Signed-off-by: Julien Desfossez <julien.desfossez@polymtl.ca>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix babeltrace-log output header

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Save current event id

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Babeltrace: print correct version number

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Update version to 0.5, add changelog

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Initialize size to 0 to eliminate incorrect gcc uninitialized var warning

gcc does not seem to keep track of both size and has_size.

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix non-matching packet context wrt last packet event read

The last event in a packet is seen with the timestamp of the beginning
of the next packet due to an incorrect handling of ctf_move_pos() : the
"ctf_move_pos_slow" that switches between packets needs to be called at
the next event, rather than at the end of the last event of the packet.
When the position was getting to the end of the payload of the last
event, it was immediately changing packet, which changed all packet
context information, including the current timestamp.

This is fixed by explicitely calling the ctf_move_pos_slow() on packet
boundaries at the beginning of event read rather than at each
ctf_move_pos call.

We also fix handling of empty trace packets here: when an empty packet
is detected, we need to move on to the next packet immediately within
ctf_move_pos_slow() rather than let the caller think there is some event
data in the empty packet.

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Version 0.4

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Multiple Directory Conversion

Code added/modified to merge and convert many CTF binary files located
in different directories into one ASCII file.

Edit by Mathieu Desnoyers:

- Introduce struct trace_collection, because this will eventually be
  seen as an API to the outside world, so I want to hide the internal
  dependency on glib types.
- Added #define _XOPEN_SOURCE 700 needed for openat and nftw at the top
  of babeltrace.c.

Signed-off-by: Amer Alhalabi <amer.alhalabi@ericsson.com>
Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Version 0.3

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add lttng-modules 2.0-pre5 trace file

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Skip padding from metadata end of packet

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

update test files header to "CTF 1.8"

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Update message

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Fix reading of empty packets

Prior to this fix, an empty packet would be considered as an end of
file. (off-by-one in the size comparison)

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>

Add warning for missing /* TSDL header

Signed-off-by: Mathieu Desnoyers <mathieu.desnoyers@efficios.com>