tmf: Change Offset Dialog advanced mode layout
[deliverable/tracecompass.git] / org.eclipse.tracecompass.help / doc / User-Guide.mediawiki
CommitLineData
ff25eb47
BH
1
2= Overview =
3
4LTTng (Linux Trace Toolkit, next generation) is a highly efficient tracing tool for Linux that can be used to track down kernel and application performance issues as well as troubleshoot problems involving multiple concurrent processes and threads. It consists of a set of kernel modules, daemons - to collect the raw tracing data - and a set of tools to control, visualize and analyze the generated data. It also provides support for user space application instrumentation.
ff25eb47
BH
5For more information about LTTng, refer to the project [http://lttng.org site]
6
c3181353 7'''Note''': This User Guide covers the integration of the latest LTTng (up to v2.4) in Eclipse.
ff25eb47
BH
8
9== About Tracing ==
10
11Tracing is a troubleshooting technique used to understand the behavior of an instrumented application by collecting information on its execution path. A tracer is the software used for tracing. Tracing can be used to troubleshoot a wide range of bugs that are otherwise extremely challenging. These include, for example, performance problems in complex parallel systems or real-time systems.
12
13Tracing is similar to logging: it consists in recording events that happen in a system at selected execution locations. However, compared to logging, it is generally aimed at developers and it usually records low-level events at a high rate. Tracers can typically generate thousands of events per second. The generated traces can easily contain millions of events and have sizes from many megabytes to tens of gigabytes. Tracers must therefore be optimized to handle a lot of data while having a small impact on the system.
14
15Traces may include events from the operating system kernel (IRQ handler entry/exit, system call entry/exit, scheduling activity, network activity, etc). They can also consists of application events (a.k.a UST - User Space Tracing) or a mix of the two.
16
c3181353 17For the maximum level of detail, tracing events may be viewed like a log file. However, trace analyzers and viewers are available to derive useful information from the raw data coupled with knowledge of the traced program. These programs must be specially designed to handle quickly the enormous amount of data a trace may contain.
ff25eb47
BH
18
19== LTTng integration ==
20
21The LTTng plug-in for Eclipse provides an Eclipse integration for the control of the LTTng tracer as well as fetching and visualization of the traces produced. It also provides the foundation for user-defined analysis tools.
22
23The LTTng Eclipse plug-in provides the following views:
24
25* ''Project'' - an extension to the standard Eclipse Project view tailored for tracing projects
26* ''Control'' - to control the tracer and configure the tracepoints
27* ''Events'' - a versatile view that presents the raw events in tabular format with support for searching, filtering and bookmarking
28* ''Statistics'' - a view that that provides simple statistics on event occurrences by type
29* ''Histogram'' - a view that displays the event density with respect to time in traces
30
31These views can be extended or tailored for specific trace types (e.g. kernel, HW, user app).
32
c3181353 33At present, the LTTng Eclipse plug-in for Eclipse supports the following kernel-oriented views:
ff25eb47
BH
34
35* ''Control Flow'' - to visualize processes state transitions
36* ''Resources'' - to visualize system resources state transitions
c3181353
MK
37* ''CPU usage'' - to visualize the usage of the processor with respect to the time in traces
38
39It also supports the following User Space traces views:
40
41* ''Memory Usage'' - to visualize the memory usage per thread with respect to time in the traces
42* ''Call Stack'' - to visualize the call stack's evolution over time
ff25eb47
BH
43
44Although the control and fetching parts are targeted at the LTTng tracer, the underlying framework can also be used to process any trace that complies with the ''Common Trace Format'' ([http://www.efficios.com/ctf CTF]). CTF specifies a very efficient and compact binary trace format that is meant to be application-, architecture-, and language-agnostic.
45
46== Features ==
47
48The LTTng Eclipse plug-in has a number of features to allow efficient handling of very large traces (and sets of large traces):
49
50* Support for arbitrarily large traces (larger than available memory)
51* Support for correlating multiple time-ordered traces
52* Support for zooming down to the nanosecond on any part of a trace or set of traces
32adc12c 53* Views synchronization of currently selected time or time range, and window time range
ff25eb47
BH
54* Efficient searching and filtering of events
55* Support for trace bookmarks
c3181353 56* Support for importing and exporting trace packages
ff25eb47
BH
57
58There is also support for the integration of non-LTTng trace types:
59
60* Built-in CTF parser
61* Dynamic creation of customized parsers (for XML and text traces)
c3181353
MK
62* Dynamic creation of customized state systems (from XML files)
63* Dynamic creation of customized views (from XML files)
ff25eb47
BH
64
65= Installation =
66
67This section describes the installation of the LTTng tracer and the LTTng Eclipse plug-ins as well as their dependencies.
68
69== LTTng Tracer ==
70
71While the Eclipse plug-ins can run on the standard Eclipse platforms (Linux, Mac, Windows), the LTTng tracer and its accompanying tools run on Linux.
72
73The tracer and tools have been available for download in Ubuntu since 12.04. They can easily be installed with the following command:
74
75<pre>
76 > sudo apt-get install lttng-tools
77</pre>
78
79For other distributions, older Ubuntu distributions, or the latest, bleeding edge LTTng tracer, please refer to the [http://lttng.org/download LTTng website] for installation information.
80
81'''Note''': The LTTng tracer (and accompanying tools) is required only if you want to create your own traces (the usual case). If you intend to simply analyze existing traces then it is not necessary to install the tracer.
82
83== LTTng Eclipse Plug-ins ==
84
85The easiest way to install the LTTng plug-ins for Eclipse is through the Software Updates and Add-ons menu. For information on how to use this menu, refer to this [http://wiki.eclipse.org/Linux_Tools_Project/PluginInstallHelp#Installing_Updates_From_the_Linux_Tools_Update_Site link].
86
ff25eb47
BH
87The LTTng plug-ins are structured as a stack of features/plug-ins as following:
88
89* '''CTF''' - A CTF parser that can also be used as a standalone component
90** ''Feature'': org.eclipse.linuxtools.ctf
91** ''Plug-ins'': org.eclipse.linuxtools.ctf.core, org.eclipse.linuxtools.ctf.parser
43d4f823 92
c3181353
MK
93* '''State System Core''' - State system for TMF
94** ''Plug-ins'': org.eclipse.linuxtools.statesystem.core
95
ff25eb47
BH
96* '''TMF''' - ''Tracing and Monitoring Framework'' a framework for generic trace processing
97** ''Feature'': org.eclipse.linuxtools.tmf
c3181353
MK
98** ''Plug-ins'': org.eclipse.linuxtools.tmf.core, org.eclipse.linuxtools.tmf.ui. org.eclipse.linuxtools.tmf.analysis.xml.core, org.eclipse.linuxtools.tmf.analysis.xml.ui
99
100* '''CTF support for TMF''' - CTF support for the TMF Feature
101** ''Feature'': org.eclipse.linuxtools.tmf.ctf
102** ''Plug-ins'': org.eclipse.linuxtools.tmf.ctf.core
ff25eb47
BH
103
104* '''LTTng''' - The wrapper for the LTTng tracer control. Can be used for kernel or application tracing.
8e8c0226
AM
105** ''Feature'': org.eclipse.linuxtools.lttng2.control
106** ''Plug-ins'': org.eclipse.linuxtools.lttng2.control.core, org.eclipse.linuxtools.lttng2.control.ui
ff25eb47
BH
107
108* '''LTTng Kernel''' - Analysis components specific to Linux kernel traces
109** ''Feature'': org.eclipse.linuxtools.lttng2.kernel
110** ''Plug-ins'': org.eclipse.linuxtools.lttng2.kernel.core, org.eclipse.linuxtools.lttng2.kernel.ui
111
c3181353
MK
112* '''LTTng UST''' - Analysis components specific to Linux userspace traces
113** ''Feature'': org.eclipse.linuxtools.lttng2.ust
114** ''Plug-ins'': org.eclipse.linuxtools.lttng2.ust.core, org.eclipse.linuxtools.lttng2.ust.ui
115
ff25eb47
BH
116== LTTng Eclipse Dependencies ==
117
c3181353 118The Eclipse LTTng controls the LTTng tracer through an ''ssh'' connection, if the tracer is running locally it can use or bypass the ''ssh'' connection.
ff25eb47
BH
119
120Therefore, the target system (where the tracer runs) needs to run an ''ssh'' server as well as ''sftp'' server (for file transfer) to which you have permission to connect.
121
122On the host side (where Eclipse is running), you also need to have Eclipse RSE (Remote System Explorer) installed to handle the SSH connection and transport. The RSE can be installed the standard way (''Help'' > ''Install New Software...'' > ''General Purpose Tools'' > ''Remote System Explorer End-User Runtime'').
123
124== Installation Verification ==
125
c3181353
MK
126If you do not have any, sample LTTng traces can be found here [http://lttng.org/download]. At the bottom of the page there is a link to some sample LTTng 2.0 kernel traces. The trace needs to be uncompressed to be read.
127
ff25eb47
BH
128Here are the quick steps to verify that your installation is functional:
129
130* Start Eclipse
131* Open the LTTng perspective
132* Create a Tracing project
133** Right-click in the Project view and select "New Project"
134** Enter the name of your project (e.g. "MyLTTngProject")
135** The project will be created. It will contain 2 empty folders: "Traces" and "Experiments"
9e684aeb 136* Open a sample trace
c3181353
MK
137** Right-click on the newly created project "Traces" folder and select "Open Trace..."
138** Navigate to the sample LTTng trace that you want to visualize and select any file in the trace folder
ff25eb47
BH
139** The newly imported trace should appear under the Traces folder
140* Visualize the trace
141** Expand the Traces folder
142** Double-click on the trace
143** The trace should load and the views be populated
144
145If an error message is displayed, you might want to double-check that the trace type is correctly set (right-click on the trace and "Select Trace Type...").
146
c3181353 147Refer to [[#Tracing Perspective]] for detailed description of the views and their usage.
ff25eb47
BH
148
149= LTTng =
150
151== Tracing Perspective ==
152
43d4f823 153The '''Tracing''' perspective is part of the '''Tracing and Monitoring Framework (TMF)''' and groups the following views:
ff25eb47 154
43b509ac
MAL
155* [[#Project_View | Project View]]
156* [[#Events_Editor | Events Editor]]
157* [[#Histogram_View | Histogram View]]
158* [[#Statistics_View | Statistics View]]
ff25eb47
BH
159
160The views are synchronized i.e. selecting an event, a timestamp, a time range, etc will update the other views accordingly.
161
162[[Image:images/TracingPerspective.png]]
163
164The perspective can be opened from the Eclipse Open Perspective dialog ('''Window > Open Perspective... > Other''').
165
166[[Image:images/ShowTracingPerspective.png]]
167
43d4f823 168In addition to these views, the '''Tracing and Monitoring Framework (TMF)''' feature provides a set of generic tracing specific views, such as:
ff25eb47 169
43b509ac
MAL
170* [[#Colors_View | Colors View]]
171* [[#Filters_View | Filters View]]
172* [[#Time_Chart_View | Time Chart View]]
43b509ac
MAL
173* [[#State_System_Explorer_View | State System Explorer View]]
174* [[#Call_Stack_View | Call Stack View]]
ff25eb47 175
43b509ac 176The framework also supports user creation of [[#Custom_Parsers | Custom Parsers]].
43d4f823
PT
177
178To open one of the above '''Tracing''' views, use the Eclipse Show View dialog ('''Window > Show View > Other...'''). Then select the relevant view from the '''Tracing''' category.
ff25eb47
BH
179
180[[Image:images/ShowTracingViews.png]]
181
43d4f823 182Additionally, the '''LTTng''' feature provides an '''LTTng Tracer Control''' functionality. It comes with a dedicated '''Control View'''.
ff25eb47 183
43b509ac 184* [[#LTTng_Tracer_Control | LTTng Tracer Control]]
ff25eb47
BH
185
186== Project View ==
43d4f823
PT
187
188The project view is the standard Eclipse Project Explorer. '''Tracing''' projects are well integrated in the Eclipse's Common Navigator Framework. The Project Explorer shows '''Tracing''' project with a small "T" decorator in the upper right of the project folder icon.
ff25eb47
BH
189
190=== Creating a Tracing Project ===
43d4f823 191
ff25eb47
BH
192A new '''Tracing''' project can be created using the New Tracing Project wizard. To create a new '''Tracing''' select '''File > New > Project...''' from the main menu bar or alternatively form the context-sensitive menu (click with right mouse button in the '''Project Explorer'''.
193
43d4f823 194The first page of project wizard will open.
ff25eb47
BH
195
196[[Image:images/NewTracingProjectPage1.png]]
197
198In the list of project categories, expand category '''Tracing''' and select '''Tracing Project''' and the click on '''Next >'''. A second page of the wizard will show. Now enter the a name in the field '''Project Name''', select a location if required and the press on '''Finish'''.
199
200[[Image:images/NewTracingProjectPage2.png]]
201
43d4f823 202A new project will appear in the '''Project Explorer''' view.
ff25eb47
BH
203
204[[Image:images/NewProjectExplorer.png]]
205
43d4f823 206Tracing projects have two sub-folders: '''Traces''' which holds the individual traces, and '''Experiments''' which holds sets of traces that we want to correlate.
ff25eb47 207
e03c29a7 208=== Importing Traces to the Project ===
9e684aeb 209
e03c29a7
PT
210The '''Traces''' folder holds the set of traces available for a tracing project. It can optionally contain a tree of trace folders to organize traces into sub-folders. The following chapters will explain different ways to import traces to the '''Traces''' folder of a tracing project.
211
43b509ac
MAL
212* [[#Opening a Trace | Opening a Trace]]
213* [[#Importing | Importing]]
214* [[#Drag and Drop | Drag and Drop]]
ad19d2e4 215
1aec2e92 216==== Opening a Trace ====
9e684aeb 217
e03c29a7 218To open a trace, right-click on a target trace folder and select '''Open Trace...'''.
9e684aeb
MAL
219
220[[Image:images/OpenTraceFile.png]]
221
e03c29a7 222A new dialog will show for selecting a trace to open. Select a trace file and then click on '''OK'''. Note that for traces that are directories (such as Common Trace Format (CTF) traces) any file in the trace directory can be selected to open the trace. Now, the trace viewer will attempt to detect the trace types of the selected trace. The auto detection algorithm will validate the trace against all known trace types. If multiple trace types are valid, a trace type is chosen based on a confidence criteria. The validation process and the computation of the confidence level are trace type specific. After successful validation the trace will be linked into the selected target trace folder and then opened with the detected trace type.
9e684aeb
MAL
223
224Note that a trace type is an extension point of the '''Tracing and Monitoring Framework (TMF)'''. Depending on the which features are loaded, the list of available trace types can vary.
225
ad19d2e4 226==== Importing ====
9e684aeb 227
e03c29a7 228To import a set of traces to a trace folder, right-click on the target folder and select '''Import...''' from the context-sensitive menu.
ad19d2e4
MAL
229
230[[Image:images/ProjectImportTraceAction.png]]
231
c8cf44dc 232At this point, the '''Import Trace Wizard''' will show for selecting traces to import. By default, it shows the correct destination directory where the traces will be imported to. Now, specify the location of the traces in the '''Root directory'''. For that click on the button '''Browse''', browse the media to the location of the traces and click on '''OK'''. Then select the traces to import in the list of files and folders.
ad19d2e4 233
c8cf44dc
MAL
234Traces can also be imported from an archive file such as a zip or a tar file by selecting the '''Select archive file''' option then by clicking '''Browse'''. Then select the traces to import in the list of files and folders as usual.
235
236Optionally, select the '''Trace Type''' from the drop-down menu. If '''Trace Type''' is set to '''<Automatic Detection>''', the wizard will attempt to detect the trace types of the selected files. The automatic detection algorithm validates a trace against all known trace types. If multiple trace types are valid, a trace type is chosen based on a confidence criteria. The validation process and the computation of the confidence level are trace type specific. Optionally, '''Import unrecognized traces''' can be selected to import trace files that could not be automatically detected by '''<Automatic Detection>'''.
ad19d2e4 237
e03c29a7 238Select or deselect the checkboxes for '''Overwrite existing trace without warning''', '''Create links in workspace''' and '''Preserve folder structure'''. When all options are configured, click on '''Finish'''.
ad19d2e4
MAL
239
240Note that traces of certain types (e.g. LTTng Kernel) are actually a composite of multiple channel traces grouped under a folder. Either the folder or its files can be selected to import the trace.
241
c8cf44dc 242The option '''Preserve folder structure''' will create, if necessary, the structure of folders relative to (and excluding) the selected '''Root directory''' (or '''Archive file''') into the target trace folder.
e03c29a7 243
ad19d2e4
MAL
244[[Image:images/ProjectImportTraceDialog.png]]
245
e03c29a7 246If a trace already exists with the same name in the target trace folder, the user can choose to rename the imported trace, overwrite the original trace or skip the trace. When rename is chosen, a number is appended to the trace name, for example smalltrace becomes smalltrace(2).
ff25eb47 247
ad19d2e4
MAL
248[[Image:images/ProjectImportTraceDialogRename.png]]
249
250If one selects '''Rename All''', '''Overwrite All''' or '''Skip All''' the choice will be applied for all traces with a name conflict.
251
19178c82 252Upon successful importing, the traces will be stored in the target trace folder. If a trace type was associated to a trace, then the corresponding icon will be displayed. If no trace type is detected the default editor icon associated with this file type will be displayed. Linked traces will have a little arrow as decorator on the right bottom corner.
ad19d2e4
MAL
253
254Note that trace type is an extension point of the '''Tracing and Monitoring Framework (TMF)'''. Depending on the which features are loaded, the list of trace types can vary.
255
e03c29a7 256Alternatively, one can open the '''Import...''' menu from the '''File''' main menu, then select '''Tracing''' > '''Trace Import''' and click on '''Next >'''.
efa5fe79 257
ad19d2e4 258[[Image:images/ProjectImportWizardSelect.png]]
efa5fe79 259
ad19d2e4 260At this point, the '''Import Trace Wizard''' will show. To import traces to the tracing project, follow the instructions that were described above.
efa5fe79 261
e03c29a7 262==== Drag and Drop ====
efa5fe79 263
e03c29a7 264Traces can be also be imported to a project by dragging from another tracing project and dropping to the project's target trace folder. The trace will be copied and the trace type will be set.
efa5fe79 265
e03c29a7 266Any resource can be dragged and dropped from a non-tracing project, and any file or folder can be dragged from an external tool, into a tracing project's trace folder. The resource will be copied or imported as a new trace and it will be attempted to detect the trace types of the imported resource. The automatic detection algorithm validates a trace against all known trace types. If multiple trace types are valid, a trace type is chosen based on a confidence criteria. The validation process and the computation of the confidence level are trace type specific. If no trace type is detected the user needs to set the trace type manually.
efa5fe79 267
e03c29a7 268To import the trace as a link, use the platform-specific key modifier while dragging the source trace. A link will be created in the target project to the trace's location on the file system.
ad19d2e4 269
e03c29a7 270If a folder containing traces is dropped on a trace folder, the full directory structure will be copied or linked to the target trace folder. The trace type of the contained traces will not be auto-detected.
ad19d2e4 271
e03c29a7 272It is also possible to drop a trace, resource, file or folder into an existing experiment. If the item does not already exist as a trace in the project's trace folder, it will first be copied or imported, then the trace will be added to the experiment.
ad19d2e4 273
a460743a
MAL
274=== Trace Package Exporting and Importing ===
275
276A trace package is an archive file that contains the trace itself and can also contain its bookmarks and its supplementary files. Including supplementary files in the package can improve performance of opening an imported trace but at the expense of package size.
277
278==== Exporting ====
279
280The '''Export Trace Package Wizard''' allows users to select a trace and export its files and bookmarks to an archive on a media.
281
e03c29a7 282The '''Traces''' folder holds the set of traces available for a tracing project. To export traces contained in the '''Traces''' folder, one can open the '''Export...''' menu from the '''File''' main menu. Then select '''Trace Package Export'''
a460743a
MAL
283
284[[Image:images/tracePackageImages/fileExport.png]]
285
e03c29a7 286At this point, the '''Trace Package Export''' is opened. The project containing the traces has to be selected first then the traces to be exported.
a460743a
MAL
287
288[[Image:images/tracePackageImages/chooseTrace.png]]
289
e03c29a7 290One can also open the wizard and skip the first page by expanding the project, selecting traces or trace folders under the '''Traces''' folder, then right-clicking and selecting the '''Export Trace Package...''' menu item in the context-sensitive menu.
a460743a
MAL
291
292[[Image:images/tracePackageImages/exportSelectedTrace.png]]
293
294Next, the user can choose the content to export and various format options for the resulting file.
295
296[[Image:images/tracePackageImages/exportPackage.png]]
297
298The '''Trace''' item is always selected and represents the files that constitute the trace. The '''Supplementary files''' items represent files that are typically generated when a trace is opened by the viewer. Sharing these files can speed up opening a trace dramatically but also increases the size of the exported archive file. The ''Size'' column can help to decide whether or not to include these files. Lastly, by selecting '''Bookmarks''', the user can export all the bookmarks so that they can be shared along with the trace.
299
300The '''To archive file''' field is used to specify the location where to save the resulting archive.
301
302The '''Options''' section allows the user to choose between a tar archive or a zip archive. Compression can also be toggled on or off.
303
e03c29a7 304When Finish button is clicked, the package is generated and saved to the media. The folder structure of the selected traces relative to the '''Traces''' folder is preserved in the trace package.
a460743a
MAL
305
306==== Importing ====
307
308The '''Import Trace Package Wizard''' allows users to select a previously exported trace package from their media and import the content of the package in the workspace.
309
310The '''Traces''' folder holds the set of traces for a tracing project. To import a trace package to the '''Traces''' folder, one can open the '''Import...''' menu from the '''File''' main menu. Then select '''Trace Package Import'''.
311
312[[Image:images/tracePackageImages/fileImport.png]]
313
e03c29a7 314One can also open the wizard by expanding the project name, right-clicking on a target folder under the '''Traces''' folder then selecting '''Import Trace Package...''' menu item in the context-sensitive menu.
a460743a
MAL
315
316[[Image:images/tracePackageImages/importTraceFolder.png]]
317
318At this point, the '''Trace Package Import Wizard''' is opened.
319
320[[Image:images/tracePackageImages/importPackage.png]]
321
322The '''From archive file''' field is used to specify the location of the trace package to export. The user can choose the content to import in the tree.
323
324If the wizard was opened using the File menu, the destination project has to be selected in the '''Into project''' field.
325
e03c29a7 326When Finish is clicked, the trace is imported in the target folder. The folder structure from the trace package is restored in the target folder.
a460743a 327
ff25eb47
BH
328=== Selecting a Trace Type ===
329
e03c29a7 330If no trace type was selected a trace type has to be associated to a trace before it can be opened. To select a trace type select the relevant trace and click the right mouse button. In the context-sensitive menu, select '''Select Trace Type...''' menu item. A sub-menu will show will all available trace type categories. From the relevant category select the required trace type. The examples, below show how to select the '''Common Trace Format''' types '''LTTng Kernel''' and '''Generic CTF trace'''.
ff25eb47
BH
331
332[[Image:images/SelectLTTngKernelTraceType.png]]
333
334[[Image:images/SelectGenericCTFTraceType.png]]
335
336After selecting the trace type, the trace icon will be updated with the corresponding trace type icon.
337
338[[Image:images/ExplorerWithAssociatedTraceType.png]]
339
e03c29a7
PT
340=== Opening a Trace or Experiment ===
341
19178c82 342A trace or experiment can be opened by double-clicking the left mouse button on the trace or experiment in the '''Project Explorer''' view. Alternatively, select the trace or experiment in the in the '''Project Explorer''' view and click the right mouse button. Then select '''Open''' menu item of the context-sensitive menu. If there is no trace type set for a file resource then the file will be opened in the default editor associated with this file type.
e03c29a7
PT
343
344[[Image:images/OpenTraceAction.png]]
345
346When opening a trace or experiment, all currently opened views which are relevant for the corresponding trace type will be updated.
347
348If a trace resource is a file (and not a directory), then the '''Open With''' menu item is available in the context-sensitive menu and can be used to open the trace source file with any applicable internal or external editor. In that case the trace will not be processed by the tracing application.
349
ff25eb47
BH
350=== Creating a Experiment ===
351
43d4f823 352An experiment consists in an arbitrary number of aggregated traces for purpose of correlation. In the degenerate case, an experiment can consist of a single trace. The experiment provides a unified, time-ordered stream of the individual trace events.
ff25eb47 353
43d4f823 354To create an experiment, select the folder '''Experiments''' and click the right mouse button. Then select '''New...'''.
ff25eb47
BH
355
356[[Image:images/NewExperimentAction.png]]
357
43d4f823 358A new display will open for entering the experiment name. Type the name of the experiment in the text field '''Experiment Name''' and the click on '''OK'''.
ff25eb47
BH
359
360[[Image:images/NewExperimentDialog.png]]
361
362=== Selecting Traces for an Experiment ===
363
43d4f823 364After creating an experiment, traces need to be added to the experiment. To select traces for an experiment select the newly create experiment and click the right mouse button. Select '''Select Traces...''' from the context sensitive menu.
ff25eb47
BH
365
366[[Image:images/SelectTracesAction.png]]
367
eb879a47 368A new dialog box will open with a list of available traces. The filter text box can be used to quickly find traces. Use buttons '''Select All''' or '''Deselect All''' to select or deselect all traces. Select the traces to add from the list and then click on '''Finish'''.
ff25eb47
BH
369
370[[Image:images/SelectTracesDialog.png]]
371
372Now the selected traces will be linked to the experiment and will be shown under the '''Experiments''' folder.
373
374[[Image:images/ExplorerWithExperiment.png]]
375
43b509ac 376Alternatively, traces can be added to an experiment using [[#Drag_and_Drop | Drag and Drop]].
ff25eb47
BH
377
378=== Removing Traces from an Experiment ===
379
43d4f823 380To remove one or more traces for an experiment select the trace(s) to remove under the Experiment folder and click the right mouse button. Select '''Remove''' from the context sensitive menu.
ff25eb47
BH
381
382[[Image:images/RemoveTracesAction.png]]
383
384After that the selected trace(s) are removed from the experiment. Note that the traces are still in the '''Traces''' folder.
385
386=== Renaming a Trace or Experiment ===
387
43d4f823 388Traces and Experiment can be renamed from the '''Project Explorer''' view. To rename a trace or experiment select the relevant trace and click the right mouse button. Then select '''Rename...''' from the context sensitive menu. The trace or experiment needs to be closed in order to do this operation.
ff25eb47
BH
389
390[[Image:images/RenameTraceAction.png]]
ff25eb47 391
43d4f823
PT
392A new dialog box will show for entering a new name. Enter a new trace or experiment name respectively in the relevant text field and click on '''OK'''. If the new name already exists the dialog box will show an error and a different name has to be entered.
393
394[[Image:images/RenameTraceDialog.png]]
ff25eb47 395
43d4f823 396[[Image:images/RenameExperimentDialog.png]]
ff25eb47 397
43d4f823 398After successful renaming the new name will show in the '''Project Explorer'''. In case of a trace all reference links to that trace will be updated too. Note that linked traces only changes the display name, the underlying trace resource will stay the original name.
ff25eb47 399
43b509ac 400Note that all supplementary files will be also handled accordingly (see also [[#Deleting Supplementary Files | Deleting Supplementary Files]]).
ff25eb47
BH
401
402=== Copying a Trace or Experiment ===
403
43d4f823 404To copy a trace or experiment select the relevant trace or experiment in the '''Project Explorer''' view and click the right mouse button. Then select '''Copy...''' from the context sensitive menu.
ff25eb47
BH
405
406[[Image:images/CopyTraceAction.png]]
ff25eb47 407
43d4f823 408A new dialog box will show for entering a new name. Enter a new trace or experiment name respectively in the relevant text field and click on '''OK'''. If the new name already exists the dialog box will show an error and a different name has to be entered.
ff25eb47 409
43d4f823 410[[Image:images/CopyTraceDialog.png]]
ff25eb47 411
43d4f823
PT
412[[Image:images/CopyExperimentDialog.png]]
413
414After successful copy operation the new trace or experiment respectively will show in the '''Project Explorer'''. In case of a linked trace, the copied trace will be a link to the original trace too.
ff25eb47 415
43b509ac 416Note that the directory for all supplementary files will be copied, too. (see also [[#Deleting Supplementary Files | Deleting Supplementary Files]]).
ff25eb47
BH
417
418=== Deleting a Trace or Experiment ===
419
43d4f823 420To delete a trace or experiment select the relevant trace or experiment in the '''Project Explorer''' view and click the right mouse button. Then select '''Delete...''' from the context sensitive menu. The trace or experiment needs to be closed in order to do this operation.
ff25eb47
BH
421
422[[Image:images/DeleteExperimentAction.png]]
43d4f823 423
ff25eb47
BH
424A confirmation dialog box will open. To perform the deletion press '''OK''' otherwise select '''Cancel'''.
425
426[[Image:images/DeleteExperimentConfirmationDialog.png]]
427
43d4f823 428After successful operation the selected trace or experiment will be removed from the project. In case of a linked trace only the link will be removed. The actual trace resource remain on the disk.
ff25eb47 429
43b509ac 430Note that the directory for all supplementary files will be deleted, too. (see also [[#Deleting Supplementary Files | Deleting Supplementary Files]]).
ff25eb47
BH
431
432=== Deleting Supplementary Files ===
433
07ed89d6 434Supplementary files are by definition trace specific files that accompany a trace. These file could be temporary files, persistent indexes or any other persistent data files created by the LTTng integration in Eclipse during parsing a trace. For the LTTng 2.0 trace viewer a persistent state history of the Linux Kernel is created and is stored under the name '''stateHistory.ht'''. The statistics for all traces are stored under '''statistics.ht'''. Other state systems may appear in the same folder as more custom views are added.
ff25eb47
BH
435
436All supplementary file are hidden from the user and are handled internally by the TMF. However, there is a possibility to delete the supplementary files so that there are recreated when opening a trace.
437
e03c29a7 438To delete all supplementary files from one or many traces and experiments, select the relevant traces and experiments in the '''Project Explorer''' view and click the right mouse button. Then select the '''Delete Supplementary Files...''' menu item from the context-sensitive menu.
ff25eb47
BH
439
440[[Image:images/DeleteSupplementaryFilesAction.png]]
441
e03c29a7 442A new dialog box will open with a list of supplementary files, grouped under the trace or experiment they belong to. Select the file(s) to delete from the list and press '''OK'''. The traces and experiments that need to be closed in order to do this operation will automatically be closed.
ff25eb47
BH
443
444[[Image:images/DeleteSupplementaryFilesDialog.png]]
445
15330a02
BH
446=== Link with Editor ===
447
448The tracing projects support the feature '''Link With Editor''' of the Project Explorer view. With this feature it is now possible to<br/>
43b509ac
MAL
449* select a trace element in the Project Explorer view and the corresponding [[#Events Editor | Events Editor]] will get focus if the relevant trace is open.
450* select an [[#Events Editor | Events Editor]] and the corresponding trace element will be highlighted in the Project Explorer view.
15330a02
BH
451
452To enable or disable this feature toggle the '''Link With Editor''' button of the Project Explorer view as shown below.
453
454[[Image:images/TMF_LinkWithEditor.png]]
455
07ed89d6 456== Events Editor ==
ff25eb47 457
07ed89d6 458The Events editor shows the basic trace data elements (events) in a tabular format. The editors can be dragged in the editor area so that several traces may be shown side by side. These traces are synchronized by timestamp.
ff25eb47 459
07ed89d6 460[[Image:images/LTTng2EventsEditor.png]]
ff25eb47 461
43d4f823 462The header displays the current trace (or experiment) name.
ff25eb47 463
43d4f823 464Being part of the '''Tracing and Monitoring''' Framework, the default table displays the following fields:
ff25eb47
BH
465
466* '''Timestamp''': the event timestamp
467* '''Source''': the source of the event
468* '''Type''': the event type and localization
469* '''Reference''' the event reference
43d4f823 470* '''Content''': the raw event content
ff25eb47
BH
471
472The first row of the table is the header row a.k.a. the Search and Filter row.
473
07ed89d6
MK
474The highlighted event is the ''current event'' and is synchronized with the other views. If you select another event, the other views will be updated accordingly. The properties view will display a more detailed view of the selected event.
475
32adc12c
PT
476An event range can be selected by holding the '''Shift''' key while clicking another event or using any of the cursor keys ('''Up'''', '''Down''', '''PageUp''', '''PageDown''', '''Home''', '''End'''). The first and last events in the selection will be used to determine the current selected time range for synchronization with the other views.
477
07ed89d6 478[[Image:images/LTTng2EventProperties.png]]
ff25eb47 479
07ed89d6 480The Events editor can be closed, disposing a trace. When this is done, all the views displaying the information will be updated with the trace data of the next event editor tab. If all the editor tabs are closed, then the views will display their empty states.
ff25eb47
BH
481
482=== Searching and Filtering ===
483
484Searching and filtering of events in the table can be performed by entering matching conditions in one or multiple columns in the header row (the first row below the column header).
485
486To toggle between searching and filtering, click on the 'search' ([[Image:images/TmfEventSearch.gif]]) or 'filter' ([[Image:images/TmfEventFilter.gif]]) icon in the header row's left margin, or right-click on the header row and select '''Show Filter Bar''' or '''Show Search Bar''' in the context menu.
487
488To apply a matching condition to a specific column, click on the column's header row cell, type in a [http://download.oracle.com/javase/7/docs/api/java/util/regex/Pattern.html regular expression] and press the '''ENTER''' key. You can also enter a simple text string and it will be automatically be replaced with a 'contains' regular expression.
489
490When matching conditions are applied to two or more columns, all conditions must be met for the event to match (i.e. 'and' behavior).
491
492To clear all matching conditions in the header row, press the '''DEL''' key.
493
494==== Searching ====
495
496When a searching condition is applied to the header row, the table will select the next matching event starting from the top currently displayed event. Wrapping will occur if there is no match until the end of the trace.
497
498All matching events will have a 'search match' icon in their left margin. Non-matching events will be dimmed.
499
500[[Image:images/DefaultTmfEvents-Search.png]]
501
502Pressing the '''ENTER''' key will search and select the next matching event. Pressing the '''SHIFT-ENTER''' key will search and select the previous matching event. Wrapping will occur in both directions.
503
504Press '''ESC''' to cancel an ongoing search.
505
506Press '''DEL''' to clear the header row and reset all events to normal.
507
508==== Filtering ====
509
510When a filtering condition is entered in the head row, the table will clear all events and fill itself with matching events as they are found from the beginning of the trace.
511
512A status row will be displayed before and after the matching events, dynamically showing how many matching events were found and how many events were processed so far. Once the filtering is completed, the status row icon in the left margin will change from a 'stop' to a 'filter' icon.
513
514[[Image:images/DefaultTmfEvents-Filter.png]]
515
516Press '''ESC''' to stop an ongoing filtering. In this case the status row icon will remain as a 'stop' icon to indicate that not all events were processed.
517
518Press '''DEL''' or right-click on the table and select '''Clear Filters''' from the context menu to clear the header row and remove the filtering. All trace events will be now shown in the table. Note that the currently selected event will remain selected even after the filter is removed.
519
520You can also search on the subset of filtered events by toggling the header row to the Search Bar while a filter is applied. Searching and filtering conditions are independent of each other.
521
522==== Bookmarking ====
523
524Any event of interest can be tagged with a bookmark.
525
526To add a bookmark, double-click the left margin next to an event, or right-click the margin and select '''Add bookmark...'''. Alternatively use the '''Edit''' > '''Add bookmark...''' menu. Edit the bookmark description as desired and press '''OK'''.
527
528The bookmark will be displayed in the left margin, and hovering the mouse over the bookmark icon will display the description in a tooltip.
529
530The bookmark will be added to the '''Bookmarks''' view. In this view the bookmark description can be edited, and the bookmark can be deleted. Double-clicking the bookmark or selecting '''Go to''' from its context menu will open the trace or experiment and go directly to the event that was bookmarked.
531
532To remove a bookmark, double-click its icon, select '''Remove Bookmark''' from the left margin context menu, or select '''Delete''' from the Bookmarks view.
533
534[[Image:images/Bookmarks.png]]
535
c2a48401
PT
536=== Event Source Lookup ===
537
538For CTF traces using specification v1.8.2 or above, information can optionally be embedded in the trace to indicate the source of a trace event. This is accessed through the event context menu by right-clicking on an event in the table.
539
029df6e3 540==== Source Code ====
c2a48401 541
029df6e3 542If a source file is available in the trace for the selected event, the item '''Open Source Code''' is shown in the context menu. Selecting this menu item will attempt to find the source file in all opened projects in the workspace. If multiple candidates exist, a selection dialog will be shown to the user. The selected source file will be opened, at the correct line, in its default language editor. If no candidate is found, an error dialog is shown displaying the source code information.
c2a48401
PT
543
544==== EMF Model ====
545
546If an EMF model URI is available in the trace for the selected event, the item '''Open Model Element''' is shown in the context menu. Selecting this menu item will attempt to open the model file in the project specified in the URI. The model file will be opened in its default model editor. If the model file is not found, an error dialog is shown displaying the URI information.
547
312094ed 548=== Exporting To Text ===
43b509ac 549It is possible to export the content of the trace to a text file based on the columns displayed in the events table. If a filter (see '''[[#Filtering| Filtering]]''') was defined prior exporting only events that match the filter will be exported to the file. To export the trace to text, press the right mouse button on the events table. A context-sensitive menu will show. Select the '''Export To Text...''' menu option. A file locater dialog will open. Fill in the file name and location and then press on '''OK'''. A window with a progress bar will open till the export is finished.
312094ed 550
e03c29a7 551''Note'': The columns in the text file are separated by tabs.
312094ed 552
7e802456
BH
553=== Collapsing of Repetitive Events ===
554The implementation for collapsing of repetitive events is trace type specific and is only available for certain trace types. For example, a trace type could allow collapsing of consecutive events that have the same event content but not the same timestamp. If a trace type supports this feature then it is possible to select the '''Collapse Events''' menu item after pressing the right mouse button in the table.
555
556When the collapsing of events is executing, the table will clear all events and fill itself with all relevant events. If the collapse condition is met, the first column of the table will show the number of times this event was repeated consecutively.
557
558[[Image:images/TablePreCollapse.png]]
559
560A status row will be displayed before and after the events, dynamically showing how many non-collapsed events were found and how many events were processed so far. Once the collapsing is completed, the status row icon in the left margin will change from a 'stop' to a 'filter' icon.
561
562[[Image:images/TablePostCollapse.png]]
563
564To clear collapsing, press the right mouse button in the table and select menu item '''Clear Filters''' in the context sensitive menu. ''Note'' that collapsing is also removed when another filter is applied to the table.
565
ff25eb47
BH
566== Histogram View ==
567
568The Histogram View displays the trace events distribution with respect to time. When streaming a trace, this view is dynamically updated as the events are received.
569
ff25eb47
BH
570[[Image:images/HistogramView.png]]
571
95aa81ef 572The '''Hide Lost Events''' toggle button [[Image:images/hide_lost_events.gif]] in the local toolbar allows to hide the bars of lost events. When the button is selected it can be toggled again to show the lost events.
ff25eb47 573
cb3dce47
XR
574The '''Activate Trace Coloring''' toggle button [[Image:images/show_hist_traces.gif]] in the local toolbar allows to use separate colors for each trace of an experiment. Note that this feature is not available if your experiment contains more than twenty two traces. When activated, a legend is displayed at the bottom on the histogram view.
575
1fdff3c5
PT
576On the top left, there are three text controls:
577
578* '''Selection Start''': Displays the start time of the current selection
579* '''Selection End''': Displays the end time of the current selection
580* '''Window Span''': Displays the current zoom window size in seconds
581
582The controls can be used to modify their respective value. After validation, the other controls and views will be synchronized and updated accordingly. To modify both selection times simultaneously, press the link icon [[Image:images/link.gif]] which disables the '''Selection End''' control input.
583
584The large (full) histogram, at the bottom, shows the event distribution over the whole trace or set of traces. It also has a smaller semi-transparent orange window, with a cross-hair, that shows the current zoom window.
585
586The smaller (zoom) histogram, on top right, corresponds to the current zoom window, a sub-range of the event set.
587
588The x-axis of each histogram corresponds to the event timestamps. The start time and end time of the histogram range is displayed. The y-axis shows the maximum number of events in the corresponding histogram bars.
ff25eb47 589
1fdff3c5 590The vertical blue line(s) show the current selection time (or range). If applicable, the region in the selection range will be shaded.
ff25eb47 591
1fdff3c5 592The mouse can be used to control the histogram:
ff25eb47 593
1fdff3c5
PT
594* '''Left-click''': Set a selection time
595* '''Left-drag''': Set a selection range
596* '''Shift-left-click or drag''': Extend or shrink the selection range
ff25eb47 597
1fdff3c5
PT
598* '''Middle-click or Ctrl-left-click''': Center the zoom window on mouse (full histogram only)
599* '''Middle-drag or Ctrl-left-drag''': Move the zoom window
ff25eb47 600
1fdff3c5
PT
601* '''Right-drag''': Set the zoom window
602* '''Shift-right-click or drag''': Extend or shrink the zoom window (full histogram only)
ff25eb47 603
1fdff3c5
PT
604* '''Mouse wheel up''': Zoom in
605* '''Mouse wheel down''': Zoom out
ff25eb47 606
1fdff3c5 607Hovering the mouse over an histogram bar pops up an information window that displays the start/end time of the corresponding bar, as well as the number of events (and lost events) it represents. If the mouse is over the selection range, the selection span in seconds is displayed.
ff25eb47
BH
608
609In each histogram, the following keys are handled:
610
1fdff3c5
PT
611* '''Left Arrow''': Moves the current event to the previous non-empty bar
612* '''Right Arrow''': Moves the current event to the next non-empty bar
613* '''Home''': Sets the current time to the first non-empty bar
32adc12c 614* '''End''': Sets the current time to the last non-empty histogram bar
ba1f5c20
PT
615* '''Plus (+)''': Zoom in
616* '''Minus (-)''': Zoom out
ff25eb47
BH
617
618== Statistics View ==
619
00421e5e 620The Statistics View displays the various event counters that are collected when analyzing a trace. The data is organized per trace. After opening a trace, the element '''Statistics''' is added under the '''Tmf Statistics Analysis''' tree element in the Project Explorer. To open the view, double-click the '''Statistics''' tree element. Alternatively, select '''Statistics''' under '''Tracing''' within the '''Show View''' window ('''Window''' -> '''Show View''' -> '''Other...'''). This view shows 3 columns: ''Level'' ''Events total'' and ''Events in selected time range''. After parsing a trace the view will display the number of events per event type in the second column and in the third, the currently selected time range's event type distribution is shown. The cells where the number of events are printed also contain a colored bar with a number that indicates the percentage of the event count in relation to the total number of events. The statistics is collected for the whole trace. This view is part of the '''Tracing and Monitoring Framework (TMF)''' and is generic. It will work for any trace type extensions. For the LTTng 2.0 integration the Statistics view will display statistics as shown below.:
ff25eb47
BH
621
622[[Image:images/LTTng2StatisticsView.png]]
623
07ed89d6
MK
624By default, the statistics use a state system, therefore will load very quickly once the state system is written to the disk as a supplementary file.
625
ff25eb47
BH
626== Colors View ==
627
628[[Image:images/ColorsView.png]]
629
630The Colors view allows the user to define a prioritized list of color settings.
631
632A color setting associates a foreground and background color (used in any events table), and a tick color (used in the Time Chart view), with an event filter.
633
634In an events table, any event row that matches the event filter of a color setting will be displayed with the specified foreground and background colors. If the event matches multiple filters, the color setting with the highest priority will be used.
635
636The same principle applies to the event tick colors in the Time Chart view. If a tick represents many events, the tick color of the highest priority matching event will be used.
637
638Color settings can be inserted, deleted, reordered, imported and exported using the buttons in the Colors view toolbar. Changes to the color settings are applied immediately, and are persisted to disk.
639
640== Filters View ==
641
642[[Image:images/FiltersView.png]]
643
644The Filters view allows the user to define preset filters that can be applied to any events table.
645
646The filters can be more complex than what can be achieved with the filter header row in the events table. The filter is defined in a tree node structure, where the node types can be any of '''EVENTTYPE''', '''AND''', '''OR''', '''CONTAINS''', '''EQUALS''', '''MATCHES''' or '''COMPARE'''. Some nodes types have restrictions on their possible children in the tree.
647
32adc12c 648The '''EVENTTYPE''' node filters against the event type of the trace as defined in a plug-in extension or in a custom parsers. When used, any child node will have its field combo box restricted to the possible fields of that event type.
ff25eb47
BH
649
650The '''AND''' node applies the logical ''and'' condition on all of its children. All children conditions must be true for the filter to match. A ''not'' operator can be applied to invert the condition.
651
652The '''OR''' node applies the logical ''or'' condition on all of its children. At least one children condition must be true for the filter to match. A ''not'' operator can be applied to invert the condition.
653
654The '''CONTAINS''' node matches when the specified event ''field'' value contains the specified ''value'' string. A ''not'' operator can be applied to invert the condition. The condition can be case sensitive or insensitive.
655
656The '''EQUALS''' node matches when the specified event ''field'' value equals exactly the specified ''value'' string. A ''not'' operator can be applied to invert the condition. The condition can be case sensitive or insensitive.
657
658The '''MATCHES''' node matches when the specified event ''field'' value matches against the specified ''regular expression''. A ''not'' operator can be applied to invert the condition.
659
660The '''COMPARE''' node matches when the specified event ''field'' value compared with the specified ''value'' gives the specified ''result''. The result can be set to ''smaller than'', ''equal'' or ''greater than''. The type of comparison can be numerical, alphanumerical or based on time stamp. A ''not'' operator can be applied to invert the condition.
661
f33eb3be 662Filters can be added, deleted, imported and exported using the buttons in the Filters view toolbar. The nodes in the view can be Cut (Ctrl-X), Copied (Ctrl-C) and Pasted (Ctrl-V) by using the buttons in the toolbar or by using the key bindings. This makes it easier to quickly build new filters from existing ones. Changes to the preset filters are only applied and persisted to disk when the '''save filters''' button is pressed.
ff25eb47
BH
663
664To apply a saved preset filter in an events table, right-click on the table and select '''Apply preset filter...''' > ''filter name''.
665
666== Time Chart View ==
667
668[[Image:images/TimeChartView.png]]
669
670The Time Chart view allows the user to visualize every open trace in a common time chart. Each trace is display in its own row and ticks are display for every punctual event. As the user zooms using the mouse wheel or by right-clicking and dragging in the time scale, more detailed event data is computed from the traces.
671
672Time synchronization is enabled between the time chart view and other trace viewers such as the events table.
673
674Color settings defined in the Colors view can be used to change the tick color of events displayed in the Time Chart view.
675
676When a search is applied in the events table, the ticks corresponding to matching events in the Time Chart view are decorated with a marker below the tick.
677
678When a bookmark is applied in the events table, the ticks corresponding to the bookmarked event in the Time Chart view is decorated with a bookmark above the tick.
679
680When a filter is applied in the events table, the non-matching ticks are removed from the Time Chart view.
681
32adc12c 682The Time Chart only supports traces that are opened in an editor. The use of an editor is specified in the plug-in extension for that trace type, or is enabled by default for custom traces.
ff25eb47 683
e8251298
PT
684== State System Explorer View ==
685
686The State System Explorer view allows the user to inspect the state interval values of every attribute of a state system at a particular time.
687
688The view shows a tree of currently selected traces and their registered state system IDs. For each state system the tree structure of attributes is displayed. The attribute name, quark, value, start and end time, and full attribute path are shown for each attribute.
689
32adc12c 690To modify the time of attributes shown in the view, select a different current time in other views that support time synchronization (e.g. event table, histogram view). When a time range is selected, this view uses the begin time.
e8251298 691
43d4f823 692== Custom Parsers ==
ff25eb47
BH
693
694Custom parser wizards allow the user to define their own parsers for text or XML traces. The user defines how the input should be parsed into internal trace events and identifies the event fields that should be created and displayed. Traces created using a custom parser can be correlated with other built-in traces or traces added by plug-in extension.
695
696=== Creating a custom text parser ===
43d4f823 697
ff25eb47 698The '''New Custom Text Parser''' wizard can be used to create a custom parser for text logs. It can be launched several ways:
43d4f823 699
ff25eb47 700* Select '''File''' &gt; '''New''' &gt; '''Other...''' &gt; '''Tracing''' &gt; '''Custom Text Parser'''
e03c29a7 701* Open the '''[[#Managing custom parsers|Manage Custom Parsers]]''' dialog, select the '''Text''' radio button and click the '''New...''' button
ff25eb47
BH
702
703[[Image:images/CustomTextParserInput.png]]
704
705Fill out the first wizard page with the following information:
706
97205e65
PT
707* '''Category:''' Enter a category name for the trace type.
708* '''Trace type:''' Enter a name for the trace type, which is also the name of the custom parser.
ff25eb47 709* '''Time Stamp format:''' Enter the date and time pattern that will be used to output the Time Stamp.<br>
06670771 710Note: information about date and time patterns can be found here: [../reference/api/org/eclipse/linuxtools/tmf/core/timestamp/TmfTimestampFormat.html TmfTimestampFormat]
43d4f823 711
ff25eb47
BH
712Click the '''Add next line''', '''Add child line''' or '''Remove line''' buttons to create a new line of input or delete it. For each line of input, enter the following information:
713
714* '''Regular expression:''' Enter a regular expression that should match the input line in the log, using capturing groups to extract the data.<br>
715Note: information about date and time patterns can be found here: [http://java.sun.com/javase/6/docs/api/java/util/regex/Pattern.html]
716
717* '''Cardinality:''' Enter the minimum and maximum number of lines matching this line's regular expression that must be found in the log. At least the minimum number of lines must be found before the parser will consider the next line. Child lines will always be considered first.
718
719<u>Important note:</u> The custom parsers identify a log entry when the first line's regular expression matches (Root Line n). Each subsequent text line in the log is attempted to be matched against the regular expression of the parser's input lines in the order that they are defined (Line n.*). Only the first matching input line will be used to process the captured data to be stored in the log entry. When a text line matches a Root Line's regular expression, a new log entry is started.
43d4f823 720
ff25eb47
BH
721Click the '''Add group''' or '''Remove group''' buttons to define the data extracted from the capturing groups in the line's regular expression. For each group, enter the following information:
722
723* '''Name combo:''' Select a name for the extracted data:
43d4f823 724** '''Time Stamp''': Select this option to identify the time stamp data. The input's data and time pattern must be entered in the format: text box.
ff25eb47 725** '''Message''': Select this option to identify the main log entry's message. This is usually a group which could have text of greater length.
43d4f823
PT
726** '''Other''': Select this option to identify any non-standard data. The name must be entered in the name: text box.
727
ff25eb47 728* '''Action combo:''' Select the action to be performed on the extracted data:
43d4f823
PT
729** '''Set''': Select this option to overwrite the data for the chosen name when there is a match for this group.
730** '''Append''': Select this option to append to the data with the chosen name, if any, when there is a match for this group.
ff25eb47 731** '''Append with |''' : Select this option to append to the data with the chosen name, if any, when there is a match for this group, using a | separator between matches.
43d4f823 732
ff25eb47 733The '''Preview input''' text box can be used to enter any log data that will be processed against the defined custom parser. When the wizard is invoked from a selected log file resource, this input will be automatically filled with the file contents.
43d4f823 734
ff25eb47 735The '''Preview:''' text field of each capturing group and of the Time Stamp will be filled from the parsed data of the first matching log entry.
43d4f823 736
ff25eb47
BH
737In the '''Preview input''' text box, the matching entries are highlighted with different colors:
738
739* <code><span style="background:#FFFF00">&nbsp;Yellow&nbsp;</span></code> : indicates uncaptured text in a matching line.
740* <code><span style="background:#00FF00">&nbsp;Green&nbsp;&nbsp;</span></code> : indicates a captured group in the matching line's regular expression for which a custom parser group is defined. This data will be stored by the custom parser.
741* <code><span style="background:#FF00FF">&nbsp;Magenta</span></code> : indicates a captured group in the matching line's regular expression for which there is no custom parser group defined. This data will be lost.
742* <code>&nbsp;White&nbsp;&nbsp;</code> : indicates a non-matching line.
743
744The first line of a matching entry is highlighted with darker colors.
43d4f823 745
ff25eb47 746By default only the first matching entry will be highlighted. To highlight all matching entries in the preview input data, click the '''Highlight All''' button. This might take a few seconds to process, depending on the input size.
43d4f823 747
efa5fe79 748Click the '''Next >''' button to go to the second page of the wizard.
43d4f823 749
ff25eb47
BH
750[[Image:images/CustomTextParserOutput.png]]
751
752On this page, the list of default and custom data is shown, along with a preview of the custom parser log table output.
753
754The custom data output can be modified by the following options:
755
756* '''Visibility:''' Select or unselect the checkbox to display the custom data or hide it.
757
758* '''Column order:''' Click '''Move before''' or '''Move after''' to change the display order of custom data.
759
760The table at the bottom of the page shows a preview of the custom parser log table output according to the selected options, using the matching entries of the previous page's '''Preview input''' log data.
43d4f823 761
ff25eb47
BH
762Click the '''Finish''' button to close the wizard and save the custom parser.
763
764=== Creating a custom XML parser ===
765
766The '''New Custom XML Parser''' wizard can be used to create a custom parser for XML logs. It can be launched several ways:
767
768* Select '''File''' &gt; '''New''' &gt; '''Other...''' &gt; '''Tracing''' &gt; '''Custom XML Parser'''
e03c29a7 769* Open the '''[[#Managing custom parsers|Manage Custom Parsers]]''' dialog, select the '''XML''' radio button and click the '''New...''' button
ff25eb47
BH
770
771[[Image:images/CustomXMLParserInput.png]]
772
773Fill out the first wizard page with the following information:
774
97205e65
PT
775* '''Category:''' Enter a category name for the trace type.
776* '''Trace type:''' Enter a name for the trace type, which is also the name of the custom parser.
ff25eb47
BH
777* '''Time Stamp format:''' Enter the date and time pattern that will be used to output the Time Stamp.<br>
778
78c692ba 779Note: information about date and time patterns can be found here: [../reference/api/org/eclipse/linuxtools/tmf/core/timestamp/TmfTimestampFormat.html TmfTimestampFormat]
ff25eb47
BH
780
781Click the '''Add document element''' button to create a new document element and enter a name for the root-level document element of the XML file.
782
783Click the '''Add child''' button to create a new element of input to the document element or any other element. For each element, enter the following information:
784
785* '''Element name:''' Enter a name for the element that must match an element of the XML file.
786* '''Log entry:''' Select this checkbox to identify an element which represents a log entry. Each element with this name in the XML file will be parsed to a new log entry. At least one log entry element must be identified in the XML document. Log entry elements cannot be nested.
787* '''Name combo:''' Select a name for the extracted data:
43d4f823 788** '''Ignore''': Select this option to ignore the extracted element's data at this level. It is still possible to extract data from this element's child elements.
ff25eb47 789** '''Time Stamp''': Select this option to identify the time stamp data. The input's data and time pattern must be entered in the format: text box.
43d4f823
PT
790** '''Message''': Select this option to identify the main log entry's message. This is usually an input which could have text of greater length.
791** '''Other''': Select this option to identify any non-standard data. The name must be entered in the name: text box. It does not have to match the element name.
ff25eb47 792* '''Action combo:''' Select the action to be performed on the extracted data:
43d4f823
PT
793** '''Set''': Select this option to overwrite the data for the chosen name when there is a match for this element.
794** '''Append''': Select this option to append to the data with the chosen name, if any, when there is a match for this element.
795** '''Append with |''' : Select this option to append to the data with the chosen name, if any, when there is a match for this element, using a | separator between matches.
ff25eb47
BH
796
797Note: An element's extracted data 'value' is a parsed string representation of all its attributes, children elements and their own values. To extract more specific information from an element, ignore its data value and extract the data from one or many of its attributes and children elements.
798
799Click the '''Add attribute''' button to create a new attribute input from the document element or any other element. For each attribute, enter the following information:
800
801* '''Attribute name:''' Enter a name for the attribute that must match an attribute of this element in the XML file.
802* '''Name combo:''' Select a name for the extracted data:
803** '''Time Stamp''': Select this option to identify the time stamp data. The input's data and time pattern must be entered in the format: text box.
43d4f823
PT
804** '''Message''': Select this option to identify the main log entry's message. This is usually an input which could have text of greater length.
805** '''Other''': Select this option to identify any non-standard data. The name must be entered in the name: text box. It does not have to match the element name.
ff25eb47 806* '''Action combo:''' Select the action to be performed on the extracted data:
43d4f823
PT
807** '''Set''': Select this option to overwrite the data for the chosen name when there is a match for this element.
808** '''Append''': Select this option to append to the data with the chosen name, if any, when there is a match for this element.
809** '''Append with |''' : Select this option to append to the data with the chosen name, if any, when there is a match for this element, using a | separator between matches.
ff25eb47
BH
810
811Note: A log entry can inherited input data from its parent elements if the data is extracted at a higher level.
812
813Click the '''Feeling lucky''' button to automatically and recursively create child elements and attributes for the current element, according to the XML element data found in the '''Preview input''' text box, if any.
814
815Click the '''Remove element''' or '''Remove attribute''' buttons to remove the extraction of this input data. Take note that all children elements and attributes are also removed.
816
817The '''Preview input''' text box can be used to enter any XML log data that will be processed against the defined custom parser. When the wizard is invoked from a selected log file resource, this input will be automatically filled with the file contents.
818
819The '''Preview:''' text field of each capturing element and attribute and of the Time Stamp will be filled from the parsed data of the first matching log entry. Also, when creating a new child element or attribute, its element or attribute name will be suggested if possible from the preview input data.
820
efa5fe79 821Click the '''Next >''' button to go to the second page of the wizard.
ff25eb47
BH
822
823[[Image:images/CustomXMLParserOutput.png]]
824
825On this page, the list of default and custom data is shown, along with a preview of the custom parser log table output.
826
827The custom data output can be modified by the following options:
828
829* '''Visibility:''' Select or unselect the checkbox to display the custom data or hide it.
830* '''Column order:''' Click '''Move before''' or '''Move before''' to change the display order of custom data.
831
832The table at the bottom of the page shows a preview of the custom parser log table output according to the selected options, using the matching entries of the previous page's '''Preview input''' log data.
833
834Click the '''Finish''' button to close the wizard and save the custom parser.
835
836=== Managing custom parsers ===
837
838The '''Manage Custom Parsers''' dialog is used to manage the list of custom parsers used by the tool. To open the dialog:
839
43d4f823
PT
840* Open the '''Project Explorer''' view.
841* Select '''Manage Custom Parsers...''' from the '''Traces''' folder context menu, or from a trace's '''Select Trace Type...''' context sub-menu.
ff25eb47
BH
842
843[[Image:images/ManageCustomParsers.png]]
43d4f823 844
ff25eb47 845The ordered list of currently defined custom parsers for the selected type is displayed on the left side of the dialog.
43d4f823 846
ff25eb47 847To change the type of custom parser to manage, select the '''Text''' or '''XML''' radio button.
43d4f823 848
ff25eb47
BH
849The following actions can be performed from this dialog:
850
851* New...
43d4f823 852
ff25eb47 853Click the '''New...''' button to launch the '''New Custom Parser''' wizard.
43d4f823 854
ff25eb47 855* Edit...
43d4f823 856
ff25eb47 857Select a custom parser from the list and click the '''Edit...''' button to launch the '''Edit Custom Parser''' wizard.
43d4f823 858
ff25eb47 859* Delete
43d4f823 860
ff25eb47
BH
861Select a custom parser from the list and click the '''Delete''' button to remove the custom parser.
862
863* Import...
43d4f823 864
97205e65 865Click the '''Import...''' button and select a file from the opened file dialog to import all its custom parsers. If any parser conflicts with an existing built-in or custom trace type, the user will be prompted to skip or rename the imported parser.
43d4f823 866
ff25eb47 867* Export...
43d4f823 868
ff25eb47
BH
869Select a custom parser from the list, click the '''Export...''' button and enter or select a file in the opened file dialog to export the custom parser. Note that if an existing file containing custom parsers is selected, the custom parser will be appended to the file.
870
871=== Opening a trace using a custom parser ===
872
e03c29a7 873Once a custom parser has been created, any [[#Importing Traces to the Project|imported trace]] file can be opened and parsed using it.
ff25eb47
BH
874
875To do so:
43d4f823 876
ff25eb47 877* Select a trace in the '''Project Explorer''' view
97205e65 878* Right-click the trace and select '''Select Trace Type...''' &gt; ''category name'' &gt; ''parser name''
ff25eb47
BH
879* Double-click the trace or right-click it and select '''Open'''
880
881The trace will be opened in an editor showing the events table, and an entry will be added for it in the Time Chart view.
882
e5b63e7d 883= LTTng Tracer Control =
ff25eb47 884
43d4f823 885The LTTng Tracer Control in Eclipse for the LTTng Tracer toolchain version v2.0 (or later) is done using SSH and requires an SSH server to be running on the remote host. For the SSH connection the SSH implementation of RSE is used. For that a new System Type was defined using the corresponding RSE extension. The functions to control the LTTng tracer (e.g. start and stop), either locally or remotely, are available from a dedicated Control View.
ff25eb47 886
43b509ac 887In the following sections the LTTng 2.0 tracer control integration in Eclipse is described. Please refer to the LTTng 2.0 tracer control command line manual for more details and descriptions about all commands and their command line parameters [[#References | References]].
ff25eb47 888
e5b63e7d 889== Control View ==
43d4f823 890To open the Control View, select '''Window->Show View->Other...->LTTng->Control View''.
ff25eb47
BH
891
892[[Image:images/LTTngControlView.png]]
893
e5b63e7d 894=== Creating a New Connection to a Remote Host ===
ff25eb47
BH
895
896To connect to a remote host, select the '''New Connection''' button in the Control View.
897
898[[Image:images/LTTngControlViewConnect.png]]
899
43d4f823 900A new display will show for entering the remote host information. A drop down menu will filled with all existing host information which were used before. To enter the host information either select one of the hosts in the drop down menu or enter the host information manually.
ff25eb47
BH
901
902[[Image:images/LTTng2NewConnection.png]]
903
904To use an existing connection definition, select the relevant entry in the drop-down menu and then select '''Ok'''.
905
906[[Image:images/LTTng2SelectConnection.png]]
907
00de7b32 908To enter the host information manually select first the button '''Edit connection information'''. Then the text fields '''Connection Name''', '''Host Name''' and '''Port Number''' will be enabled. The '''Host Name''' holds the IP address or DNS name of the remote system. The '''Connection Name''' is the alias name to be displayed in the Control View. The '''Port Number''' is the port number to be used for the IP connection. This parameter is optional and if it is omitted the default port will be used. Enter the relevant information and then select '''Ok'''.
43d4f823 909
ff25eb47
BH
910[[Image:images/LTTng2EditConnection.png]]
911
912A new display will show for providing the user name and password. This display only opens if no password had been saved before. Enter user name and password in the '''Enter Password''' dialog box and select '''Ok'''.
913
ff25eb47
BH
914[[Image:images/LTTng2EnterPassword.png]]
915
916After pressing '''Ok''' the SSH connection will be established and after successful login the Control View implementation retrieves the LTTng Tracer Control information. This information will be displayed in the Control View in form of a tree structure.
917
918[[Image:images/LTTng2ControlViewFilled.png]]
919
920The top level tree node is the representation of the remote connection (host). The connection name of the connection will be displayed. Depending on the connection state different icons are displayed. If the node is '''CONNECTED''' the icon is shown [[Image:images/Target_connected.gif]], otherwise (states '''CONNECTING''', '''DISCONNNECTING''' or '''DISCONNECTED''' the icon is [[Image:images/Target_disconnected.gif]].
921
43d4f823 922Under the host level two folder groups are located. The first one is the '''Provider''' group. The second one is the '''Sessions''' group.
ff25eb47 923
43d4f823 924Under the '''Provider''' group all trace providers are displayed. Trace providers are '''Kernel''' and any user space application that supports UST tracing. Under each provider a corresponding list of events are displayed.
ff25eb47 925
43d4f823 926Under the '''Sessions''' group all current sessions will be shown. The level under the sessions show the configured domains. Currently the LTTng 2.0 Tracer Toolchan supports domain '''Kernel''' and '''UST global'''. Under each domain the configured channels will be displayed. The last level is under the channels where the configured events are displayed.
ff25eb47
BH
927
928Each session can be '''ACTIVE''' or '''INACTIVE'''. Active means that tracing has been started, inactive means that the tracing has been stopped. Depending on the state of a session a different icon is displayed. The icon for an active session is [[Image:images/Session_active.gif]]. The icon for an inactive session is [[Image:images/Session_inactive.gif]].
929
930Each channel can be '''ENABLED''' or '''DISABLED'''. An enabled channel means that all configured events of that channel will be traced and a disabled channel won't trace any of its configured events. Different icons are displayed depending on the state of the channel. The icon for an enabled channel is [[Image:images/Channel.gif]] and the icon for a disabled channel is [[Image:images/Channel_disabled.gif]].
931
932Events within a channel can be in state '''ENABLED''' or '''DISABLED'''. Enabled events are stored in the trace when passed during program execution. Disabled events on the other hand won't be traced. Depending on the state of the event the icons for the event is different. An enabled event has the icon [[Image:images/Event_enabled.gif]] and a disabled event the icon [[Image:images/Event_disabled.gif]].
933
e5b63e7d 934=== Disconnecting from a Remote Host ===
ff25eb47 935
43d4f823
PT
936To disconnect from a remote host, select the host in the Control View and press the '''Disconnect''' button. Alternatively, press the right mouse button. A context-sensitive menu will show. Select the '''Disconnect''' button.
937
ff25eb47
BH
938[[Image:images/LTTng2ControlViewDisconnect.png]]
939
e5b63e7d 940=== Connecting to a Remote Host ===
ff25eb47 941
43b509ac 942To connect to a remote host, select the host in the Control View and press the '''Connect''' button. Alternatively, press the right mouse button. A context-sensitive menu will show. Select the '''Connect''' button. This will start the connection process as discribed in [[#Creating a New Connection to a Remote Host | Creating a New Connection to a Remote Host]].
ff25eb47
BH
943
944[[Image:images/LTTng2ControlViewConnect.png]]
945
e5b63e7d 946=== Deleting to a Remote Host Connection ===
ff25eb47 947
07ed89d6 948To delete a remote host connection, select the host in the Control View and press the '''Delete''' button. Alternatively, press the right mouse button. A context-sensitive menu will show. Select the '''Delete''' button. For that command to be active the connection state has to be '''DISCONNECTED''' and the trace has to be closed.
ff25eb47
BH
949
950[[Image:images/LTTng2ControlViewDelete.png]]
951
e5b63e7d 952=== Creating a Tracing Session ===
ff25eb47
BH
953To create a tracing session, select the tree node '''Sessions''' and press the right mouse button. Then select the '''Create Session...''' button of the context-sensitive menu.
954
955[[Image:images/LTTng2CreateSessionAction.png]]
956
43d4f823 957A dialog box will open for entering information about the session to be created.
ff25eb47
BH
958
959[[Image:images/LTTng2CreateSessionDialog.png]]
960
961Fill in the '''Session Name''' and optionally the '''Session Path''' and press '''Ok'''. Upon successful operation a new session will be created and added under the tree node '''Sessions'''.
962
e5b63e7d 963=== Creating a Tracing Session With Advanced Options ===
52e76353
BH
964LTTng Tools version v2.1.0 introduces the possibility to configure the trace output location at session creation time. The trace can be stored in the (tracer) local file system or can be transferred over the network.
965
43b509ac 966To create a tracing session and configure the trace output, open the trace session dialog as described in chapter [[#Creating a Tracing Session | Creating a Tracing Session]]. A dialog box will open for entering information about the session to be created.
52e76353
BH
967
968[[Image:images/LTTng2CreateSessionDialog_Advanced.png]]
969
970The button '''Advanced >>>''' will only show if the remote host has LTTng Tools v2.1.0 installed. To configure the trace output select the '''Advanced >>>''' button. The Dialog box will be shown new fields to configure the trace output location.
971
972[[Image:images/LTTng2CreateSessionDialog_TracePath.png]]
973
974By default, the button '''Use same protocol and address for data and control''' is selected which allows to configure the same '''Protocol''' and '''Address''' for both data URL and control URL.
975
976If button '''Use same protocol and address for data and control''' is selected the '''Protocol''' can be '''net''' for the default network protocol which is TCP (IPv4), '''net6''' for the default network protocol which is TCP (IPv6) and '''file''' for the local file system. For '''net''' and '''net6''' the port can be configured. Enter a value in '''Port''' for data and control URL or keep them empty for the default port to be used. Using '''file''' as protocol no port can be configured and the text fields are disabled.
977
978If button '''Use same protocol and address for data and control''' is not selected the '''Protocol''' can be '''net''' for the default network protocol which is TCP (IPv4), '''net6''' for the default network protocol which is TCP (IPv6), '''tcp''' for the network protocol TCP (IPv4) and '''tcp6''' for the network protocol TCP (IPv6). Note that for '''net''' and '''net6''' always the default port is used and hence the port text fields are disabled. To configure non-default ports use '''tcp''' or '''tcp6'''.
979
43b509ac 980The text field '''Trace Path''' allows for specifying the path relative to the location defined by the '''relayd''' or relative to the location specified by the '''Address''' when using protocol '''file'''. For more information about the '''relayd''' see '''LTTng relayd User Manual''' in chapter [[#References | References]].
52e76353
BH
981
982To create a session with advanced options, fill in the relevant parameters and press '''Ok'''. Upon successful operation a new session will be created and added under the tree node '''Sessions'''.
983
e5b63e7d 984=== Creating a Snapshot Tracing Session ===
43b509ac 985LTTng Tools version v2.3.0 introduces the possibility to create snapshot tracing sessions. After starting tracing the trace events are not stored on disk or over the network. They are only transfered to disk or over the network when the user records a snapshot. To create such a snapshot session, open the trace session dialog as described in chapter [[#Creating a Tracing Session | Creating a Tracing Session]].
589d0d33
BH
986
987[[Image:images/LTTng2CreateSessionDialog_Snapshot.png]]
988
81d5dc3a 989Fill in all necessary information, select the radio button for '''Snapshot Mode''' and press '''Ok'''. By default, the location for the snapshot output will be on the host where the host is located.
589d0d33 990
43b509ac 991Refer to chapter [[#Recording a Snapshot | Recording a Snapshot]] for how to create a snapshot.
589d0d33 992
81d5dc3a
MAL
993=== Creating a Live Tracing Session ====
994LTTng Tools version v2.4.0 introduces the possibility to create live tracing sessions. The live mode allows you to stream the trace and view it while it's being recorded. To create such a live session, open the trace session dialog as described in chapter [[#Creating a Tracing Session | Creating a Tracing Session]].
995
996[[Image:images/LTTng2CreateSessionDialog_Live.png]]
997
998In the advanced options, it is possible to set the '''Live Delay'''. The '''Live Delay''' is the delay in micro seconds before the data is flushed and streamed.
999
1000[[Image:images/LTTng2CreateSessionDialog_Live_Advanced.png]]
1001
1002Fill in all necessary information, select the radio button for '''Live Mode''' and press '''Ok'''.
1003
e5b63e7d 1004=== Enabling Channels - General ===
ff25eb47 1005
43d4f823 1006Enabling channels can be done using a session tree node when the domain hasn't be created in the session or, alternatively on a domain tree node of a session in case the domain is already available.
ff25eb47 1007
e5b63e7d 1008=== Enabling Channels On Session Level ===
ff25eb47 1009
43d4f823 1010To enable a channel, select the tree node of the relevant session and press the right mouse button. Then select the '''Enable Channel...''' button of the context-sensitive menu.
ff25eb47
BH
1011
1012[[Image:images/LTTng2CreateChannelAction.png]]
1013
1014A dialog box will open for entering information about the channel to be created.
1015
1016[[Image:images/LTTng2CreateChannelDialog.png]]
1017
e799e5f3 1018By default the domain '''Kernel''' is selected. To create a UST channel, select '''UST''' under the domain section. The label <Default> in any text box indicates that the default value of the tracer will be configured. To initialize the dialog box press button '''Default'''.
43d4f823 1019
ff25eb47
BH
1020If required update the following channel information and then press '''Ok'''.
1021
43d4f823 1022* '''Channel Name''': The name of the channel.
ff25eb47 1023* '''Sub Buffer size''': The size of the sub-buffers of the channel (in bytes).
83051fc3 1024* '''Number of Sub Buffers''': The number of sub-buffers of the channel.
ff25eb47 1025* '''Switch Timer Interval''': The switch timer interval.
83051fc3
BH
1026* '''Read Timer Interval''': The read timer interval.
1027* '''Discard Mode''': '''Overwrite''' events in buffer or '''Discard''' new events when buffer is full.
ff25eb47
BH
1028
1029Upon successful operation, the requested domain will be created under the session tree node as well as the requested channel will be added under the domain. The channel will be '''ENABLED'''.
1030
e5b63e7d 1031=== Configuring Trace File Rotation ===
e799e5f3 1032
83051fc3 1033Since LTTng Tools v2.2.0 it is possible to set the maximum size of trace files and the maximum number of them. These options are located in the same dialog box that is used for enabling channels.
e799e5f3
SD
1034
1035[[Image:images/LTTng2CreateChannelDialogFileRotation.png]]
1036
1037* '''Maximum size of trace files''': The maximum size of trace files
1038* '''Maximum number of trace files''': The maximum number of trace files
1039
e5b63e7d 1040=== Configuring per UID and per PID Buffers (UST only) ===
e799e5f3 1041
83051fc3 1042Since LTTng Tools v2.2.0 it is possible to configure the type of buffers for '''UST''' application. It is now possible to choose between per '''UID''' buffers (per user ID) and per '''PID''' buffers (per process ID) using the dialog box for enabling channels.
e799e5f3
SD
1043
1044[[Image:images/LTTng2CreateChannelDialogPerUIDBuffers.png]]
1045
83051fc3
BH
1046* '''Per PID buffers''': To activate the per PID buffers option for UST channels
1047* '''Per UID buffers''': To activate the per UID buffers option for UST channels
e799e5f3 1048
83051fc3 1049If no buffer type is selected then the default value of the tracer will be configured.
e799e5f3 1050
83051fc3
BH
1051Note that '''Global shared buffers''' is only for kernel channel and is pre-selected when '''Kernel''' is selected in the dalog box.
1052
e5b63e7d 1053=== Configuring Periodical Flush for metadata Channel ===
83051fc3
BH
1054
1055Since LTTng Tools v2.2.0 it is possible to configure periodical flush for the metadata channel. To set this, use the checkbox '''Configure metadata channel''' then fill the switch timer interval.
e799e5f3
SD
1056
1057[[Image:images/LTTng2CreateChannelDialogMetadataFlush.png]]
1058
e5b63e7d 1059=== Enabling Channels On Domain Level ===
ff25eb47
BH
1060
1061Once a domain is available, channels can be enabled directly using the domain. To enable a channel under an existing domain, select the tree node of the relevant domain and press the right mouse button. Then select the '''Enable Channel...''' button of the context-sensitive menu.
1062
1063[[Image:images/LTTng2CreateChannelOnDomainAction.png]]
1064
83051fc3 1065The dialog box for enabling channel will open for entering information about the channel to be created. Note that the domain is pre-selected and cannot be changed. Fill the relevant information and press '''Ok'''.
ff25eb47 1066
e5b63e7d 1067=== Enabling and Disabling Channels ===
ff25eb47 1068
43d4f823 1069To disable one or more enabled channels, select the tree nodes of the relevant channels and press the right mouse button. Then select the '''Disable Channel''' menu item of the context-sensitive menu.
ff25eb47
BH
1070
1071[[Image:images/LTTng2DisableChannelAction.png]]
1072
1073Upon successful operation, the selected channels will be '''DISABLED''' and the icons for the channels will be updated.
1074
1075To enable one or more disabled channels, select the tree nodes of the relevant channels and press the right mouse button. Then select the '''Enable Channel''' menu item of the context-sensitive menu.
1076
1077[[Image:images/LTTng2EnableChannelAction.png]]
1078
1079Upon successful operation, the selected channels will be '''ENABLED''' and the icons for the channels will be updated.
1080
e5b63e7d 1081=== Enabling Events - General ===
ff25eb47 1082
43d4f823 1083Enabling events can be done using different levels in the tree node. It can be done on the session, domain level and channel level. For the case of session or domain, i.e. when no specific channels is assigned then enabling of events is done on the default channel with the name '''channel0''' which created, if not already exists, by the LTTng tracer control on the server side.
ff25eb47 1084
e5b63e7d 1085=== Enabling Kernel Events On Session Level ===
ff25eb47 1086
43d4f823 1087To enable events, select the tree node of the relevant session and press the right mouse button. Then select the '''Enable Event (default channel)...''' button of the context-sensitive menu.
ff25eb47
BH
1088
1089[[Image:images/LTTng2EventOnSessionAction.png]]
1090
1091A dialog box will open for entering information about events to be enabled.
1092
1093[[Image:images/LTTng2EventOnSessionDialog.png]]
1094
1095By default the domain '''Kernel''' is selected and the kernel specific data sections are created. From this dialog box kernel '''Tracepoint''' events, '''System calls (Syscall)''', a '''Dynamic Probe''' or a '''Dynamic Function entry/return''' probe can be enabled. Note that events of one of these types at a time can be enabled.
1096
1097To enable '''Tracepoint''' events, first select the corresponding '''Select''' button, then select either all tracepoins (select '''All''') or select selectively one or more tracepoints in the displayed tree of tracepoints and finally press '''Ok'''.
1098
1099[[Image:images/LTTng2TracepointEventsDialog.png]]
1100
1101Upon successful operation, the domain '''Kernel''' will be created in the tree (if neccessary), the default channel with name "channel0" will be added under the domain (if necessary) as well as all requested events of type '''TRACEPOINT''' under the channel. The channel and events will be '''ENABLED'''.
1102
1103[[Image:images/LTTng2EnabledKernelTracepoints.png]]
1104
43d4f823 1105To enable all '''Syscalls''', select the corresponding '''Select''' button and press '''Ok'''.
ff25eb47 1106
43d4f823 1107[[Image:images/LTTng2SyscallsDialog.png]]
ff25eb47
BH
1108
1109Upon successful operation, the event with the name '''syscalls''' and event type '''SYSCALL''' will be added under the default channel (channel0). If necessary the domain '''Kernel''' and the channel '''channel0''' will be created.
1110
1111[[Image:images/LTTng2EnabledKernelSyscalls.png]]
1112
1113To enable a '''Dynamic Probe''' event, select the corresponding '''Select''' button, fill the '''Event Name''' and '''Probe''' fields and press '''Ok'''. Note that the probe can be an address, symbol or a symbol+offset where the address and offset can be octal (0NNN...), decimal (NNN...) or hexadecimal (0xNNN...).
1114
1115[[Image:images/LTTng2ProbeEventDialog.png]]
1116
1117Upon successful operation, the dynamic probe event with the given name and event type '''PROBE''' will be added under the default channel (channel0). If necessary the domain '''Kernel''' and the channel '''channel0''' will be created.
1118
1119[[Image:images/LTTng2EnabledKernelProbeEvent.png]]
1120
1121To enable a '''Dynamic Function entry/return Probe''' event, select the corresponding '''Select''' button, fill the '''Event Name''' and '''Function''' fields and press '''Ok'''. Note that the funtion probe can be an address, symbol or a symbol+offset where the address and offset can be octal (0NNN...), decimal (NNN...) or hexadecimal (0xNNN...).
1122
1123[[Image:images/LTTng2FunctionEventDialog.png]]
1124
1125Upon successful operation, the dynamic function probe event with the given name and event type '''PROBE''' will be added under the default channel (channel0). If necessary the domain '''Kernel''' and the channel '''channel0''' will be created.
1126
1127[[Image:images/LTTng2EnabledFunctionProbeEvent.png]]
1128
e5b63e7d 1129=== Enabling UST Events On Session Level ===
ff25eb47 1130
43b509ac 1131For enabling UST events, first open the enable events dialog as described in section [[#Enabling Kernel Events On Session Level | Enabling Kernel Events On Session Level]] and select domain '''UST'''.
ff25eb47
BH
1132
1133To enable '''Tracepoint''' events, first select the corresponding '''Select''' button, then select either all tracepoins (select '''All''') or select selectively one or more tracepoints in the displayed tree of tracepoints and finally press '''Ok'''.
1134
1135[[Image:images/LTTng2UstTracepointEventsDialog.png]]
43d4f823
PT
1136
1137Upon successful operation, the domain '''UST global''' will be created in the tree (if neccessary), the default channel with name "channel0" will be added under the domain (if necessary) as well as all requested events under the channel. The channel and events will be '''ENABLED'''. Note that for the case that '''All''' tracepoints were selected the wildcard '''*''' is used which will be shown in the Control View as below.
ff25eb47
BH
1138
1139[[Image:images/LTTng2EnabledAllUstTracepoints.png]]
1140
1141For UST it is possible to enable '''Tracepoint''' events using a wildcard. To enable '''Tracepoint''' events with a wildcard, select first the corresponding '''Select''' button, fill the '''Wildcard''' field and press '''Ok'''.
1142
43d4f823 1143[[Image:images/LTTng2UstWildcardEventsDialog.png]]
ff25eb47
BH
1144
1145Upon successful operation, the event with the given wildcard and event type '''TRACEPOINT''' will be added under the default channel (channel0). If necessary the domain '''UST global''' and the channel '''channel0''' will be created.
1146
1147[[Image:images/LTTng2EnabledUstWildcardEvents.png]]
1148
1149For UST it is possible to enable '''Tracepoint''' events using log levels. To enable '''Tracepoint''' events using log levels, select first the corresponding '''Select''' button, select a log level from the drop down menu, fill in the relevant information (see below) and press '''Ok'''.
1150
43d4f823 1151* '''Event Name''': Name to display
ff25eb47 1152* '''loglevel''': To specify if a range of log levels (0 to selected log level) shall be configured
43d4f823 1153* '''loglevel-only''': To specify that only the specified log level shall be configured
ff25eb47
BH
1154
1155[[Image:images/LTTng2UstLoglevelEventsDialog.png]]
1156
1157Upon successful operation, the event with the given event name and event type '''TRACEPOINT''' will be added under the default channel (channel0). If necessary the domain '''UST global''' and the channel '''channel0''' will be created.
1158
1159[[Image:images/LTTng2EnabledUstLoglevelEvents.png]]
1160
e5b63e7d 1161=== Enabling Events On Domain Level ===
ff25eb47 1162
43d4f823 1163Kernel events can also be enabled on the domain level. For that select the relevant domain tree node, click the right mouse button and the select '''Enable Event (default channel)...'''. A new dialog box will open for providing information about the events to be enabled. Depending on the domain, '''Kernel''' or '''UST global''', the domain specifc fields are shown and the domain selector is preselected and read-only.
ff25eb47
BH
1164
1165[[Image:images/LTTng2EventOnDomainAction.png]]
1166
43b509ac
MAL
1167To enable events for domain '''Kernel''' follow the instructions in section [[#Enabling Kernel Events On Session Level | Enabling Kernel Events On Session Level]], for domain '''UST global''', see section [[#Enabling UST Events On Session Level | Enabling UST Events On Session Level]].
1168The events will be add to the default channel '''channel0'''. This channel will be created by on the server side if neccessary.
ff25eb47 1169
e5b63e7d 1170=== Enabling Events On Channel Level ===
ff25eb47 1171
43b509ac 1172Kernel events can also be enabled on the channel level. If necessary, create a channel as described in sections [[#Enabling Channels On Session Level | Enabling Channels On Session Level]] or [[#Enabling Channels On Domain Level | Enabling Channels On Domain Level]].
ff25eb47 1173
43d4f823 1174Then select the relevant channel tree node, click the right mouse button and the select '''Enable Event...'''. A new dialog box will open for providing information about the events to be enabled. Depending on the domain, '''Kernel''' or '''UST global''', the domain specifc fields are shown and the domain selector is preselected and read-only.
ff25eb47
BH
1175
1176[[Image:images/LTTng2EventOnChannelAction.png]]
1177
43b509ac 1178To enable events for domain '''Kernel''' follow the instructions in section [[#Enabling Kernel Events On Session Level | Enabling Kernel Events On Session Level]], for domain '''UST global''' [[#Enabling UST Events On Session Level | Enabling UST Events On Session Level]].
ff25eb47
BH
1179
1180When enabling events on the channel level, the events will be add to the selected channel.
1181
e5b63e7d 1182=== Enabling and Disabling Events ===
ff25eb47 1183
43d4f823 1184To disable one or more enabled events, select the tree nodes of the relevant events and click the right mouse button. Then select '''Disable Event''' menu item in the context-sensitive menu.
ff25eb47
BH
1185
1186[[Image:images/LTTng2DisableEventAction.png]]
1187
1188Upon successful operation, the selected events will be '''DISABLED''' and the icons for these events will be updated.
1189
1190To enable one or more disabled events, select the tree nodes of the relevant events and press the right mouse button. Then select the '''Enable Event''' menu item of the context-sensitive menu.
1191
1192[[Image:images/LTTng2EnableEventAction.png]]
1193
1194Upon successful operation, the selected events will be '''ENABLED''' and the icons for these events will be updated.
1195
1196'''Note''': There is currently a limitation for kernel event of type '''SYSCALL'''. This kernel event can not be disabled. An error will appear when trying to disable this type of event. A work-around for that is to have the syscall event in a separate channel and disable the channel instead of the event.
1197
e5b63e7d 1198=== Enabling Tracepoint Events From Provider ===
ff25eb47 1199
43b509ac 1200It is possible to enable events of type '''Tracepoint''' directly from the providers and assign the enabled event to a session and channel. Before doing that a session has to be created as described in section [[#Creating a Tracing Session | Creating a Tracing Session]]. Also, if other than default channel '''channel0''' is required, create a channel as described in sections [[#Enabling Channels On Session Level | Enabling Channels On Session Level]] or [[#Enabling Channels On Domain Level | Enabling Channels On Domain Level]].
ff25eb47 1201
43d4f823 1202To assign tracepoint events to a session and channel, select the events to be enabled under the provider (e.g. provider '''Kernel'''), click right mouse button and then select '''Enable Event...''' menu item from the context sensitive menu.
ff25eb47
BH
1203
1204[[Image:images/LTTng2AssignEventAction.png]]
1205
43d4f823
PT
1206A new display will open for defining the session and channel.
1207
ff25eb47
BH
1208[[Image:images/LTTng2AssignEventDialog.png]]
1209
43d4f823 1210Select a session from the '''Session List''' drop-down menu, a channel from the '''Channel List''' drop-down menu and the press '''Ok'''. Upon successful operation, the selected events will be added to the selected session and channel of the domain that the selected provider belongs to. In case that there was no channel available, the domain and the default channel '''channel0''' will be created for corresponding session. The newly added events will be '''ENABLED'''.
ff25eb47
BH
1211
1212[[Image:images/LTTng2AssignedEvents.png]]
1213
e5b63e7d 1214=== Configuring Filter Expression On UST Event Fields ===
52e76353 1215
43b509ac 1216Since LTTng Tools v2.1.0 it is possible to configure a filter expression on UST event fields. To configure a filter expression on UST event fields, open the enable event dialog as described in chapters [[#Enabling UST Events On Session Level | Enabling UST Events On Session Level]], [[#Enabling Events On Domain Level | Enabling Events On Domain Level]] or [[#Enabling Events On Channel Level | Enabling Events On Channel Level]], select UST if needed, select the relevant '''Tracepoint''' event(s) and enter the filter expression in the '''Filter Expression''' text field.
52e76353
BH
1217
1218[[Image:images/LTTng2EnableEventWithFilter.png]]
1219
43b509ac 1220Alternatively, open the dialog box for assigning events to a session and channel described in [[#Enabling Tracepoint Events From Provider | Enabling Tracepoint Events From Provider]] (for UST providers) and enter the filter expression in the '''Filter Expression''' text field.
52e76353
BH
1221
1222[[Image:images/LTTng2AssignEventDialogWithFilter.png]]
1223
43b509ac 1224For the syntax of the filter expression refer to the '''LTTng Tracer Control Command Line Tool User Manual''' of chapter [[#References |References]].
52e76353 1225
e5b63e7d 1226=== Adding Contexts to Channels and Events of a Domain ===
ff25eb47
BH
1227
1228It is possible to add contexts to channels and events. Adding contexts on channels and events from the domain level, will enable the specified contexts to all channels of the domain and all their events. To add contexts on the domain level, select a domain, click right mouse button on a domain tree node (e.g. provider '''Kernel''') and select the menu item '''Add Context...''' from the context-sensitive menu.
1229
1230[[Image:images/LTTng2AddContextOnDomainAction.png]]
1231
1232A new display will open for selecting one or more contexts to add.
1233
1234[[Image:images/LTTng2AddContextDialog.png]]
1235
43d4f823 1236The tree shows all available context that can be added. Select one or more context and the press '''Ok'''. Upon successful operation, the selected context will be added to all channels and their events of the selected domain.
ff25eb47
BH
1237
1238'''Note''': The LTTng UST tracer only supports contexts '''procname''', '''pthread_id''', '''vpid''' '''vtid'''. Adding any other contexts in the UST domina will fail.
1239
e5b63e7d 1240=== Adding Contexts to All Events of a Channel ===
ff25eb47 1241
43d4f823 1242Adding contexts on channels and events from the channel level, will enable the specified contexts to all events of the selected channel. To add contexts on the channel level, select a channel, click right mouse button on a channel tree node and select the menu item '''Add Context...''' from the context-sensitive menu.
ff25eb47
BH
1243
1244[[Image:images/LTTng2AddContextOnChannelAction.png]]
1245
43b509ac 1246A new display will open for selecting one or more contexts to add. Select one or more contexts as described in chapter [[#Adding Contexts to Channels and Events of a Domain | Adding Contexts to Channels and Events of a Domain]]. Upon successful operation, the selected context will be added to all channels and their events of the selected domain. '''Note''' that the LTTng 2.0 tracer control on the remote host doesn't provide a way to retrieve added contexts. Hence it's not possible to display the context information in the GUI.
ff25eb47 1247
e5b63e7d 1248=== Adding Contexts to an Event of a Specific Channel ===
ff25eb47 1249
bd9f92a8 1250Adding contexts to an event of a channel is only available in LTTng Tools versions v2.0.0-2.1.x. The menu option won't be visible for LTTng Tools version v2.2.0 or later. To add contexts on an event select an event of a channel, click right mouse button on the corresponding event tree node and select the menu item '''Add Context...''' from the context-sensitive menu.
ff25eb47
BH
1251
1252[[Image:images/LTTng2AddContextToEventsAction.png]]
1253
43b509ac 1254A new display will open for selecting one or more contexts to add. Select one or more contexts as described in chapter [[#Adding Contexts to Channels and Events of a Domain | Adding Contexts to Channels and Events of a Domain]]. Upon successful operation, the selected context will be added to the selected event.
ff25eb47 1255
e5b63e7d 1256=== Start Tracing ===
ff25eb47
BH
1257
1258To start tracing, select one or more sessions to start in the Control View and press the '''Start''' button. Alternatively, press the right mouse button on the session tree nodes. A context-sensitive menu will show. Then select the '''Start''' menu item.
1259
1260[[Image:images/LTTng2StartTracingAction.png]]
1261
43d4f823 1262Upon successful operation, the tracing session will be '''ACTIVE''' and the icon of the session will be updated.
ff25eb47 1263
e5b63e7d 1264=== Recording a Snapshot ===
589d0d33 1265
43b509ac 1266LTTng Tools version v2.3.0 introduces the possibility to create snapshot tracing sessions. After creating a snapshot session (see [[#Creating a Snapshot Tracing Session | Creating a Snapshot Tracing Session]]) and starting tracing (see [[#Start Tracing | Start Tracing]]) it possible to record snapshots. To record a snapshot select one or more sessions and press the '''Record Snapshot''' button. Alternatively, press the right mouse button on the session tree nodes. A context-sensitive menu will show. Then select the '''Recored Snapshot''' menu item.
589d0d33
BH
1267
1268[[Image:images/LTTng2RecordSnapshotAction.png]]
1269
43b509ac 1270This action can be executed many times. It is possible to import the recorded snpshots to a tracing project. The trace session might be '''ACTIVE''' or '''INACTIVE''' for that. Refer to section [[#Importing Session Traces to a Tracing Project | Importing Session Traces to a Tracing Project]] on how to import a trace to a tracing project.
589d0d33 1271
e5b63e7d 1272=== Stop Tracing ===
ff25eb47 1273
589d0d33 1274To stop tracing, select one or more sessions to stop in the Control View and press the '''Stop''' button. Alternatively, click the right mouse button on the session tree node. A context-sensitive menu will show. Then select the '''Stop''' menu item.
ff25eb47
BH
1275
1276[[Image:images/LTTng2StopTracingAction.png]]
1277
1278Upon successful operation, the tracing session will be '''INACTIVE''' and the icon of the session will be updated.
1279
e5b63e7d 1280=== Destroying a Tracing Session ===
ff25eb47 1281
43d4f823 1282To destroy a tracing session, select one or more sessions to destroy in the Control View and press the '''Destroy''' button. Alternatively, click the right mouse button on the session tree node. A context-sensitive menu will show. Then select the '''Destroy...''' menu item. Note that the session has to be '''INACTIVE''' for this operation.
ff25eb47
BH
1283
1284[[Image:images/LTTng2DestroySessionAction.png]]
1285
43d4f823 1286A confirmation dialog box will open. Click on '''Ok''' to destroy the session otherwise click on '''Cancel'''.
ff25eb47
BH
1287
1288[[Image:images/LTTng2DestroyConfirmationDialog.png]]
1289
1290Upon successful operation, the tracing session will be destroyed and removed from the tree.
1291
e5b63e7d 1292=== Refreshing the Node Information ===
ff25eb47 1293
43d4f823 1294To refresh the remote host information, select any node in the tree of the Control View and press the '''Refresh''' button. Alternatively, click the right mouse button on any tree node. A context-sensitive menu will show. Then select the '''Refresh''' menu item.
ff25eb47
BH
1295
1296[[Image:images/LTTng2RefreshAction.png]]
1297
1298Upon successful operation, the tree in the Control View will be refreshed with the remote host configuration.
1299
e5b63e7d 1300=== Quantifing LTTng overhead (Calibrate) ===
ff25eb47
BH
1301
1302The LTTng calibrate command can be used to find out the combined average overhead of the LTTng tracer and the instrumentation mechanisms used. For now, the only calibration implemented is that of the kernel function
1303instrumentation (kretprobes). To run the calibrate command, select the a domain (e.g. '''Kernel'''), click the right mouse button on the domain tree node. A context-sensitive menu will show. Select the '''Calibrate''' menu item.
1304
1305[[Image:images/LTTng2CalibrateAction.png]]
1306
1307Upon successful operation, the calibrate command is executed and relevant information is stored in the trace. Note: that the trace has to be active so that to command as any effect.
1308
e5b63e7d 1309=== Importing Session Traces to a Tracing Project ===
ff25eb47 1310
43d4f823 1311To import traces from a tracing session, select the relevant session and click on the '''Import''' Button. Alternatively, click the right mouse button on the session tree node and select the menu item '''Import...''' from the context-sensitive menu.
ff25eb47
BH
1312
1313[[Image:images/LTTng2ImportAction.png]]
1314
1315A new display will open for selecting the traces to import.
1316
1317[[Image:images/LTTng2ImportDialog.png]]
1318
e5b63e7d 1319By default all traces are selected. A default project with the name '''Remote''' is selected which will be created if necessary. Update the list of traces to be imported, if necessary, by selecting and deselecting the relevant traces in the tree viewer. Use buttons '''Select All''' or '''Deselect All''' to select or deselect all traces. Also if needed, change the tracing project from the '''Available Projects''' combo box. Select the Overwrite button ('''Overwrite existing trace without warning''') if required. Then press button '''Ok'''. Upon successful import operation the selected traces will be stored in the '''Traces''' directory of the specified tracing project. The session directory structure as well as the trace names will be preserved in the destination tracing project. For '''Kernel''' traces the trace type '''LTTng Kernel Trace''' and for '''UST''' traces the trace type '''LTTng UST Trace''' will be set. From the '''Project Explorer''' view, the trace can be analyzed further.
cd9821de 1320
e5b63e7d 1321'''Note''': If the overwrite button ('''Overwrite existing trace without warning''') was not selected and a trace with the same name of a trace to be imported already exists in the destination directory of the project, then a new confirmation dialog box will open.
ff25eb47
BH
1322
1323[[Image:images/LTTng2ImportOverwriteConfirmationDialog.png]]
1324
1325To Overwrite select the '''Overwrite''' Button and press '''Ok'''.
1326
1327If the existing trace should not be overwritten select, then select the '''Rename''' option of the confirmation dialog box above, enter a new name and then press '''Ok'''.
1328
1329[[Image:images/LTTng2ImportRenameDialog.png]]
1330
e5b63e7d 1331=== Importing Network Traces to a Tracing Project ===
52e76353 1332
43b509ac 1333Since LTTng Tools v2.1.0 it is possible to store traces over the network. To import network traces, execute the '''Import''' action as described in chapter [[#Importing Session Traces to a Tracing Project | Importing Session Traces to a Tracing Project]]. For network traces the '''Import Trace Wizard''' will be displayed. Follow the instructions in chapter [[#Importing | Importing]] to import the network traces of the current session.
52e76353 1334
e5b63e7d 1335== Properties View ==
ff25eb47
BH
1336
1337The Control View provides property information of selected tree component. Depending on the selected tree component different properties are displayed in the property view. For example, when selecting the node level the property view will be filled as followed:
43d4f823 1338
ff25eb47
BH
1339[[Image:images/LTTng2PropertyView.png]]
1340
1341'''List of properties''':
1342
1343* '''Host''' Properties
1344** '''Connection Name''': The alias name to be displayed in the Control View.
1345** '''Host Name''': The IP address or DNS name of the remote system.
1346** '''State''': The state of the connection ('''CONNECTED''', '''CONNECTING''', '''DISCONNNECTING''' or '''DISCONNECTED''').
1347* '''Kernel Provider''' Properties
1348** '''Provider Name''': The name of the provider.
1349* '''UST Provider''' Properties
1350** '''Provider Name''': The name of the provider.
1351** '''Process ID''': The process ID of the provider.
1352* '''Event''' Properties (Provider)
1353** '''Event Name''': The name of the event.
1354** '''Event Type''': The event type ('''TRACEPOINT''' only).
52e76353 1355** '''Fields''': Shows a list of fields defined for the selected event. (UST only, since support for LTTng Tools v2.1.0)
43d4f823 1356** '''Log Level''': The log level of the event.
ff25eb47
BH
1357* '''Session''' Properties
1358** '''Session Name''': The name of the Session.
589d0d33 1359** '''Session Path''': The path on the remote host where the traces will be stored. (Not shown for snapshot sessions).
ff25eb47 1360** '''State''': The state of the session ('''ACTIVE''' or '''INACTIVE''')
589d0d33
BH
1361** '''Snapshot ID''': The snapshot ID. (Only shown for snapshot sessions).
1362** '''Snapshot Name''': The name of the snapshot output configuration. (Only shown for snapshot sessions).
1363** '''Snapshot Path''': The path where the snapshot session is located. (Only shown for snapshot sessions).
ff25eb47
BH
1364* '''Domain''' Properties
1365** '''Domain Name''': The name of the domain.
ca8c54b3 1366** '''Buffer Type''': The buffer type of the domain.
ff25eb47 1367* '''Channel''' Properties
43d4f823 1368** '''Channel Name''': The name of the channel.
ff25eb47
BH
1369** '''Number of Sub Buffers''': The number of sub-buffers of the channel.
1370** '''Output type''': The output type for the trace (e.g. ''splice()'' or ''mmap()'')
1371** '''Overwrite Mode''': The channel overwrite mode ('''true''' for overwrite mode, '''false''' for discard)
1372** '''Read Timer Interval''': The read timer interval.
1373** '''State''': The channel state ('''ENABLED''' or '''DISABLED''')
1374** '''Sub Buffer size''': The size of the sub-buffers of the channel (in bytes).
1375** '''Switch Timer Interval''': The switch timer interval.
43d4f823 1376* '''Event''' Properties (Channel)
ff25eb47 1377** '''Event Name''': The name of the event.
52e76353 1378** '''Event Type''': The event type ('''TRACEPOINT''', '''SYSCALL''' or '''PROBE''').
e5b63e7d 1379** '''Log Level''': The log level of the event. (For LTTng Tools v2.4.0 or later, '''<=''' prior the log level name will indicate a range of log levels and '''==''' a single log level.)
ff25eb47 1380** '''State''': The Event state ('''ENABLED''' or '''DISABLED''')
52e76353 1381** '''Filter''': Shows '''with filter''' if a filter expression is configured else property '''Filter''' is omitted. (since support for LTTng Tools v2.1.0)
ff25eb47 1382
e5b63e7d 1383== LTTng Tracer Control Preferences ==
ff25eb47 1384
4bdf5f96 1385Serveral LTTng 2.0 tracer control preferences exists which can be configured. To configure these preferences, select '''Window->Preferences''' from the top level menu. The preference display will open. Then select '''Tracing->LTTng Tracer Control Preferences'''. This preferences page allows the user to specify the tracing group of the user and to specify the command execution timeout as well as it allows the user to configure the logging of LTTng 2.0 tracer control commands and results to a file.
ff25eb47
BH
1386
1387[[Image:images/LTTng2Preferences.png]]
1388
4bdf5f96 1389To change the tracing group of the user which will be specified on each command line, enter the new group name in the '''Tracing Group''' text field and click button '''OK'''. The default tracing group is '''tracing''' and can be restored by pressing the '''Restore Defaults''' button.
ff25eb47
BH
1390
1391[[Image:images/LTTng2PreferencesGroup.png]]
1392
4bdf5f96 1393To configure logging of trace control commands and the corresponding command result to a file, selected the button '''Logging'''. To append to an existing log file, select the '''Append''' button. Deselect the '''Append''' button to overwrite any existing log file. It's possible to specify a verbose level. There are 3 levels with inceasing verbosity from '''Level 1''' to '''Level 3'''. To change the verbosity level, select the relevant level or select '''None'''. If '''None''' is selected only commands and command results are logged. Then press on button '''OK'''. The log file will be stored in the users home directory with the name ''lttng_tracer_control.log''. The name and location cannot be changed. To reset to default preferences, click on the button '''Restore Defaults'''.
ff25eb47
BH
1394
1395[[Image:images/LTTng2PreferencesLogging.png]]
1396
4bdf5f96
BH
1397To configure the LTTng command execution timeout, enter a timeout value into the text field '''Command Timeout (in seconds)''' and press on button '''OK'''. To reset to the default value of 15 seconds, click on the button '''Restore Defaults'''.
1398
1399[[Image:images/LTTng2PreferencesTimeout.png]]
1400
ff25eb47
BH
1401= LTTng Kernel Analysis =
1402
1403Historically, LTTng was developped to trace the Linux kernel and, over time, a number of kernel-oriented analysis views were developped and organized in a perspective.
1404
1405This section presents a description of the LTTng Kernel Perspective.
1406
1407== LTTng Kernel Perspective ==
1408
43b509ac 1409The '''LTTng Kernel''' perspective is built upon the [[#Tracing_Perspective | Tracing Perspective]], re-organizes them slightly and adds the following views:
ff25eb47 1410
43b509ac
MAL
1411* [[#Control_Flow_View | Control Flow View]] - to visualize processes state transitions
1412* [[#Resources_View | Resources View]] - to visualize system resources state transitions
1413* [[#LTTng_Tracer_Control | LTTng Tracer Control]] - to configure LTTng tracing sessions remotely
ff25eb47
BH
1414
1415[[Image:images/LTTngKernelPerspective.png]]
1416
1417
1418The perspective can be opened from the Eclipse Open Perspective dialog ('''Window > Open Perspective... > Other''').
1419
1420
1421[[Image:images/OpenLTTngKernelPerspective.png]]
1422
1423== Control Flow View ==
1424
708adb96 1425The '''''Control Flow''''' view is a LTTng-specific view that shows per-process events graphically. The LTTng Kernel analysis is executed the first time a LTTng Kernel is opened. After opening the trace, the element '''Control Flow''' is added under the '''LTTng Kernel Analysis''' tree element in the Project Explorer. To open the view, double-click the '''Control Flow''' tree element.
ff25eb47
BH
1426
1427[[Image:images/Cfv_show_view.png]]
1428
708adb96
BH
1429Alternatively, select ''Control Flow'' under ''LTTng'' within the ''Show View'' window ('''Window''' -> '''Show View''' -> '''Other...'''):
1430
ff25eb47
BH
1431You should get something like this:
1432
1433[[Image:images/Cfv_global.png]]
1434
cbc9608c 1435The view is divided into the following important sections: '''process tree and information''', '''control flow''' and the '''toolbar'''.
ff25eb47
BH
1436
1437The following sections provide detailed information for each part of the Control Flow View.
1438
cbc9608c 1439=== Process tree and information ===
ff25eb47
BH
1440
1441Processes are organized as a tree within this view. This way, child and parent processes are easy to identify.
1442
1443[[Image:images/Cfv_process_tree.png]]
1444
1445The layout is based on the states computed from the trace events.
1446
cbc9608c 1447A given process may be shown at different places within the tree since the nodes are '''unique (TID, birth time) couples'''. This means that if process B of parent A dies, you'll still see it in the tree. If process A forks process B again, it will be shown as a different node since it won't have the same birth time (and probably not the same TID). This has the advantage that the tree, once loaded, never changes: horizontal scrolling within the [[#Control flow|control flow]] remains possible.
ff25eb47
BH
1448
1449The TID column shows the process node's '''thread ID''' and the PTID column shows its '''parent thread ID''' (nothing is shown if the process has no parent).
1450
cbc9608c 1451=== Control flow ===
ff25eb47
BH
1452
1453This part of the Control Flow View is probably the most interesting one. Using the mouse, you can navigate through the trace (go left, right) and zoom on a specific region to inspect its details.
1454
b812d14f 1455The colored bars you see represent '''states''' for the associated process node. When a process state changes in time, so does the color. For state '''SYSCALL''' the name of the system call is displayed in the state bar. States colors legend is available through a [[#Toolbar|toolbar button]]:
ff25eb47
BH
1456
1457[[Image:images/Cfv_legend.png]]
1458
1459This dark yellow is what you'll see most of the time since scheduling puts processes on hold while others run.
1460
cbc9608c
PT
1461The vertical blue line with T1 above it is the '''current selection indicator'''. When a time range is selected, the region between the begin and end time of the selection will be shaded and two lines with T1 and T2 above will be displayed. The time stamps corresponding to T1, T2 and their delta are shown in the status line when the mouse is hovering over the control flow.
1462
03ab8eeb 1463Arrows can be displayed that follow the execution of each CPU across processes. The arrows indicate when the scheduler switches from one process to another for a given CPU. The CPU being followed is indicated on the state tooltip. When the scheduler switches to and from the idle process, the arrow skips to the next process which executes on the CPU after the idle process. Note that an appropriate zoom level is required for all arrows to be displayed.
cbc9608c 1464
03ab8eeb 1465The display of arrows is optional and can be toggled using the '''Hide Arrows''' toolbar button. It is also possible to follow a CPU's execution across state changes and the scheduler's process switching using the '''Follow CPU Forward/Backward''' toolbar buttons.
ff25eb47
BH
1466
1467==== Using the mouse ====
1468
1469The states flow is usable with the mouse. The following actions are set:
1470
32adc12c
PT
1471* '''left-click''': select a time or time range begin time
1472* '''Shift-left-click''': select a time range end time
1473* '''left-drag horizontally''': select a time range or change the time range begin or end time
1474* '''middle-drag or Ctrl-left-drag horizontally''': pan left or right
1475* '''right-drag horizontally''': [[#Zoom region|zoom region]]
ff25eb47 1476* '''click on a colored bar''': the associated process node is selected and the current time indicator is moved where the click happened
e5552166
PT
1477* '''mouse wheel up/down''': scroll up or down
1478* '''Ctrl-mouse wheel up/down''': zoom in or out
32adc12c
PT
1479* '''drag the time ruler horizontally''': zoom in or out with fixed start time
1480* '''double-click the time ruler''': reset zoom to full range
ff25eb47 1481
e03c29a7 1482When the current time indicator is changed (when clicking in the states flow), all the other views are '''synchronized'''. For example, the [[#LTTng Kernel Events Editor|Events Editor]] will show the event matching the current time indicator. The reverse behaviour is also implemented: selecting an event within the Events View will update the Control Flow View current time indicator.
ff25eb47
BH
1483
1484==== Incomplete regions ====
1485
1486You'll notice '''small dots''' over the colored bars at some places:
1487
1488[[Image:images/Cfv_small_dots.png]]
1489
1490Those dots mean the underlying region is '''incomplete''': there's not enough pixels to view all the events. In other words, you have to zoom in.
1491
1492When zooming in, small dots start to disappear:
1493
1494[[Image:images/Cfv_zoom.png]]
1495
1496When no dots are left, you are viewing '''all the events and states''' within that region.
1497
1498==== Zoom region ====
1499
32adc12c 1500To zoom in on a specific region, '''right-click and drag''' in order to draw a time range:
ff25eb47
BH
1501
1502[[Image:images/Cfv_zoom_region.png]]
1503
1504The states flow horizontal space will only show the selected region.
1505
1506==== Tooltips ====
1507
1508Hover the cursor over a colored bar and a '''tooltip''' will pop up:
1509
1510[[Image:images/Cfv_tooltip.png]]
1511
1512The tooltip indicates:
1513
1514* the process name
1515* the pointed state name
cbc9608c
PT
1516* the CPU (if applicable)
1517* the system call name (if applicable)
ff25eb47
BH
1518* the pointed state date and start/stop times
1519* the pointed state duration (seconds)
1520
1521=== Toolbar ===
1522
1523The Control Flow View '''toolbar''', located at the top right of the view, has shortcut buttons to perform common actions:
1524
cbc9608c
PT
1525{|
1526| [[Image:images/filter_items.gif]]
1527| Show View Filter
1528| Opens the process filter dialog
1529|-
1530| [[Image:images/show_legend.gif]]
1531| Show Legend
1532| Displays the states legend
1533|-
1534| [[Image:images/home_nav.gif]]
1535| Reset the Time Scale to Default
1536| Resets the zoom window to the full range
1537|-
1538| [[Image:images/prev_event.gif]]
1539| Select Previous Event
1540| Selects the previous state for the selected process
1541|-
1542| [[Image:images/next_event.gif]]
1543| Select Next Event
1544| Selects the next state for the selected process
1545|-
1546| [[Image:images/prev_menu.gif]]
1547| Select Previous Process
1548| Selects the previous process
1549|-
1550| [[Image:images/next_menu.gif]]
1551| Select Next Process
1552| Selects the next process
1553|-
1554| [[Image:images/zoomin_nav.gif]]
1555| Zoom In
1556| Zooms in on the selection by 50%
1557|-
1558| [[Image:images/zoomout_nav.gif]]
1559| Zoom Out
1560| Zooms out on the selection by 50%
1561|-
1562| [[Image:images/hide_arrows.gif]]
1563| Hide Arrows
1564| Toggles the display of arrows on or off
1565|-
1566| [[Image:images/follow_arrow_bwd.gif]]
03ab8eeb 1567| Follow CPU Backward
cbc9608c
PT
1568| Selects the previous state following CPU execution across processes
1569|-
1570| [[Image:images/follow_arrow_fwd.gif]]
03ab8eeb 1571| Follow CPU Forward
cbc9608c
PT
1572| Selects the next state following CPU execution across processes
1573|}
b812d14f 1574
ff25eb47 1575== Resources View ==
cbc9608c 1576
708adb96
BH
1577This view is specific to LTTng kernel traces. The LTTng Kernel analysis is executed the first time a LTTng Kernel is opened. After opening the trace, the element '''Resources''' is added under the '''LTTng Kernel Analysis''' tree element of the Project Explorer. To open the view, double-click the '''Resources''' tree element.
1578
1579Alternatively, go in '''Window''' -> '''Show View''' -> '''Other...''' and select '''LTTng/Resources''' in the list.
ff25eb47 1580
e03c29a7 1581[[Image:images/Rv_example.png|Example of resources view with all trace points and syscalls enabled]]
ff25eb47 1582
b812d14f
BH
1583This view shows the state of system resources i.e. if changes occured during the trace either on '''CPUs''', '''IRQs''' or '''soft IRQs''', it will appear in this view. The left side of the view present a list of resources that are affected by at least one event of the trace. The right side illustrate the state in which each resource is at some point in time. For state '''USERMODE''' it also prints the process name in the state bar. For state '''SYSCALL''' the name of the system call is
1584displayed in the state region.
ff25eb47
BH
1585
1586Just like other views, according to which trace points and system calls are activated, the content of this view may change from one trace to another.
1587
1588Each state are represented by one color so it is faster to say what is happening.
1589
1590[[Image:images/Rv_legend.png|Color for each state]]
1591
1592To go through the state of a resource, you first have to select the resource and the timestamp that interest you. For the latter, you can pick some time before the interesting part of the trace.
1593
1594[[Image:images/RV_infobox1.png|Shows the state of an IRQ]]
1595
1596Then, by selecting '''Next Event''', it will show the next state transition and the event that occured at this time.
1597
1598[[Image:images/RV_infobox2.png|Shows the next state of the IRQ]]
1599
43b509ac 1600This view is also synchronized with the others : [[#Histogram_View | Histogram View]], [[#LTTng_Kernel_Events_Editor | Events Editor]], [[#Control_Flow_View | Control Flow View]], etc.
ff25eb47
BH
1601
1602=== Navigation ===
1603
43b509ac 1604See Control Flow View's '''[[#Using_the_mouse | Using the mouse]]''' and '''[[#Zoom_region | Zoom region]]'''.
ff25eb47
BH
1605
1606=== Incomplete regions ===
1607
43b509ac 1608See Control Flow View's '''[[#Incomplete_regions | Incomplete regions]]'''.
ff25eb47
BH
1609
1610=== Toolbar ===
1611
b812d14f
BH
1612The Resources View '''toolbar''', located at the top right of the view, has shortcut buttons to perform common actions:
1613
cbc9608c
PT
1614{|
1615| [[Image:images/show_legend.gif]]
1616| Show Legend
1617| Displays the states legend
1618|-
1619| [[Image:images/home_nav.gif]]
1620| Reset the Time Scale to Default
1621| Resets the zoom window to the full range
1622|-
1623| [[Image:images/prev_event.gif]]
1624| Select Previous Event
1625| Selects the previous state for the selected resource
1626|-
1627| [[Image:images/next_event.gif]]
1628| Select Next Event
1629| Selects the next state for the selected resource
1630|-
1631| [[Image:images/prev_menu.gif]]
1632| Select Previous Resource
1633| Selects the previous resource
1634|-
1635| [[Image:images/next_menu.gif]]
1636| Select Next Resource
1637| Selects the next resource
1638|-
1639| [[Image:images/zoomin_nav.gif]]
1640| Zoom In
1641| Zooms in on the selection by 50%
1642|-
1643| [[Image:images/zoomout_nav.gif]]
1644| Zoom Out
1645| Zooms out on the selection by 50%
1646|}
ff25eb47 1647
708adb96
BH
1648== LTTng CPU Usage View ==
1649
1650The CPU Usage analysis and view is specific to LTTng Kernel traces. The CPU usage is derived from a kernel trace as long as the '''sched_switch''' event was enabled during the collection of the trace. This analysis is executed the first time that the CPU Usage view is opened after opening the trace. To open the view, double-click on the '''CPU Usage''' tree element under the '''LTTng Kernel Analysis''' tree element of the Project Explorer.
1651
1652[[Image:images/LTTng_OpenCpuUsageView.png]]
1653
1654Now, the CPU Usage view will show:
1655
1656[[Image:images/LTTng_CpuUsageView.png]]
1657
1658The view is divided into the following important sections: '''Process Information''' and the '''CPU Usage Chart'''.
1659
1660
1661=== Process Information ===
1662The Process Information is displayed on the left side of the view and shows all threads that were executing on all available CPUs in the current time range. For each process, it shows in different columns the thread ID (TID), process name (Process), the average (%) execution time and the actual execution time (Time) during the current time range. It shows all threads that were executing on the CPUs in the current time range.
1663
1664
1665=== CPU Usage Chart ===
1666
1667The CPU Usage Chart on the right side of the view, plots the total time spent on all CPUs of all processes and the time of the selected process.
1668
1669
1670==== Using the mouse ====
1671
1672The CPU Usage chart is usable with the mouse. The following actions are set:
1673
1674* '''left-click''': select a time or time range begin time
1675* '''Shift-left-click''': select a time range end time
1676* '''left-drag horizontally''': select a time range or change the time range begin or end time
1677* '''middle-drag''': pan left or right
1678* '''right-drag horizontally''': zoom region
1679* '''mouse wheel up/down''': zoom in or out
1680
1681
1682==== Tooltips ====
1683
1684Hover the cursor over a line of the chart and a tooltip will pop up with the following information:
1685* '''time''': current time of mouse position
1686* '''Total''': The total CPU usage
1687
1688
1689[[Image:images/LTTng_CpuUsageViewToolTip.png]]
1690
1691
07ed89d6 1692== LTTng Kernel Events Editor ==
ff25eb47 1693
43b509ac 1694The LTTng Kernel Events editor '''is''' the plain TMF [[#Events_Editor | Events Editor]], except that it provides its own specialized viewer to replace the standard one. In short, it has exactly the same behaviour but the layout is slightly different:
ff25eb47
BH
1695
1696* '''Timestamp''': the event timestamp
1697* '''Channel''': the event channel (data collector)
1698* '''Event Type''': the event type (or kernel marker)
43d4f823 1699* '''Content''': the raw event content
ff25eb47 1700
07ed89d6
MK
1701[[Image:images/LTTng2EventsEditor.png]]
1702
c3181353
MK
1703= LTTng-UST Analyses =
1704
1705The Userspace traces are taken on an application level. With kernel traces, you know what events you will have as the domain is known and cloistered. Userspace traces can contain pretty much anything. Some analyses are offered if certain events are enabled.
1706
1707== Call Stack View ==
1708
1709The Call Stack view allows the user to visualize the call stack per thread over time, if the application and trace provide this information.
1710
1711To open this view go in '''Window''' -> '''Show View''' -> '''Other...''' and select '''Tracing/Call Stack''' in the list. The view shows the call stack information for the currently selected trace. Conversely, you can select a trace and expand it in the '''Project Explorer''' then expand '''LTTng-UST CallStack Analysis''' (the trace must be loaded) and open '''Call Stack'''.
1712
1713The table on the left-hand side of the view shows the threads and call stack. The function name, depth, entry and exit time and duration are shown for the call stack at the selected time.
1714
1715Double-clicking on a function entry in the table will zoom the time graph to the selected function's range of execution.
1716
1717The time graph on the right-hand side of the view shows the call stack state graphically over time. The function name is visible on each call stack event if size permits. The color of each call stack event is randomly assigned based on the function name, allowing for easy identification of repeated calls to the same function.
1718
1719Clicking on the time graph will set the current time and consequently update the table with the current call stack information.
1720
1721Shift-clicking on the time graph will select a time range. When the selection is a time range, the begin time is used to update the stack information.
1722
1723Double-clicking on a call stack event will zoom the time graph to the selected function's range of execution.
1724
1725Clicking the '''Select Next Event''' or '''Select Previous Event''' or using the left and right arrows will navigate to the next or previous call stack event, and select the function currently at the top of the call stack.
1726
1727Clicking the '''Import Mapping File''' ([[Image:images/import.gif]]) icon will open a file selection dialog, allowing you to import a text file containing mappings from function addresses to function names. If the callstack provider for the current trace type only provides function addresses, a mapping file will be required to get the function names in the view. See the following sections for an example with LTTng-UST traces.
1728
1729=== Using the Callstack View with LTTng-UST traces ===
1730
1731There is support in the LTTng-UST integration plugin to display the callstack of applications traced with the ''liblttng-ust-cyg-profile.so'' library (see the ''liblttng-ust-cyg-profile'' man page for additional information). To do so, you need to:
1732
1733* Recompile your application with "''-g -finstrument-functions''".
1734* Add the ''vtid'' and ''procname'' contexts to your trace session. See the [[#Adding Contexts to Channels and Events of a Domain]] section. Or if using the command-line:
1735** <pre>lttng add-context -u -t vtid -t procname</pre>
1736* Preload the ''liblttng-ust-cyg-profile'' library when running your program:
1737** <pre>LD_PRELOAD=/usr/lib/liblttng-ust-cyg-profile.so ./myprogram</pre>
1738
1739Once you load the resulting trace, making sure it's set to the ''Common Trace Format - LTTng UST Trace'' type, the Callstack View should be populated with the relevant information. However, since GCC's cyg-profile instrumentation only provides function addresses, and not names, an additional step is required to get the function names showing in the view. The following section explains how to do so.
1740
1741=== Importing a function name mapping file for LTTng-UST traces ===
1742
1743If you followed the steps in the previous section, you should have a Callstack View populated with function entries and exits. However, the view will display the function addresses instead of names in the intervals, which are not very useful by themselves. To get the actual function names, you need to:
1744
1745* Generate a mapping file from the binary, using:
1746** <pre>nm myprogram > mapping.txt</pre>
1747* Click the '''Import Mapping File''' ([[Image:images/import.gif]]) button in the Callstack View, and select the ''mapping.txt'' file that was just created.
1748
1749The view should now update to display the function names instead. Make sure the binary used for taking the trace is the one used for this step too (otherwise, there is a good chance of the addresses not being the same).
1750
1751== Memory Usage ==
1752
1753The Memory Usage view allows the user to visualize the active memory usage per thread over time, if the application and trace provide this information.
1754
1755The view shows the memory consumption for the currently selected trace.
1756
1757The time chart plots heap memory usage graphically over time. There is one line per process, unassigned memory usage is mapped to "Other".
1758
1759In this implementation, the user needs to trace while hooking the ''liblttng-ust-libc-wrapper'' by running ''LD_PRELOAD=liblttng-ust-libc-wrapper.so'' '''<exename>'''. This will add tracepoints to memory allocation and freeing to the heap, NOT shared memory or stack usage. If the contexts '''vtid''' and '''procname''' are enabled, then the view will associate the heap usage to processes. As detailed earlier, to enable the contexts, see the [[#Adding Contexts to Channels and Events of a Domain]] section. Or if using the command-line:
1760* <pre>lttng add-context -u -t vtid -t procname</pre>
1761
1762If thread information is available the view will look like this:
1763
1764[[Image:images/memoryUsage/memory-usage-multithread.png]]
1765
1766If thread information is not available it will look like this:
1767
1768[[Image:images/memoryUsage/memory-usage-no-thread-info.png]]
1769
1770The view allows selection of a specific time by left-clicking on a point in the chart. Left mouse dragging will select a time range. Right mouse dragging on the area will zoom in on that window. Middle mouse dragging will move the display window. Mouse wheel operations will zoom in and out also.
1771
1772Please note this view will not show shared memory or stack memory usage.
1773
fc3177d9
GB
1774= Trace synchronization =
1775
1776It is possible to synchronize traces from different machines so that they have the same time reference. Events from the reference trace will have the same timestamps as usual, but the events from traces synchronized with the first one will have their timestamps transformed according to the formula obtained after synchronization.
1777
1778== Obtain synchronizable traces ==
1779
1780To synchronize traces from different machines, they need to exchange packets through the network and have events enabled such that the data can be matched from one trace to the other. For now, only TCP packets can be matched between two traces.
1781
1782LTTng traces that can be synchronized are obtained using one of two methods (both methods are compatible):
1783
1784=== LTTng-module network tracepoint with complete data ===
1785
1786The tracepoints '''net_dev_queue''' and '''netif_receive_skb''' will be used for synchronization. Both tracepoints are available in lttng-modules since version 2.2, but they do not contain sufficient data to be used to synchronize traces.
1787
1788An experimental branch introduces this extra data: lttng-modules will need to be compiled by hand.
1789
1790Obtain the source code for the experimental lttng-modules
1791
1792 # git clone git://git.dorsal.polymtl.ca/~gbastien/lttng-modules.git
1793 # cd lttng-modules
1794
1795Checkout the ''net_data_experimental'' branch, compile and install lttng-modules as per the lttng-modules documentation
1796
1797 # git checkout net_data_experimental
1798 # make
1799 # sudo make modules_install
1800 # sudo depmod -a
1801
1802This experimental branch adds IP, IPv6 and TCP header data to the tracepoints. Packets received and sent with other protocols do not have this extra header data, but all packets are captured.
1803
1804=== LTTng-modules addons kernel module with dynamic tracepoints ===
1805
1806This method adds dynamic instrumentation on TCP packets via extra kernel modules. Only TCP packets are captured.
1807
1808Obtain the source code, along with lttng-modules
1809
1810 # git clone https://github.com/giraldeau/lttng-modules.git
1811 # cd lttng-modules
1812
1813Checkout the addons branch, compile and install lttng-modules as per the lttng-modules documentation. The ''make'' command will fail at first with a message about the unset SYSMAP variable. Instructions on how to generate a System.map are mentioned in the error message.
1814
1815 # git checkout addons
1816 # make
1817 # (follow the instructions to obtain the System.map file and set the SYSMAP variable)
1818 # make
1819 # sudo make modules_install
1820 # sudo depmod -a
1821
1822The lttng-addons modules must be inserted manually for the TCP tracepoints to be made available.
1823
1824 # sudo modprobe lttng-addons
1825 # sudo modprobe lttng-probe-addons
1826
1827The following tracepoints will be available
1828
1829 # sudo lttng list -k
1830 Kernel events:
1831 -------------
1832 ...
1833 inet_sock_create (loglevel: TRACE_EMERG (0)) (type: tracepoint)
1834 inet_sock_delete (loglevel: TRACE_EMERG (0)) (type: tracepoint)
1835 inet_sock_clone (loglevel: TRACE_EMERG (0)) (type: tracepoint)
1836 inet_accept (loglevel: TRACE_EMERG (0)) (type: tracepoint)
1837 inet_connect (loglevel: TRACE_EMERG (0)) (type: tracepoint)
1838 inet_sock_local_in (loglevel: TRACE_EMERG (0)) (type: tracepoint)
1839 inet_sock_local_out (loglevel: TRACE_EMERG (0)) (type: tracepoint)
1840 ...
1841
1842The ones used for trace synchronization are '''inet_sock_local_in''' and '''inet_sock_local_out'''.
1843
1844== Synchronize traces in TMF ==
1845
1846In order to synchronize traces, create a new experiment and select all traces that need to be synchronized. Right-click on the experiment and select '''Synchronize traces'''. For each trace whose time needs to be transformed, a new trace named as the original but followed by a '_' will be created with the transformed timestamps, and the original trace will be replaced in the experiment. The original trace can still be accessed under the '''Traces''' folder.
1847
e03c29a7 1848[[Image:images/Sync_menu.png|Right-click synchronize traces to perform the trace synchronization]]
fc3177d9
GB
1849
1850When opening the experiment now, all the views will be synchronized. The following screenshot presents the differences in the filtered Control Flow View before and after the time synchronization.
1851
e03c29a7 1852[[Image:images/Sync_cfv.png|Example of Control Flow View before and after trace synchronization]]
fc3177d9
GB
1853
1854Information on the quality of the synchronization, the timestamp transformation formula and some synchronization statistics can be visualized in the '''Synchronization''' view. To open the '''Synchronization''' view, use the Eclipse Show View dialog ('''Window''' -> '''Show View''' -> '''Other...'''). Then select '''Synchronization''' under '''Tracing'''.
1855
e03c29a7 1856[[Image:images/Sync_view.png|Example of Synchronization view]]
fc3177d9 1857
07ed89d6
MK
1858= Timestamp formatting =
1859
43d4f823 1860Most views that show timestamps are displayed in the same time format. The unified timestamp format can be changed in the Preferences page. To get to that page, click on '''Window''' -> '''Preferences''' -> '''Tracing''' -> '''Time Format'''. Then a window will show the time format preferences.
07ed89d6
MK
1861
1862[[Image:images/TmfTimestampFormatPage.png]]
1863
1864The preference page has several subsections:
1865
1866* '''Current Format''' a format string generated by the page
1867* '''Sample Display''' an example of a timestamp formatted with the '''Current Format''' string.
c1cd9635 1868* '''Time Zone''' the time zone to use when displaying the time. The value '''Local time''' corresponds to the local, system-configured, time zone.
07ed89d6
MK
1869* '''Data and Time format''' how to format the date (days/months/years) and the time (hours/minutes/seconds)
1870* '''Sub-second format''' how much precision is shown for the sub-second units
1871* '''Date delimiter''' the character used to delimit the date units such as months and years
1872* '''Time delimiter''' the character to separate super-second time units such as seconds and minutes
1873* '''Sub-Second Delimiter''' the character to separate the sub-second groups such as milliseconds and nanoseconds
1874* '''Restore Defaults''' restores the system settings
1875* '''Apply''' apply changes
1876
1877This will update all the displayed timestamps.
ff25eb47 1878
85aa7575
GB
1879= Data driven analysis =
1880
1881It is possible to define custom trace analyses and a way to view them in an XML format. These kind of analyses allow doing more with the trace data than what the default analyses shipped with TMF offer. It can be customized to a specific problem, and fine-tuned to show exactly what you're looking for.
1882
1883== Importing an XML file containing analysis ==
1884
1885If you already have an XML file defining state providers and/or views, you can import it in your TMF workspace by right-clicking on the ''Traces'' or ''Experiments'' folder and selecting ''Import XML Analysis''.
1886
1887[[Image:images/import_XML_analysis.png| Import XML analysis menu]]
1888
1889You will be prompted to select the file. It will be validated before importing it and if successful, the new analysis and views will be shown under the traces for which they apply. You will need to close any already opened traces and re-open them before the new analysis can be executed.
1890
1891Right now, there is no way to "unimport" analyses from within the application. A UI to manage the imported analyses is currently being worked on. In the meantime, you can navigate to your workspace directory, and delete the files in .metadata/.plugins/org.eclipse.linuxtools.tmf.analysis.xml.core/xml_files .
1892
1893== Defining XML components ==
1894
1895To define XML components, you need to create a new XML file and use the XSD that comes with the XML plugin.
1896
1897''For now, the XSD is only available through the source code in org.eclipse.linuxtools.tmf.analysis.xml.core/src/org/eclipse/linuxtools/tmf/analysis/xml/core/module/xmlDefinition.xsd''.
1898
1899An empty file, with no content yet would look like this:
1900
1901<pre>
1902<?xml version="1.0" encoding="UTF-8"?>
1903<tmfxml xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
1904 xsi:noNamespaceSchemaLocation="xmlDefinition.xsd">
1905
1906</tmfxml>
1907</pre>
1908
1909== Defining an XML state provider ==
1910
1911The state system is a component of TMF which can track the states of different elements of the system over the duration of a trace. To build this state system, events have to go chronologically through a state provider, which defines what changes are caused by the event to the system.
1912
1913The state system obtained by the state provider can then be used to populate data-driven views without having to re-read the trace, or to query specific timestamps in the trace without needing to access the trace file.
1914
1915=== Definitions and example ===
1916
1917Before we start, we'll define a few terms used in the following sections. The interested reader should read the [[Developer-Guide|Tmf Developer Guide]] for more complete description of the state system and state providers.
1918
1919* The '''state system''' can be viewed as a model of the system, where the different elements (attributes) can be seen as a tree, and their evolution (states) is tracked through time.
1920
1921* '''Attribute''': An attribute is the smallest element of the model that can be in any particular state. Since many attributes may have the same name, each attribute is represented by its full path in the attribute tree.
1922
1923* '''State''': A state is a value assigned to an attribute at a given time. Each model has its own state values.
1924
1925* '''Attribute tree''': Elements in the model can be placed in a tree-like structure, for logical grouping. Each element in the tree can have both children and a state. Also, the tree is just a logical structure, all elements may be top-level elements.
1926
1927* '''State history''': Whereas the attribute tree may be seen as the first dimension of the state system, the state history is the second dimension, over time. It tracks the intervals at which an attribute was in a given state.
1928
1929In the following sections, we'll use an example trace with the following events:
1930
1931* start(number): A new task with ID 'number' just started.
1932* execute(number, fct_name): The task with ID 'number' is executing a critical section named 'fct_name'.
1933* wait(number): The task with ID 'number' cannot execute a critical section and needs to wait for it.
1934* exec_end(fct_name): A task finished executing the critical section named 'fct_name'.
1935* stop(number): The task with ID 'number' has just finished.
1936
1937=== Determining the state system structure ===
1938
1939The first thing to do is to determine the attribute tree we'll use to represent the model of the system. The attribute tree is like a file system with directories and files, where files are logically gathered in the same parent directory. There is no one good way to build a tree, the logic will depend on the situation and on the person defining it.
1940
1941The generated state system may be used later on to populate views, so attributes of the tree could be grouped in such a way as to make it easy to reach them with a simple path. The view will then be more simple.
1942
1943In our example case, we'll want to track the status of each task and, for each critical section, which task is running them.
1944
1945<pre>
1946|- Tasks
1947| |- 1
1948| |- 2
1949| ...
1950|- Critical section
1951 |- Crit_sect1
1952 |- Crit_sect2
1953 ...
1954</pre>
1955
1956Then we determine how each event will affect the state of the attributes. But first, let's ask ourselves what values should each state take.
1957
1958Let's see with the tree:
1959
1960<pre>
1961|- Tasks -> Empty
1962| |- 1 -> Each task can be in one of
1963| |- 2 RUNNING, CRITICAL, WAITING
1964| ...
1965|- Critical section -> Empty
1966 |- Crit_sect1 -> Each critical section will hold the currently running task number
1967 |- Crit_sect2
1968 ...
1969</pre>
1970
1971Then we determine how each event will affect the state of the attributes. In the attribute paths below, elements in {} are values coming from the trace event, while strings are constants. For the sake of simplicity, we'll say "update attribute", but if an attribute does not exist, it will be created.
1972
1973* start(number): Update state value of attribute "Tasks/{number}" to "RUNNING".
1974* execute(number, fct_name): Update state value of attribute "Tasks/{number}" to "CRITICAL" and Update attribute "Critical section/{fct_name}" to "{number}".
1975* wait(number): Update state value of attribute "Tasks/{number}" to "WAITING".
1976* exec_end(fct_name): Update state value of attribute "Tasks/{valueOf Critical section/{fct_name}}" to RUNNING and update "Critical section/{fct_name}" to null.
1977* stop(number): Update state value of attribute "Tasks/{number}" to null.
1978
1979=== Writing the XML state provider ===
1980
1981Once the model is done at a high level, it is time to translate it to an XML data-driven analysis. For details on how to use each XML element, refer to the documentation available in the XSD files. Some elements will be commented on below.
1982
1983First define the state provider element.
1984
1985The "version" attribute indicates which version of the state system is defined here. Once a state provider has been defined for a trace type, it will typically be used by a team of people and it may be modified over time. This version number should be bumped each time a new version of the state provider is published. This will force a rebuild of any existing state histories (if applicable) whose version number is different from the current one.
1986
1987The "id" attribute uniquely identifies this state provider, and the analysis that will contain it.
1988
1989<pre>
1990<stateProvider version="0" id="my.test.state.provider">
1991</pre>
1992
1993Optional header information can be added to the state provider. A "traceType" should be defined to tell TMF which trace type this analysis will apply to. If no tracetype is specified, the analysis will appear under every trace. A "label" can optionally be added to have a more user-friendly name for the analysis.
1994
1995<pre>
1996<head>
1997 <traceType id="my.trace.id" />
1998 <label value="My test analysis" />
1999</head>
2000</pre>
2001
2002If pre-defined values will be used in the state provider, they must be defined before the state providers. They can then be referred to in the state changes by name, preceded by the '$' sign. It is not necessary to use pre-defined values, the state change can use values like (100, 101, 102) directly.
2003
2004<pre>
2005<definedValue name="RUNNING" value="100" />
2006<definedValue name="CRITICAL" value="101" />
2007<definedValue name="WAITING" value="102" />
2008</pre>
2009
2010The following event handler shows what to do with the event named ''start''. It causes one state change. The sequence of '''stateAttribute''' elements represents the path to the attribute in the attribute tree, each element being one level of the tree. The '''stateValue''' indicates which value to assign to the attribute at the given path. The "$RUNNING" value means it will use the predefined value named RUNNING above.
2011
2012Suppose the actual event is ''start(3)''. The result of this state change is that at the time of the event, the state system attribute "Tasks/3" will have value 100.
2013
2014<pre>
2015<eventHandler eventName="start">
2016 <stateChange>
2017 <stateAttribute type="constant" value="Tasks" />
2018 <stateAttribute type="eventField" value="number" />
2019 <stateValue type="int" value="$RUNNING" />
2020 </stateChange>
2021</eventHandler>
2022</pre>
2023
2024The full XML file for the example above would look like this:
2025
2026<pre>
2027<?xml version="1.0" encoding="UTF-8"?>
2028<tmfxml xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="../../org.eclipse.linuxtools.tmf.analysis.xml.core/src/org/eclipse/linuxtools/tmf/analysis/xml/core/module/xmlDefinition.xsd">
2029 <stateProvider version="0" id="my.test.state.provider">
2030 <head>
2031 <traceType id="my.trace.id" />
2032 <label value="My test analysis" />
2033 </head>
2034
2035 <definedValue name="RUNNING" value="100" />
2036 <definedValue name="CRITICAL" value="101" />
2037 <definedValue name="WAITING" value="102" />
2038
2039 <eventHandler eventName="start">
2040 <stateChange>
2041 <stateAttribute type="constant" value="Tasks" />
2042 <stateAttribute type="eventField" value="number" />
2043 <stateValue type="int" value="$RUNNING" />
2044 </stateChange>
2045 </eventHandler>
2046 <eventHandler eventName="execute">
2047 <stateChange>
2048 <stateAttribute type="constant" value="Tasks" />
2049 <stateAttribute type="eventField" value="number" />
2050 <stateValue type="int" value="$CRITICAL" />
2051 </stateChange>
2052 <stateChange>
2053 <stateAttribute type="constant" value="Critical section" />
2054 <stateAttribute type="eventField" value="fct_name" />
2055 <stateValue type="eventField" value="number" />
2056 </stateChange>
2057 </eventHandler>
2058 <eventHandler eventName="wait">
2059 <stateChange>
2060 <stateAttribute type="constant" value="Tasks" />
2061 <stateAttribute type="eventField" value="number" />
2062 <stateValue type="int" value="$WAITING" />
2063 </stateChange>
2064 </eventHandler>
2065 <eventHandler eventName="exec_end">
2066 <stateChange>
2067 <stateAttribute type="constant" value="Tasks" />
2068 <stateAttribute type="query">
2069 <stateAttribute type="constant" value="Critical section" />
2070 <stateAttribute type="eventField" value="fct_name" />
2071 </stateAttribute>
2072 <stateValue type="int" value="$RUNNING" />
2073 </stateChange>
2074 <stateChange>
2075 <stateAttribute type="constant" value="Critical section" />
2076 <stateAttribute type="eventField" value="fct_name" />
2077 <stateValue type="null" />
2078 </stateChange>
2079 </eventHandler>
2080 <eventHandler eventName="stop">
2081 <stateChange>
2082 <stateAttribute type="constant" value="Tasks" />
2083 <stateAttribute type="eventField" value="number" />
2084 <stateValue type="null" />
2085 </stateChange>
2086 </eventHandler>
2087 </stateProvider>
2088</tmfxml>
2089</pre>
2090
2091=== Debugging the XML state provider ===
2092
43b509ac 2093To debug the state system that was generated by the XML state provider, one could use the [[#State System Explorer View | State System Explorer View]], along with the events editor. By selecting an event, you can see what changes this event caused and the states of other attributes at the time.
85aa7575
GB
2094
2095If there are corrections to make, you may modify the XML state provider file, and re-import it. To re-run the analysis, you must first delete the supplementary files by right-clicking on your trace, and selecting ''Delete supplementary files...''. Check you analysis's .ht file, so that the analysis will be run again when the trace is reopened. The supplementary file deletion will have closed the trace, so it needs to be opened again to use the newly imported analysis file.
2096
2097If modifications are made to the XML state provider after it has been "published", the '''version''' attribute of the '''xmlStateProvider''' element should be updated. This avoids having to delete each trace's supplementary file manually. If the saved state system used a previous version, it will automatically be rebuilt from the XML file.
2098
2099== Defining an XML time graph view ==
2100
2101A time graph view is a view divided in two, with a tree viewer on the left showing information on the different entries to display and a Gantt-like viewer on the right, showing the state of the entries over time. The [[#Control_Flow_View | Control Flow View]] is an example of a time graph view.
2102
43b509ac 2103Such views can be defined in XML using the data in the state system. The state system itself could have been built by an XML-defined state provider or by any pre-defined Java analysis. It only requires knowing the structure of the state system, which can be explored using the [[#State System Explorer View | State System Explorer View]] (or programmatically using the methods in ''ITmfStateSystem'').
85aa7575
GB
2104
2105In the example above, suppose we want to display the status for each task. In the state system, it means the path of the entries to display is "Tasks/*". The attribute whose value should be shown in the Gantt chart is the entry attribute itself. So the XML to display these entries would be as such:
2106
2107<pre>
2108<entry path="Tasks/*">
2109 <display type="self" />
2110</entry>
2111</pre>
2112
2113But first, the view has to be declared. It has an ID, to uniquely identify this view among all the available XML files.
2114
2115<pre>
2116<timeGraphView id="my.test.time.graph.view">
2117</pre>
2118
2119Optional header information can be added to the view. '''analysis''' elements will associate the view only to the analysis identified by the "id" attribute. It can be either the ID of the state provider, like in this case, or the analysis ID of any analysis defined in Java. If no analysis is specified, the view will appear under every analysis with a state system. The '''label''' element allows to give a more user-friendly name to the view. The label does not have to be unique. As long as the ID is unique, views for different analyses can use the same name.
2120
2121<pre>
2122<head>
2123 <analysis id="my.test.state.provider" />
2124 <label value="My Sample XML View" />
2125</head>
2126</pre>
2127
2128Also, if the values of the attributes to display are known, they can be defined, along with a text to explain them and a color to draw them with. Note that the values are the same as defined in the state provider, but the name does not have to be the same. While in the state provider, a simple constant string makes sense to use in state changes. But in the view, the name will appear in the legend, so a user-friendly text is more appropriate.
2129
2130<pre>
2131<definedValue name="The process is running" value="100" color="#118811" />
2132<definedValue name="Critical section" value="101" color="#881111" />
2133<definedValue name="Waiting for critical section" value="102" color="#AEB522" />
2134</pre>
2135
2136Here is the full XML for the time graph view:
2137
2138<pre>
2139<tmfxml xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="../../org.eclipse.linuxtools.tmf.analysis.xml.core/src/org/eclipse/linuxtools/tmf/analysis/xml/core/module/xmlDefinition.xsd">
2140 <timeGraphView id="my.test.time.graph.view">
2141 <head>
2142 <analysis id="my.test.state.provider" />
2143 <label value="My Sample XML View" />
2144 </head>
2145
2146 <definedValue name="The process is running" value="100" color="#118811" />
2147 <definedValue name="Critical section" value="101" color="#881111" />
2148 <definedValue name="Waiting for critical section" value="102" color="#AEB522" />
2149
2150 <entry path="Tasks/*">
2151 <display type="self" />
2152 </entry>
2153 </timeGraphView>
2154</tmfxml>
2155</pre>
2156
2157The following screenshot shows the result of the preceding example on a test trace. The trace used, as well as the XML file are available [http://secretaire.dorsal.polymtl.ca/~gbastien/Xml4Traces/XML_documentation_example.tar.gz here].
2158
2159[[Image:images/Xml_analysis_screenshot.png| XML analysis with view]]
2160
8d8983f1
GB
2161== Defining an XML XY chart ==
2162
2163An XY chart displays series as a set of numerical values over time. The X-axis represents the time and is synchronized with the trace's current time range. The Y-axis can be any numerical value.
2164
2165Such views can be defined in XML using the data in the state system. The state system itself could have been built by an XML-defined state provider or by any pre-defined Java analysis. It only requires knowing the structure of the state system, which can be explored using the [[#State System Explorer View | State System Explorer View]] (or programmatically using the methods in ''ITmfStateSystem'').
2166
2167We will use the LTTng Kernel Analysis on LTTng kernel traces to show an example XY chart. In this state system, the status of each CPU is a numerical value. We will display this value as the Y axis of the series. There will be one series per CPU. The XML to display these entries would be as such:
2168
2169<pre>
2170<entry path="CPUs/*">
2171 <display type="constant" value="Status" />
2172 <name type="self" />
2173</entry>
2174</pre>
2175
2176But first, the view has to be declared. It has an ID, to uniquely identify this view among all the available XML files.
2177
2178<pre>
2179<xyView id="my.test.xy.chart.view">
2180</pre>
2181
2182Like for the time graph views, optional header information can be added to the view. '''analysis''' elements will associate the view only to the analysis identified by the "id" attribute. It can be either the ID of the state provider, like in this case, or the analysis ID of any analysis defined in Java. If no analysis is specified, the view will appear under every analysis with a state system. The '''label''' element allows to give a more user-friendly name to the view. The label does not have to be unique. As long as the ID is unique, views for different analyses can use the same name.
2183
2184<pre>
2185<head>
2186 <analysis id="org.eclipse.linuxtools.lttng2.kernel.analysis" />
2187 <label value="CPU status XY view" />
2188</head>
2189</pre>
2190
2191Here is the full XML for the XY Chart that displays the CPU status over time of an LTTng Kernel Trace:
2192
2193<pre>
2194<tmfxml xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="../../org.eclipse.linuxtools.tmf.analysis.xml.core/src/org/eclipse/linuxtools/tmf/analysis/xml/core/module/xmlDefinition.xsd">
2195 <xyView id="my.test.xy.chart.view">
2196 <head>
2197 <analysis id="org.eclipse.linuxtools.lttng2.kernel.analysis" />
2198 <label value="CPU status XY view" />
2199 </head>
2200
2201 <entry path="CPUs/*">
2202 <display type="constant" value="Status" />
2203 <name type="self" />
2204 </entry>
2205 </xyView>
2206</tmfxml>
2207</pre>
2208
2209The following screenshot shows the result of the preceding example on a LTTng Kernel Trace.
2210
2211[[Image:images/XML_xy_chart.png| XML XY chart]]
2212
ff25eb47
BH
2213= Limitations =
2214
07ed89d6 2215* When parsing text traces, the timestamps are assumed to be in the local time zone. This means that when combining it to CTF binary traces, there could be offsets by a few hours depending on where the traces were taken and where they were read.
52e76353 2216* LTTng Tools v2.1.0 introduced the command line options ''--no-consumer'' and ''--disable-consumer'' for session creation as well as the commands ''enable-consumer'' and ''disable-consumer''. The LTTng Tracer Control in Eclipse doesn't support these options and commands because they will obsolete in LTTng Tools v2.2.0 and because the procedure for session creation offers already all relevant advanced parameters.
ff25eb47 2217
43d4f823 2218= How to use LTTng to diagnose problems =
ff25eb47
BH
2219
2220LTTng is a tracer, it will give an enormous amount of information about the system it is running on. This means it can solve many types of problems.
2221
43d4f823 2222The following are examples of problems that can be solved with a tracer.
ff25eb47 2223
43d4f823 2224== Random stutters ==
ff25eb47
BH
2225
2226Bob is running a computer program and it stutters periodically every 2 minutes. The CPU load is relatively low and Bob isn't running low on RAM.
2227
2228He decides to trace his complete system for 10 minutes. He opens the LTTng view in eclipse. From the control, he creates a session and enables all kernel tracepoints.
2229
2230He now has a 10 GB trace file. He imports the trace to his viewer and loads it up.
2231
2232A cursory look at the histogram bar on the bottom show relatively even event distribution, there are no interesting spikes, so he will have to dig deeper to find the issue. If he had seen a spike every 2 minutes, there would be strong chances this would be the first thing to investigate as it would imply a lot of kernel activity at the same period as his glitch, this would have been a path to investigate.
2233
2234As Bob suspects that he may be having some hardware raising IRQs or some other hardware based issue and adding delays. He looks at the ressource view and doesn't see anything abnormal.
2235
2236Bob did note an exact second one glitch occured: 11:58:03. He zooms into the time range or 11:58:02-11:58:04 using the histogram.He is happy to see the time is human readable local wall clock time and no longer in "nanseconds since the last reboot". <br>In the resource view, once again, he sees many soft irqs being raised at the same time, around the time his gui would freeze. He changes views and looks at the control flow view at that time and sees a process spending a lot of time in the kernel: FooMonitor- his temperature monitoring software.
2237
2238At this point he closes FooMonitor and notices the bug dissapeared. He could call it a day but he wants to see what was causing the system to freeze. He cannot justify closing a piece of software without understanding the issue. It may be a conflict that HIS software is causing after all.
2239
2240The system freezes around the time this program is running. He clicks on the process in the control flow view and looks at the corresponding events in the detailed events view. He sees: open - read - close repeated hundreds of times on the same file. The file being read was /dev/HWmonitor. He sends a report to the FooMonitor team and warns his team that FooMonitor was glitching their performance.
2241
2242The FooMonitor team finds that they were calling a system bus call that would halt a cpu while reading the temperature so that the core would not induce an 0.1 degree error in the reading, by disabling this feature, they improve their software and stop the glitches from occurring on their custommer's machine. They also optimize their code to open the file read and clone it once.
2243
2244By using system wide kernel tracing, even without deep kernel knowledge Bob was able to isolate a bug in a rogue piece of software in his system.
2245
43d4f823 2246== Slow I/O ==
ff25eb47
BH
2247
2248Alice is running her server. She noticed that one of her nodes was slowing down, and wasn't sure why, upon reading the trace she noticed that her time between a block request and complete was around 10ms.
2249
2250This is abnormal, normally her server handles IOs in under 100us, since they are quite local.
2251
2252She walks up to the server and hears the hard drive thrashing, This prompts her to look up in the events view the sectors being read in the block complete requests. There are her requests interleaved with other ones at the opposite side of the hard drive.
2253
2254She sees the tracer writing but there is another process that is writing to the server disk non stop. She looks in the control flow view and sees that there's a program from another fellow engineer, "Wally" that is writing in his home in a loop "All work and no play makes Jack a dull boy.".
2255
2256Alice kills the program, and immediately the server speeds up. She then goes to discuss this with Wally and implements strict hard disk quotas on the server.
2257
2258= References =
2259
2260* [http://www.eclipse.org/linuxtools/projectPages/lttng/ Linux Tools - LTTng integration]
2261* [http://www.lttng.org/ LTTng project]
52e76353
BH
2262* [http://lttng.org/files/doc/man-pages/man1/lttng.1.html LTTng Tracer Control Command Line Tool User Manual]
2263* [http://lttng.org/files/doc/man-pages/man8/lttng-relayd.8.html LTTng relayd User Manual]
ff25eb47
BH
2264* [http://wiki.eclipse.org/Linux_Tools_Project/TMF/User_Guide TMF User Guide]
2265
2266= Updating This Document =
2267
2268This document is maintained in a collaborative wiki. If you wish to update or modify this document please visit [http://wiki.eclipse.org/index.php/Linux_Tools_Project/LTTng2/User_Guide http://wiki.eclipse.org/Linux_Tools_Project/LTTng2/User_Guide]
This page took 0.201317 seconds and 5 git commands to generate.