| ================================== | |
| Using the Linux Kernel Tracepoints | |
| ================================== | |
| :Author: Mathieu Desnoyers | |
| This document introduces Linux Kernel Tracepoints and their use. It | |
| provides examples of how to insert tracepoints in the kernel and | |
| connect probe functions to them and provides some examples of probe | |
| functions. | |
| Purpose of tracepoints | |
| ---------------------- | |
| A tracepoint placed in code provides a hook to call a function (probe) | |
| that you can provide at runtime. A tracepoint can be "on" (a probe is | |
| connected to it) or "off" (no probe is attached). When a tracepoint is | |
| "off" it has no effect, except for adding a tiny time penalty | |
| (checking a condition for a branch) and space penalty (adding a few | |
| bytes for the function call at the end of the instrumented function | |
| and adds a data structure in a separate section). When a tracepoint | |
| is "on", the function you provide is called each time the tracepoint | |
| is executed, in the execution context of the caller. When the function | |
| provided ends its execution, it returns to the caller (continuing from | |
| the tracepoint site). | |
| You can put tracepoints at important locations in the code. They are | |
| lightweight hooks that can pass an arbitrary number of parameters, | |
| whose prototypes are described in a tracepoint declaration placed in a | |
| header file. | |
| They can be used for tracing and performance accounting. | |
| Usage | |
| ----- | |
| Two elements are required for tracepoints : | |
| - A tracepoint definition, placed in a header file. | |
| - The tracepoint statement, in C code. | |
| In order to use tracepoints, you should include linux/tracepoint.h. | |
| In include/trace/events/subsys.h:: | |
| #undef TRACE_SYSTEM | |
| #define TRACE_SYSTEM subsys | |
| #if !defined(_TRACE_SUBSYS_H) || defined(TRACE_HEADER_MULTI_READ) | |
| #define _TRACE_SUBSYS_H | |
| #include <linux/tracepoint.h> | |
| DECLARE_TRACE(subsys_eventname, | |
| TP_PROTO(int firstarg, struct task_struct *p), | |
| TP_ARGS(firstarg, p)); | |
| #endif /* _TRACE_SUBSYS_H */ | |
| /* This part must be outside protection */ | |
| #include <trace/define_trace.h> | |
| In subsys/file.c (where the tracing statement must be added):: | |
| #include <trace/events/subsys.h> | |
| #define CREATE_TRACE_POINTS | |
| DEFINE_TRACE(subsys_eventname); | |
| void somefct(void) | |
| { | |
| ... | |
| trace_subsys_eventname_tp(arg, task); | |
| ... | |
| } | |
| Where : | |
| - subsys_eventname is an identifier unique to your event | |
| - subsys is the name of your subsystem. | |
| - eventname is the name of the event to trace. | |
| - `TP_PROTO(int firstarg, struct task_struct *p)` is the prototype of the | |
| function called by this tracepoint. | |
| - `TP_ARGS(firstarg, p)` are the parameters names, same as found in the | |
| prototype. | |
| - if you use the header in multiple source files, `#define CREATE_TRACE_POINTS` | |
| should appear only in one source file. | |
| Connecting a function (probe) to a tracepoint is done by providing a | |
| probe (function to call) for the specific tracepoint through | |
| register_trace_subsys_eventname(). Removing a probe is done through | |
| unregister_trace_subsys_eventname(); it will remove the probe. | |
| tracepoint_synchronize_unregister() must be called before the end of | |
| the module exit function to make sure there is no caller left using | |
| the probe. This, and the fact that preemption is disabled around the | |
| probe call, make sure that probe removal and module unload are safe. | |
| The tracepoint mechanism supports inserting multiple instances of the | |
| same tracepoint, but a single definition must be made of a given | |
| tracepoint name over all the kernel to make sure no type conflict will | |
| occur. Name mangling of the tracepoints is done using the prototypes | |
| to make sure typing is correct. Verification of probe type correctness | |
| is done at the registration site by the compiler. Tracepoints can be | |
| put in inline functions, inlined static functions, and unrolled loops | |
| as well as regular functions. | |
| The naming scheme "subsys_event" is suggested here as a convention | |
| intended to limit collisions. Tracepoint names are global to the | |
| kernel: they are considered as being the same whether they are in the | |
| core kernel image or in modules. | |
| If the tracepoint has to be used in kernel modules, an | |
| EXPORT_TRACEPOINT_SYMBOL_GPL() or EXPORT_TRACEPOINT_SYMBOL() can be | |
| used to export the defined tracepoints. | |
| If you need to do a bit of work for a tracepoint parameter, and | |
| that work is only used for the tracepoint, that work can be encapsulated | |
| within an if statement with the following:: | |
| if (trace_foo_bar_enabled()) { | |
| int i; | |
| int tot = 0; | |
| for (i = 0; i < count; i++) | |
| tot += calculate_nuggets(); | |
| trace_foo_bar_tp(tot); | |
| } | |
| All trace_<tracepoint>_tp() calls have a matching trace_<tracepoint>_enabled() | |
| function defined that returns true if the tracepoint is enabled and | |
| false otherwise. The trace_<tracepoint>_tp() should always be within the | |
| block of the if (trace_<tracepoint>_enabled()) to prevent races between | |
| the tracepoint being enabled and the check being seen. | |
| The advantage of using the trace_<tracepoint>_enabled() is that it uses | |
| the static_key of the tracepoint to allow the if statement to be implemented | |
| with jump labels and avoid conditional branches. | |
| .. note:: The convenience macro TRACE_EVENT provides an alternative way to | |
| define tracepoints. Note, DECLARE_TRACE(foo) creates a function | |
| "trace_foo_tp()" whereas TRACE_EVENT(foo) creates a function | |
| "trace_foo()", and also exposes the tracepoint as a trace event in | |
| /sys/kernel/tracing/events directory. Check http://lwn.net/Articles/379903, | |
| http://lwn.net/Articles/381064 and http://lwn.net/Articles/383362 | |
| for a series of articles with more details. | |
| If you require calling a tracepoint from a header file, it is not | |
| recommended to call one directly or to use the trace_<tracepoint>_enabled() | |
| function call, as tracepoints in header files can have side effects if a | |
| header is included from a file that has CREATE_TRACE_POINTS set, as | |
| well as the trace_<tracepoint>() is not that small of an inline | |
| and can bloat the kernel if used by other inlined functions. Instead, | |
| include tracepoint-defs.h and use tracepoint_enabled(). | |
| In a C file:: | |
| void do_trace_foo_bar_wrapper(args) | |
| { | |
| trace_foo_bar_tp(args); // for tracepoints created via DECLARE_TRACE | |
| // or | |
| trace_foo_bar(args); // for tracepoints created via TRACE_EVENT | |
| } | |
| In the header file:: | |
| DECLARE_TRACEPOINT(foo_bar); | |
| static inline void some_inline_function() | |
| { | |
| [..] | |
| if (tracepoint_enabled(foo_bar)) | |
| do_trace_foo_bar_wrapper(args); | |
| [..] | |
| } |