Blame view

Documentation/trace/ftrace-design.txt 14.9 KB
555f386c9   Mike Frysinger   ftrace: document ...
1
2
  		function tracer guts
  		====================
036889703   Mike Frysinger   tracing/documenta...
3
  		By Mike Frysinger
555f386c9   Mike Frysinger   ftrace: document ...
4
5
6
7
8
9
10
11
12
13
14
  
  Introduction
  ------------
  
  Here we will cover the architecture pieces that the common function tracing
  code relies on for proper functioning.  Things are broken down into increasing
  complexity so that you can start simple and at least get basic functionality.
  
  Note that this focuses on architecture implementation details only.  If you
  want more explanation of a feature in terms of common code, review the common
  ftrace.txt file.
9849ed4d7   Mike Frysinger   tracing/documenta...
15
16
  Ideally, everyone who wishes to retain performance while supporting tracing in
  their kernel should make it all the way to dynamic ftrace support.
555f386c9   Mike Frysinger   ftrace: document ...
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
  
  Prerequisites
  -------------
  
  Ftrace relies on these features being implemented:
   STACKTRACE_SUPPORT - implement save_stack_trace()
   TRACE_IRQFLAGS_SUPPORT - implement include/asm/irqflags.h
  
  
  HAVE_FUNCTION_TRACER
  --------------------
  
  You will need to implement the mcount and the ftrace_stub functions.
  
  The exact mcount symbol name will depend on your toolchain.  Some call it
  "mcount", "_mcount", or even "__mcount".  You can probably figure it out by
  running something like:
  	$ echo 'main(){}' | gcc -x c -S -o - - -pg | grep mcount
  	        call    mcount
  We'll make the assumption below that the symbol is "mcount" just to keep things
  nice and simple in the examples.
  
  Keep in mind that the ABI that is in effect inside of the mcount function is
  *highly* architecture/toolchain specific.  We cannot help you in this regard,
  sorry.  Dig up some old documentation and/or find someone more familiar than
  you to bang ideas off of.  Typically, register usage (argument/scratch/etc...)
  is a major issue at this point, especially in relation to the location of the
  mcount call (before/after function prologue).  You might also want to look at
  how glibc has implemented the mcount function for your architecture.  It might
  be (semi-)relevant.
  
  The mcount function should check the function pointer ftrace_trace_function
  to see if it is set to ftrace_stub.  If it is, there is nothing for you to do,
  so return immediately.  If it isn't, then call that function in the same way
  the mcount function normally calls __mcount_internal -- the first argument is
  the "frompc" while the second argument is the "selfpc" (adjusted to remove the
  size of the mcount call that is embedded in the function).
  
  For example, if the function foo() calls bar(), when the bar() function calls
  mcount(), the arguments mcount() will pass to the tracer are:
  	"frompc" - the address bar() will use to return to foo()
7e25f44cb   Randy Dunlap   Documentation: Up...
58
  	"selfpc" - the address bar() (with mcount() size adjustment)
555f386c9   Mike Frysinger   ftrace: document ...
59
60
61
62
  
  Also keep in mind that this mcount function will be called *a lot*, so
  optimizing for the default case of no tracer will help the smooth running of
  your system when tracing is disabled.  So the start of the mcount function is
7e25f44cb   Randy Dunlap   Documentation: Up...
63
64
65
  typically the bare minimum with checking things before returning.  That also
  means the code flow should usually be kept linear (i.e. no branching in the nop
  case).  This is of course an optimization and not a hard requirement.
555f386c9   Mike Frysinger   ftrace: document ...
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
  
  Here is some pseudo code that should help (these functions should actually be
  implemented in assembly):
  
  void ftrace_stub(void)
  {
  	return;
  }
  
  void mcount(void)
  {
  	/* save any bare state needed in order to do initial checking */
  
  	extern void (*ftrace_trace_function)(unsigned long, unsigned long);
  	if (ftrace_trace_function != ftrace_stub)
  		goto do_trace;
  
  	/* restore any bare state */
  
  	return;
  
  do_trace:
  
  	/* save all state needed by the ABI (see paragraph above) */
  
  	unsigned long frompc = ...;
  	unsigned long selfpc = <return address> - MCOUNT_INSN_SIZE;
  	ftrace_trace_function(frompc, selfpc);
  
  	/* restore all state needed by the ABI */
  }
  
  Don't forget to export mcount for modules !
  extern void mcount(void);
  EXPORT_SYMBOL(mcount);
  
  
  HAVE_FUNCTION_TRACE_MCOUNT_TEST
  -------------------------------
  
  This is an optional optimization for the normal case when tracing is turned off
  in the system.  If you do not enable this Kconfig option, the common ftrace
  code will take care of doing the checking for you.
  
  To support this feature, you only need to check the function_trace_stop
  variable in the mcount function.  If it is non-zero, there is no tracing to be
  done at all, so you can return.
  
  This additional pseudo code would simply be:
  void mcount(void)
  {
  	/* save any bare state needed in order to do initial checking */
  
  +	if (function_trace_stop)
  +		return;
  
  	extern void (*ftrace_trace_function)(unsigned long, unsigned long);
  	if (ftrace_trace_function != ftrace_stub)
  ...
  
  
  HAVE_FUNCTION_GRAPH_TRACER
  --------------------------
  
  Deep breath ... time to do some real work.  Here you will need to update the
  mcount function to check ftrace graph function pointers, as well as implement
  some functions to save (hijack) and restore the return address.
  
  The mcount function should check the function pointers ftrace_graph_return
  (compare to ftrace_stub) and ftrace_graph_entry (compare to
7e25f44cb   Randy Dunlap   Documentation: Up...
136
  ftrace_graph_entry_stub).  If either of those is not set to the relevant stub
555f386c9   Mike Frysinger   ftrace: document ...
137
138
  function, call the arch-specific function ftrace_graph_caller which in turn
  calls the arch-specific function prepare_ftrace_return.  Neither of these
7e25f44cb   Randy Dunlap   Documentation: Up...
139
  function names is strictly required, but you should use them anyway to stay
555f386c9   Mike Frysinger   ftrace: document ...
140
141
142
143
144
145
146
147
148
  consistent across the architecture ports -- easier to compare & contrast
  things.
  
  The arguments to prepare_ftrace_return are slightly different than what are
  passed to ftrace_trace_function.  The second argument "selfpc" is the same,
  but the first argument should be a pointer to the "frompc".  Typically this is
  located on the stack.  This allows the function to hijack the return address
  temporarily to have it point to the arch-specific function return_to_handler.
  That function will simply call the common ftrace_return_to_handler function and
7e25f44cb   Randy Dunlap   Documentation: Up...
149
  that will return the original return address with which you can return to the
555f386c9   Mike Frysinger   ftrace: document ...
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
  original call site.
  
  Here is the updated mcount pseudo code:
  void mcount(void)
  {
  ...
  	if (ftrace_trace_function != ftrace_stub)
  		goto do_trace;
  
  +#ifdef CONFIG_FUNCTION_GRAPH_TRACER
  +	extern void (*ftrace_graph_return)(...);
  +	extern void (*ftrace_graph_entry)(...);
  +	if (ftrace_graph_return != ftrace_stub ||
  +	    ftrace_graph_entry != ftrace_graph_entry_stub)
  +		ftrace_graph_caller();
  +#endif
  
  	/* restore any bare state */
  ...
  
  Here is the pseudo code for the new ftrace_graph_caller assembly function:
  #ifdef CONFIG_FUNCTION_GRAPH_TRACER
  void ftrace_graph_caller(void)
  {
  	/* save all state needed by the ABI */
  
  	unsigned long *frompc = &...;
  	unsigned long selfpc = <return address> - MCOUNT_INSN_SIZE;
036889703   Mike Frysinger   tracing/documenta...
178
179
  	/* passing frame pointer up is optional -- see below */
  	prepare_ftrace_return(frompc, selfpc, frame_pointer);
555f386c9   Mike Frysinger   ftrace: document ...
180
181
182
183
  
  	/* restore all state needed by the ABI */
  }
  #endif
036889703   Mike Frysinger   tracing/documenta...
184
185
186
  For information on how to implement prepare_ftrace_return(), simply look at the
  x86 version (the frame pointer passing is optional; see the next section for
  more information).  The only architecture-specific piece in it is the setup of
555f386c9   Mike Frysinger   ftrace: document ...
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
  the fault recovery table (the asm(...) code).  The rest should be the same
  across architectures.
  
  Here is the pseudo code for the new return_to_handler assembly function.  Note
  that the ABI that applies here is different from what applies to the mcount
  code.  Since you are returning from a function (after the epilogue), you might
  be able to skimp on things saved/restored (usually just registers used to pass
  return values).
  
  #ifdef CONFIG_FUNCTION_GRAPH_TRACER
  void return_to_handler(void)
  {
  	/* save all state needed by the ABI (see paragraph above) */
  
  	void (*original_return_point)(void) = ftrace_return_to_handler();
  
  	/* restore all state needed by the ABI */
  
  	/* this is usually either a return or a jump */
  	original_return_point();
  }
  #endif
036889703   Mike Frysinger   tracing/documenta...
209
210
211
212
213
214
215
  HAVE_FUNCTION_GRAPH_FP_TEST
  ---------------------------
  
  An arch may pass in a unique value (frame pointer) to both the entering and
  exiting of a function.  On exit, the value is compared and if it does not
  match, then it will panic the kernel.  This is largely a sanity check for bad
  code generation with gcc.  If gcc for your port sanely updates the frame
9849ed4d7   Mike Frysinger   tracing/documenta...
216
  pointer under different optimization levels, then ignore this option.
036889703   Mike Frysinger   tracing/documenta...
217
218
219
220
221
222
223
  
  However, adding support for it isn't terribly difficult.  In your assembly code
  that calls prepare_ftrace_return(), pass the frame pointer as the 3rd argument.
  Then in the C version of that function, do what the x86 port does and pass it
  along to ftrace_push_return_trace() instead of a stub value of 0.
  
  Similarly, when you call ftrace_return_to_handler(), pass it the frame pointer.
555f386c9   Mike Frysinger   ftrace: document ...
224
225
226
227
228
229
  HAVE_FTRACE_NMI_ENTER
  ---------------------
  
  If you can't trace NMI functions, then skip this option.
  
  <details to be filled>
459c6d15a   Frederic Weisbecker   tracing: Document...
230
  HAVE_SYSCALL_TRACEPOINTS
9849ed4d7   Mike Frysinger   tracing/documenta...
231
  ------------------------
555f386c9   Mike Frysinger   ftrace: document ...
232

459c6d15a   Frederic Weisbecker   tracing: Document...
233
  You need very few things to get the syscalls tracing in an arch.
e7b8e675d   Mike Frysinger   tracing: Unify ar...
234
  - Support HAVE_ARCH_TRACEHOOK (see arch/Kconfig).
459c6d15a   Frederic Weisbecker   tracing: Document...
235
236
  - Have a NR_syscalls variable in <asm/unistd.h> that provides the number
    of syscalls supported by the arch.
e7b8e675d   Mike Frysinger   tracing: Unify ar...
237
  - Support the TIF_SYSCALL_TRACEPOINT thread flags.
459c6d15a   Frederic Weisbecker   tracing: Document...
238
239
  - Put the trace_sys_enter() and trace_sys_exit() tracepoints calls from ptrace
    in the ptrace syscalls tracing path.
c763ba06b   Ian Munsie   tracing/syscalls:...
240
241
242
  - If the system call table on this arch is more complicated than a simple array
    of addresses of the system calls, implement an arch_syscall_addr to return
    the address of a given system call.
b2d554968   Ian Munsie   tracing/syscalls:...
243
244
245
246
  - If the symbol names of the system calls do not match the function names on
    this arch, define ARCH_HAS_SYSCALL_MATCH_SYM_NAME in asm/ftrace.h and
    implement arch_syscall_match_sym_name with the appropriate logic to return
    true if the function name corresponds with the symbol name.
459c6d15a   Frederic Weisbecker   tracing: Document...
247
  - Tag this arch as HAVE_SYSCALL_TRACEPOINTS.
555f386c9   Mike Frysinger   ftrace: document ...
248
249
250
251
  
  
  HAVE_FTRACE_MCOUNT_RECORD
  -------------------------
9849ed4d7   Mike Frysinger   tracing/documenta...
252
253
254
  See scripts/recordmcount.pl for more info.  Just fill in the arch-specific
  details for how to locate the addresses of mcount call sites via objdump.
  This option doesn't make much sense without also implementing dynamic ftrace.
555f386c9   Mike Frysinger   ftrace: document ...
255

9849ed4d7   Mike Frysinger   tracing/documenta...
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
  
  HAVE_DYNAMIC_FTRACE
  -------------------
  
  You will first need HAVE_FTRACE_MCOUNT_RECORD and HAVE_FUNCTION_TRACER, so
  scroll your reader back up if you got over eager.
  
  Once those are out of the way, you will need to implement:
  	- asm/ftrace.h:
  		- MCOUNT_ADDR
  		- ftrace_call_adjust()
  		- struct dyn_arch_ftrace{}
  	- asm code:
  		- mcount() (new stub)
  		- ftrace_caller()
  		- ftrace_call()
  		- ftrace_stub()
  	- C code:
  		- ftrace_dyn_arch_init()
  		- ftrace_make_nop()
  		- ftrace_make_call()
  		- ftrace_update_ftrace_func()
  
  First you will need to fill out some arch details in your asm/ftrace.h.
  
  Define MCOUNT_ADDR as the address of your mcount symbol similar to:
  	#define MCOUNT_ADDR ((unsigned long)mcount)
  Since no one else will have a decl for that function, you will need to:
  	extern void mcount(void);
  
  You will also need the helper function ftrace_call_adjust().  Most people
  will be able to stub it out like so:
  	static inline unsigned long ftrace_call_adjust(unsigned long addr)
  	{
  		return addr;
  	}
555f386c9   Mike Frysinger   ftrace: document ...
292
  <details to be filled>
9849ed4d7   Mike Frysinger   tracing/documenta...
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
  Lastly you will need the custom dyn_arch_ftrace structure.  If you need
  some extra state when runtime patching arbitrary call sites, this is the
  place.  For now though, create an empty struct:
  	struct dyn_arch_ftrace {
  		/* No extra data needed */
  	};
  
  With the header out of the way, we can fill out the assembly code.  While we
  did already create a mcount() function earlier, dynamic ftrace only wants a
  stub function.  This is because the mcount() will only be used during boot
  and then all references to it will be patched out never to return.  Instead,
  the guts of the old mcount() will be used to create a new ftrace_caller()
  function.  Because the two are hard to merge, it will most likely be a lot
  easier to have two separate definitions split up by #ifdefs.  Same goes for
  the ftrace_stub() as that will now be inlined in ftrace_caller().
  
  Before we get confused anymore, let's check out some pseudo code so you can
  implement your own stuff in assembly:
555f386c9   Mike Frysinger   ftrace: document ...
311

9849ed4d7   Mike Frysinger   tracing/documenta...
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
  void mcount(void)
  {
  	return;
  }
  
  void ftrace_caller(void)
  {
  	/* implement HAVE_FUNCTION_TRACE_MCOUNT_TEST if you desire */
  
  	/* save all state needed by the ABI (see paragraph above) */
  
  	unsigned long frompc = ...;
  	unsigned long selfpc = <return address> - MCOUNT_INSN_SIZE;
  
  ftrace_call:
  	ftrace_stub(frompc, selfpc);
  
  	/* restore all state needed by the ABI */
  
  ftrace_stub:
  	return;
  }
  
  This might look a little odd at first, but keep in mind that we will be runtime
  patching multiple things.  First, only functions that we actually want to trace
  will be patched to call ftrace_caller().  Second, since we only have one tracer
  active at a time, we will patch the ftrace_caller() function itself to call the
  specific tracer in question.  That is the point of the ftrace_call label.
  
  With that in mind, let's move on to the C code that will actually be doing the
  runtime patching.  You'll need a little knowledge of your arch's opcodes in
  order to make it through the next section.
  
  Every arch has an init callback function.  If you need to do something early on
  to initialize some state, this is the time to do that.  Otherwise, this simple
  function below should be sufficient for most people:
  
  int __init ftrace_dyn_arch_init(void *data)
  {
  	/* return value is done indirectly via data */
  	*(unsigned long *)data = 0;
  
  	return 0;
  }
  
  There are two functions that are used to do runtime patching of arbitrary
  functions.  The first is used to turn the mcount call site into a nop (which
  is what helps us retain runtime performance when not tracing).  The second is
  used to turn the mcount call site into a call to an arbitrary location (but
  typically that is ftracer_caller()).  See the general function definition in
  linux/ftrace.h for the functions:
  	ftrace_make_nop()
  	ftrace_make_call()
  The rec->ip value is the address of the mcount call site that was collected
  by the scripts/recordmcount.pl during build time.
  
  The last function is used to do runtime patching of the active tracer.  This
  will be modifying the assembly code at the location of the ftrace_call symbol
  inside of the ftrace_caller() function.  So you should have sufficient padding
  at that location to support the new function calls you'll be inserting.  Some
  people will be using a "call" type instruction while others will be using a
  "branch" type instruction.  Specifically, the function is:
  	ftrace_update_ftrace_func()
  
  
  HAVE_DYNAMIC_FTRACE + HAVE_FUNCTION_GRAPH_TRACER
  ------------------------------------------------
  
  The function grapher needs a few tweaks in order to work with dynamic ftrace.
  Basically, you will need to:
  	- update:
  		- ftrace_caller()
  		- ftrace_graph_call()
  		- ftrace_graph_caller()
  	- implement:
  		- ftrace_enable_ftrace_graph_caller()
  		- ftrace_disable_ftrace_graph_caller()
555f386c9   Mike Frysinger   ftrace: document ...
389
390
  
  <details to be filled>
9849ed4d7   Mike Frysinger   tracing/documenta...
391
392
393
394
395
396
397
398
399
  Quick notes:
  	- add a nop stub after the ftrace_call location named ftrace_graph_call;
  	  stub needs to be large enough to support a call to ftrace_graph_caller()
  	- update ftrace_graph_caller() to work with being called by the new
  	  ftrace_caller() since some semantics may have changed
  	- ftrace_enable_ftrace_graph_caller() will runtime patch the
  	  ftrace_graph_call location with a call to ftrace_graph_caller()
  	- ftrace_disable_ftrace_graph_caller() will runtime patch the
  	  ftrace_graph_call location with nops