Blame view
Documentation/filesystems/fuse.rst
15.8 KB
8ab13bca4 Documentation: fi... |
1 |
.. SPDX-License-Identifier: GPL-2.0 |
3b31589c7 docs: filesystems... |
2 3 |
==== |
8ab13bca4 Documentation: fi... |
4 |
FUSE |
3b31589c7 docs: filesystems... |
5 |
==== |
8ab13bca4 Documentation: fi... |
6 |
|
334f485df [PATCH] FUSE - de... |
7 |
Definitions |
8ab13bca4 Documentation: fi... |
8 |
=========== |
334f485df [PATCH] FUSE - de... |
9 10 |
Userspace filesystem: |
334f485df [PATCH] FUSE - de... |
11 12 13 14 15 |
A filesystem in which data and metadata are provided by an ordinary userspace process. The filesystem can be accessed normally through the kernel interface. Filesystem daemon: |
334f485df [PATCH] FUSE - de... |
16 17 18 |
The process(es) providing the data and metadata of the filesystem. Non-privileged mount (or user mount): |
334f485df [PATCH] FUSE - de... |
19 20 21 22 |
A userspace filesystem mounted by a non-privileged (non-root) user. The filesystem daemon is running with the privileges of the mounting user. NOTE: this is not the same as mounts allowed with the "user" option in /etc/fstab, which is not discussed here. |
bafa96541 [PATCH] fuse: add... |
23 |
Filesystem connection: |
bafa96541 [PATCH] fuse: add... |
24 25 26 |
A connection between the filesystem daemon and the kernel. The connection exists until either the daemon dies, or the filesystem is umounted. Note that detaching (or lazy umounting) the filesystem |
8ab13bca4 Documentation: fi... |
27 |
does *not* break the connection, in this case it will exist until |
bafa96541 [PATCH] fuse: add... |
28 |
the last reference to the filesystem is released. |
334f485df [PATCH] FUSE - de... |
29 |
Mount owner: |
334f485df [PATCH] FUSE - de... |
30 31 32 |
The user who does the mounting. User: |
334f485df [PATCH] FUSE - de... |
33 34 35 |
The user who is performing filesystem operations. What is FUSE? |
8ab13bca4 Documentation: fi... |
36 |
============= |
334f485df [PATCH] FUSE - de... |
37 38 39 40 41 42 43 44 45 |
FUSE is a userspace filesystem framework. It consists of a kernel module (fuse.ko), a userspace library (libfuse.*) and a mount utility (fusermount). One of the most important features of FUSE is allowing secure, non-privileged mounts. This opens up new possibilities for the use of filesystems. A good example is sshfs: a secure network filesystem using the sftp protocol. |
8ab13bca4 Documentation: fi... |
46 |
The userspace library and utilities are available from the |
c1b0c6271 fuse: update proj... |
47 |
`FUSE homepage: <https://github.com/libfuse/>`_ |
334f485df [PATCH] FUSE - de... |
48 |
|
d6392f873 [PATCH] fuse: add... |
49 |
Filesystem type |
8ab13bca4 Documentation: fi... |
50 |
=============== |
d6392f873 [PATCH] fuse: add... |
51 52 |
The filesystem type given to mount(2) can be one of the following: |
8ab13bca4 Documentation: fi... |
53 54 55 56 |
fuse This is the usual way to mount a FUSE filesystem. The first argument of the mount system call may contain an arbitrary string, which is not interpreted by the kernel. |
d6392f873 [PATCH] fuse: add... |
57 |
|
8ab13bca4 Documentation: fi... |
58 59 60 |
fuseblk The filesystem is block device based. The first argument of the mount system call is interpreted as the name of the device. |
d6392f873 [PATCH] fuse: add... |
61 |
|
334f485df [PATCH] FUSE - de... |
62 |
Mount options |
8ab13bca4 Documentation: fi... |
63 |
============= |
334f485df [PATCH] FUSE - de... |
64 |
|
8ab13bca4 Documentation: fi... |
65 |
fd=N |
334f485df [PATCH] FUSE - de... |
66 67 68 |
The file descriptor to use for communication between the userspace filesystem and the kernel. The file descriptor must have been obtained by opening the FUSE device ('/dev/fuse'). |
8ab13bca4 Documentation: fi... |
69 |
rootmode=M |
334f485df [PATCH] FUSE - de... |
70 |
The file mode of the filesystem's root in octal representation. |
8ab13bca4 Documentation: fi... |
71 |
user_id=N |
334f485df [PATCH] FUSE - de... |
72 |
The numeric user id of the mount owner. |
8ab13bca4 Documentation: fi... |
73 |
group_id=N |
334f485df [PATCH] FUSE - de... |
74 |
The numeric group id of the mount owner. |
8ab13bca4 Documentation: fi... |
75 |
default_permissions |
334f485df [PATCH] FUSE - de... |
76 |
By default FUSE doesn't check file access permissions, the |
a33f32244 Documentation/: i... |
77 |
filesystem is free to implement its access policy or leave it to |
334f485df [PATCH] FUSE - de... |
78 79 |
the underlying file access mechanism (e.g. in case of network filesystems). This option enables permission checking, restricting |
91f6e54b6 [PATCH] fuse: fix... |
80 81 |
access based on file mode. It is usually useful together with the 'allow_other' mount option. |
334f485df [PATCH] FUSE - de... |
82 |
|
8ab13bca4 Documentation: fi... |
83 |
allow_other |
334f485df [PATCH] FUSE - de... |
84 85 86 87 |
This option overrides the security measure restricting file access to the user mounting the filesystem. This option is by default only allowed to root, but this restriction can be removed with a (userspace) configuration option. |
8ab13bca4 Documentation: fi... |
88 |
max_read=N |
334f485df [PATCH] FUSE - de... |
89 90 91 |
With this option the maximum size of read operations can be set. The default is infinite. Note that the size of read requests is limited anyway to 32 pages (which is 128kbyte on i386). |
8ab13bca4 Documentation: fi... |
92 |
blksize=N |
d80916140 [PATCH] fuse: add... |
93 94 |
Set the block size for the filesystem. The default is 512. This option is only valid for 'fuseblk' type mounts. |
bafa96541 [PATCH] fuse: add... |
95 |
Control filesystem |
8ab13bca4 Documentation: fi... |
96 |
================== |
bafa96541 [PATCH] fuse: add... |
97 |
|
8ab13bca4 Documentation: fi... |
98 |
There's a control filesystem for FUSE, which can be mounted by:: |
bacac382f [PATCH] fuse: upd... |
99 |
|
bafa96541 [PATCH] fuse: add... |
100 |
mount -t fusectl none /sys/fs/fuse/connections |
bacac382f [PATCH] fuse: upd... |
101 |
|
bafa96541 [PATCH] fuse: add... |
102 103 |
Mounting it under the '/sys/fs/fuse/connections' directory makes it backwards compatible with earlier versions. |
bacac382f [PATCH] fuse: upd... |
104 |
|
bafa96541 [PATCH] fuse: add... |
105 106 |
Under the fuse control filesystem each connection has a directory named by a unique number. |
bacac382f [PATCH] fuse: upd... |
107 |
|
bafa96541 [PATCH] fuse: add... |
108 |
For each connection the following files exist within this directory: |
bacac382f [PATCH] fuse: upd... |
109 |
|
8ab13bca4 Documentation: fi... |
110 111 112 113 114 |
waiting The number of requests which are waiting to be transferred to userspace or being processed by the filesystem daemon. If there is no filesystem activity and 'waiting' is non-zero, then the filesystem is hung or deadlocked. |
bacac382f [PATCH] fuse: upd... |
115 |
|
8ab13bca4 Documentation: fi... |
116 117 118 119 |
abort Writing anything into this file will abort the filesystem connection. This means that all waiting requests will be aborted an error returned for all aborted and new requests. |
bacac382f [PATCH] fuse: upd... |
120 |
|
bafa96541 [PATCH] fuse: add... |
121 |
Only the owner of the mount may read or write these files. |
bacac382f [PATCH] fuse: upd... |
122 |
|
a4d27e75f [PATCH] fuse: add... |
123 |
Interrupting filesystem operations |
8ab13bca4 Documentation: fi... |
124 |
################################## |
a4d27e75f [PATCH] fuse: add... |
125 126 127 |
If a process issuing a FUSE filesystem request is interrupted, the following will happen: |
8ab13bca4 Documentation: fi... |
128 |
- If the request is not yet sent to userspace AND the signal is |
a4d27e75f [PATCH] fuse: add... |
129 130 |
fatal (SIGKILL or unhandled fatal signal), then the request is dequeued and returns immediately. |
8ab13bca4 Documentation: fi... |
131 132 |
- If the request is not yet sent to userspace AND the signal is not fatal, then an interrupted flag is set for the request. When |
fa00e7e15 Fix typos in /Doc... |
133 |
the request has been successfully transferred to userspace and |
a4d27e75f [PATCH] fuse: add... |
134 |
this flag is set, an INTERRUPT request is queued. |
8ab13bca4 Documentation: fi... |
135 |
- If the request is already sent to userspace, then an INTERRUPT |
a4d27e75f [PATCH] fuse: add... |
136 137 138 139 140 141 |
request is queued. INTERRUPT requests take precedence over other requests, so the userspace filesystem will receive queued INTERRUPTs before any others. The userspace filesystem may ignore the INTERRUPT requests entirely, |
8ab13bca4 Documentation: fi... |
142 |
or may honor them by sending a reply to the *original* request, with |
a4d27e75f [PATCH] fuse: add... |
143 144 145 |
the error set to EINTR. It is also possible that there's a race between processing the |
a33f32244 Documentation/: i... |
146 |
original request and its INTERRUPT request. There are two possibilities: |
a4d27e75f [PATCH] fuse: add... |
147 |
|
8ab13bca4 Documentation: fi... |
148 |
1. The INTERRUPT request is processed before the original request is |
a4d27e75f [PATCH] fuse: add... |
149 |
processed |
8ab13bca4 Documentation: fi... |
150 |
2. The INTERRUPT request is processed after the original request has |
a4d27e75f [PATCH] fuse: add... |
151 152 153 154 155 156 157 |
been answered If the filesystem cannot find the original request, it should wait for some timeout and/or a number of new requests to arrive, after which it should reply to the INTERRUPT request with an EAGAIN error. In case 1) the INTERRUPT request will be requeued. In case 2) the INTERRUPT reply will be ignored. |
bacac382f [PATCH] fuse: upd... |
158 |
Aborting a filesystem connection |
8ab13bca4 Documentation: fi... |
159 |
================================ |
bacac382f [PATCH] fuse: upd... |
160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 |
It is possible to get into certain situations where the filesystem is not responding. Reasons for this may be: a) Broken userspace filesystem implementation b) Network connection down c) Accidental deadlock d) Malicious deadlock (For more on c) and d) see later sections) In either of these cases it may be useful to abort the connection to the filesystem. There are several ways to do this: - Kill the filesystem daemon. Works in case of a) and b) - Kill the filesystem daemon and all users of the filesystem. Works in all cases except some malicious deadlocks - Use forced umount (umount -f). Works in all cases but only if filesystem is still attached (it hasn't been lazy unmounted) |
bafa96541 [PATCH] fuse: add... |
184 185 |
- Abort filesystem through the FUSE control filesystem. Most powerful method, always works. |
bacac382f [PATCH] fuse: upd... |
186 |
|
334f485df [PATCH] FUSE - de... |
187 |
How do non-privileged mounts work? |
8ab13bca4 Documentation: fi... |
188 |
================================== |
334f485df [PATCH] FUSE - de... |
189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 |
Since the mount() system call is a privileged operation, a helper program (fusermount) is needed, which is installed setuid root. The implication of providing non-privileged mounts is that the mount owner must not be able to use this capability to compromise the system. Obvious requirements arising from this are: A) mount owner should not be able to get elevated privileges with the help of the mounted filesystem B) mount owner should not get illegitimate access to information from other users' and the super user's processes C) mount owner should not be able to induce undesired behavior in other users' or the super user's processes How are requirements fulfilled? |
8ab13bca4 Documentation: fi... |
207 |
=============================== |
334f485df [PATCH] FUSE - de... |
208 209 |
A) The mount owner could gain elevated privileges by either: |
8ab13bca4 Documentation: fi... |
210 |
1. creating a filesystem containing a device file, then opening this device |
334f485df [PATCH] FUSE - de... |
211 |
|
8ab13bca4 Documentation: fi... |
212 |
2. creating a filesystem containing a suid or sgid application, then executing this application |
334f485df [PATCH] FUSE - de... |
213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 |
The solution is not to allow opening device files and ignore setuid and setgid bits when executing programs. To ensure this fusermount always adds "nosuid" and "nodev" to the mount options for non-privileged mounts. B) If another user is accessing files or directories in the filesystem, the filesystem daemon serving requests can record the exact sequence and timing of operations performed. This information is otherwise inaccessible to the mount owner, so this counts as an information leak. The solution to this problem will be presented in point 2) of C). C) There are several ways in which the mount owner can induce undesired behavior in other users' processes, such as: 1) mounting a filesystem over a file or directory which the mount owner could otherwise not be able to modify (or could only make limited modifications). This is solved in fusermount, by checking the access permissions on the mountpoint and only allowing the mount if the mount owner can do unlimited modification (has write access to the mountpoint, and mountpoint is not a "sticky" directory) 2) Even if 1) is solved the mount owner can change the behavior of other users' processes. i) It can slow down or indefinitely delay the execution of a |
8ab13bca4 Documentation: fi... |
244 245 246 247 248 |
filesystem operation creating a DoS against the user or the whole system. For example a suid application locking a system file, and then accessing a file on the mount owner's filesystem could be stopped, and thus causing the system file to be locked forever. |
334f485df [PATCH] FUSE - de... |
249 250 |
ii) It can present files or directories of unlimited length, or |
8ab13bca4 Documentation: fi... |
251 252 253 |
directory structures of unlimited depth, possibly causing a system process to eat up diskspace, memory or other resources, again causing *DoS*. |
334f485df [PATCH] FUSE - de... |
254 255 256 257 258 259 260 261 |
The solution to this as well as B) is not to allow processes to access the filesystem, which could otherwise not be monitored or manipulated by the mount owner. Since if the mount owner can ptrace a process, it can do all of the above without using a FUSE mount, the same criteria as used in ptrace can be used to check if a process is allowed to access the filesystem or not. |
8ab13bca4 Documentation: fi... |
262 |
Note that the *ptrace* check is not strictly necessary to |
334f485df [PATCH] FUSE - de... |
263 264 |
prevent B/2/i, it is enough to check if mount owner has enough privilege to send signal to the process accessing the |
8ab13bca4 Documentation: fi... |
265 |
filesystem, since *SIGSTOP* can be used to get a similar effect. |
334f485df [PATCH] FUSE - de... |
266 267 |
I think these limitations are unacceptable? |
8ab13bca4 Documentation: fi... |
268 |
=========================================== |
334f485df [PATCH] FUSE - de... |
269 270 271 |
If a sysadmin trusts the users enough, or can ensure through other measures, that system processes will never enter non-privileged |
8ab13bca4 Documentation: fi... |
272 |
mounts, it can relax the last limitation with a 'user_allow_other' |
334f485df [PATCH] FUSE - de... |
273 |
config option. If this config option is set, the mounting user can |
8ab13bca4 Documentation: fi... |
274 |
add the 'allow_other' mount option which disables the check for other |
334f485df [PATCH] FUSE - de... |
275 276 277 |
users' processes. Kernel - userspace interface |
8ab13bca4 Documentation: fi... |
278 |
============================ |
334f485df [PATCH] FUSE - de... |
279 280 |
The following diagram shows how a filesystem operation (in this |
8ab13bca4 Documentation: fi... |
281 |
example unlink) is performed in FUSE. :: |
334f485df [PATCH] FUSE - de... |
282 |
|
334f485df [PATCH] FUSE - de... |
283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 |
| "rm /mnt/fuse/file" | FUSE filesystem daemon | | | | >sys_read() | | >fuse_dev_read() | | >request_wait() | | [sleep on fc->waitq] | | | >sys_unlink() | | >fuse_unlink() | | [get request from | | fc->unused_list] | | >request_send() | | [queue req on fc->pending] | | [wake up fc->waitq] | [woken up] | >request_wait_answer() | | [sleep on req->waitq] | | | <request_wait() | | [remove req from fc->pending] | | [copy req to read buffer] | | [add req to fc->processing] | | <fuse_dev_read() | | <sys_read() | | | | [perform unlink] | | | | >sys_write() | | >fuse_dev_write() | | [look up req in fc->processing] | | [remove from fc->processing] | | [copy write buffer to req] | [woken up] | [wake up req->waitq] | | <fuse_dev_write() | | <sys_write() | <request_wait_answer() | | <request_send() | | [add request to | | fc->unused_list] | | <fuse_unlink() | | <sys_unlink() | |
8ab13bca4 Documentation: fi... |
323 |
.. note:: Everything in the description above is greatly simplified |
334f485df [PATCH] FUSE - de... |
324 325 326 |
There are a couple of ways in which to deadlock a FUSE filesystem. Since we are talking about unprivileged userspace programs, something must be done about these. |
8ab13bca4 Documentation: fi... |
327 |
**Scenario 1 - Simple deadlock**:: |
334f485df [PATCH] FUSE - de... |
328 329 330 331 332 333 334 335 336 337 338 339 340 |
| "rm /mnt/fuse/file" | FUSE filesystem daemon | | | >sys_unlink("/mnt/fuse/file") | | [acquire inode semaphore | | for "file"] | | >fuse_unlink() | | [sleep on req->waitq] | | | <sys_read() | | >sys_unlink("/mnt/fuse/file") | | [acquire inode semaphore | | for "file"] | | *DEADLOCK* |
51eb01e73 [PATCH] fuse: no ... |
341 |
The solution for this is to allow the filesystem to be aborted. |
334f485df [PATCH] FUSE - de... |
342 |
|
8ab13bca4 Documentation: fi... |
343 |
**Scenario 2 - Tricky deadlock** |
334f485df [PATCH] FUSE - de... |
344 345 346 |
This one needs a carefully crafted filesystem. It's a variation on the above, only the call back to the filesystem is not explicit, |
8ab13bca4 Documentation: fi... |
347 |
but is caused by a pagefault. :: |
334f485df [PATCH] FUSE - de... |
348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 |
| Kamikaze filesystem thread 1 | Kamikaze filesystem thread 2 | | | [fd = open("/mnt/fuse/file")] | [request served normally] | [mmap fd to 'addr'] | | [close fd] | [FLUSH triggers 'magic' flag] | [read a byte from addr] | | >do_page_fault() | | [find or create page] | | [lock page] | | >fuse_readpage() | | [queue READ request] | | [sleep on req->waitq] | | | [read request to buffer] | | [create reply header before addr] | | >sys_write(addr - headerlength) | | >fuse_dev_write() | | [look up req in fc->processing] | | [remove from fc->processing] | | [copy write buffer to req] | | >do_page_fault() | | [find or create page] | | [lock page] | | * DEADLOCK * |
8ab13bca4 Documentation: fi... |
372 |
The solution is basically the same as above. |
334f485df [PATCH] FUSE - de... |
373 |
|
a4d27e75f [PATCH] fuse: add... |
374 375 376 377 |
An additional problem is that while the write buffer is being copied to the request, the request must not be interrupted/aborted. This is because the destination address of the copy may not be valid after the request has returned. |
334f485df [PATCH] FUSE - de... |
378 |
|
51eb01e73 [PATCH] fuse: no ... |
379 380 381 382 |
This is solved with doing the copy atomically, and allowing abort while the page(s) belonging to the write buffer are faulted with get_user_pages(). The 'req->locked' flag indicates when the copy is taking place, and abort is delayed until this flag is unset. |