29 Jan, 2008

5 commits


28 Jan, 2008

4 commits

  • Currently you must be root to set idle io prio class on a process. This
    is due to the fact that the idle class is implemented as a true idle
    class, meaning that it will not make progress if someone else is
    requesting disk access. Unfortunately this means that it opens DOS
    opportunities by locking down file system resources, hence it is root
    only at the moment.

    This patch relaxes the idle class a little, by removing the truly idle
    part (which entals a grace period with associated timer). The
    modifications make the idle class as close to zero impact as can be done
    while still guarenteeing progress. This means we can relax the root only
    criteria as well.

    Signed-off-by: Jens Axboe

    Jens Axboe
     
  • Detach task state from ioc, instead keep track of how many processes
    are accessing the ioc.

    Signed-off-by: Jens Axboe

    Jens Axboe
     
  • This is where it belongs and then it doesn't take up space for a
    process that doesn't do IO.

    Signed-off-by: Jens Axboe

    Jens Axboe
     
  • If the users sets a new ->bi_bdev on the bio after __bio_clone() has
    returned it, the "segment counts valid" flag still remains even though
    it may be different with the new target. So don't calculate segment
    counts in __bio_clone().

    Signed-off-by: Jens Axboe

    Jens Axboe
     

27 Jan, 2008

1 commit

  • * git://git.kernel.org/pub/scm/linux/kernel/git/sfrench/cifs-2.6:
    [CIFS] DFS build fixes
    [CIFS] DFS support: provide shrinkable mounts
    [CIFS] Do not log path names in lookup errors
    [CIFS] DFS support patchset: Added mountdata
    [CIFS] Forgot to add two new files from previous commit
    [CIFS] DNS name resolution helper upcall for cifs
    [CIFS] fix checkpatch warnings in fs/cifs/inode.c
    [CIFS] hold ses sem on tcp session reconnect during mount
    [CIFS] Allow setting mode via cifs acl
    [CIFS] fix unicode string alignment in SPNEGO setup
    [CIFS] cifs_partialpagewrite() cleanup
    [CIFS] use krb5 session key from first SMB session after a NegProt
    [CIFS] redo existing session setup if needed in cifs_mount
    [CIFS] Only dump SPNEGO key if CONFIG_CIFS_DEBUG2 is set
    [CIFS] fix SetEA failure to some Samba versions

    Linus Torvalds
     

26 Jan, 2008

30 commits

  • * git://git.kernel.org/pub/scm/linux/kernel/git/jejb/scsi-misc-2.6: (200 commits)
    [SCSI] usbstorage: use last_sector_bug flag universally
    [SCSI] libsas: abstract STP task status into a function
    [SCSI] ultrastor: clean up inline asm warnings
    [SCSI] aic7xxx: fix firmware build
    [SCSI] aacraid: fib context lock for management ioctls
    [SCSI] ch: remove forward declarations
    [SCSI] ch: fix device minor number management bug
    [SCSI] ch: handle class_device_create failure properly
    [SCSI] NCR5380: fix section mismatch
    [SCSI] sg: fix /proc/scsi/sg/devices when no SCSI devices
    [SCSI] IB/iSER: add logical unit reset support
    [SCSI] don't use __GFP_DMA for sense buffers if not required
    [SCSI] use dynamically allocated sense buffer
    [SCSI] scsi.h: add macro for enclosure bit of inquiry data
    [SCSI] sd: add fix for devices with last sector access problems
    [SCSI] fix pcmcia compile problem
    [SCSI] aacraid: add Voodoo Lite class of cards.
    [SCSI] aacraid: add new driver features flags
    [SCSI] qla2xxx: Update version number to 8.02.00-k7.
    [SCSI] qla2xxx: Issue correct MBC_INITIALIZE_FIRMWARE command.
    ...

    Linus Torvalds
     
  • * 'upstream-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/mfasheh/ocfs2: (31 commits)
    ocfs2: clean up bh null checks
    ocfs2: document access rules for blocked_lock_list
    configfs: file.c fix possible recursive locking
    configfs: dir.c fix possible recursive locking
    configfs: Remove EXPERIMENTAL
    ocfs2: bump version number
    ocfs2/dlm: Clear joining_node on hearbeat node down
    ocfs2: convert byte order of constant instead of variable
    ocfs2: Update default cluster timeouts
    ocfs2: printf fixes
    ocfs2: Use generic_file_llseek
    ocfs2: Safer read_inline_data()
    ocfs2: Silence false lockdep warnings
    [PATCH 2/2] ocfs2: cluster aware flock()
    [PATCH 1/2] ocfs2: add flock lock type
    ocfs2: Local alloc window size changeable via mount option
    ocfs2: Support commit= mount option
    ocfs2: Add missing permission checks
    [PATCH 2/2] ocfs2: Implement group add for online resize
    [PATCH 1/2] ocfs2: Add group extend for online resize
    ...

    Linus Torvalds
     
  • If we know a buffer_head is non-null, then brelse() is unnecessary and
    put_bh() can be used instead. Also, an explicit check for NULL is
    unnecessary when using brelse(). This patch only covers buffer_head_io.c and
    resize.c, which have recently added code which exhibits this problem.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • ocfs2_super->blocked_lock_list and ocfs2_super->blocked_lock_count have some
    usage restrictions which aren't immediately obvious to anyone reading the
    code. It's a good idea to document this so that we avoid making costly
    mistakes in the future.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • configfs_register_subsystem() with default_groups triggers recursive locking.
    it seems that mutex_lock_nested is needed.

    =============================================
    [ INFO: possible recursive locking detected ]
    2.6.24-rc6 #145
    ---------------------------------------------
    swapper/1 is trying to acquire lock:
    (&sb->s_type->i_mutex_key#3){--..}, at: [] configfs_add_file+0x2e/0x70

    but task is already holding lock:
    (&sb->s_type->i_mutex_key#3){--..}, at: [] configfs_register_subsystem+0x55/0x130

    other info that might help us debug this:
    1 lock held by swapper/1:
    #0: (&sb->s_type->i_mutex_key#3){--..}, at: [] configfs_register_subsystem+0x55/0x130

    stack backtrace:
    Pid: 1, comm: swapper Not tainted 2.6.24-rc6 #145
    [] show_trace_log_lvl+0x1a/0x30
    [] show_trace+0x12/0x20
    [] dump_stack+0x6e/0x80
    [] __lock_acquire+0xe62/0x1120
    [] lock_acquire+0x82/0xa0
    [] mutex_lock_nested+0x98/0x2e0
    [] configfs_add_file+0x2e/0x70
    [] configfs_create_file+0x2c/0x40
    [] configfs_attach_item+0x139/0x220
    [] configfs_attach_group+0x14/0x140
    [] configfs_attach_group+0xc9/0x140
    [] configfs_register_subsystem+0xc6/0x130
    [] init_netconsole+0x2b6/0x300
    [] kernel_init+0x142/0x320
    [] kernel_thread_helper+0x7/0x14
    =======================

    Signed-off-by: Joonwoo Park
    Signed-off-by: Joel Becker
    Signed-off-by: Mark Fasheh

    Joonwoo Park
     
  • configfs_register_subsystem() with default_groups triggers recursive locking.
    it seems that mutex_lock_nested is needed.

    =============================================
    [ INFO: possible recursive locking detected ]
    2.6.24-rc6 #141
    ---------------------------------------------
    swapper/1 is trying to acquire lock:
    (&sb->s_type->i_mutex_key#3){--..}, at: [] configfs_attach_group+0x4f/0x190

    but task is already holding lock:
    (&sb->s_type->i_mutex_key#3){--..}, at: [] configfs_register_subsystem+0x55/0x130

    other info that might help us debug this:
    1 lock held by swapper/1:
    #0: (&sb->s_type->i_mutex_key#3){--..}, at: [] configfs_register_subsystem+0x55/0x130

    stack backtrace:
    Pid: 1, comm: swapper Not tainted 2.6.24-rc6 #141
    [] show_trace_log_lvl+0x1a/0x30
    [] show_trace+0x12/0x20
    [] dump_stack+0x6e/0x80
    [] __lock_acquire+0xe62/0x1120
    [] lock_acquire+0x82/0xa0
    [] mutex_lock_nested+0x98/0x2e0
    [] configfs_attach_group+0x4f/0x190
    [] configfs_register_subsystem+0xc6/0x130
    [] init_netconsole+0x2b6/0x300
    [] kernel_init+0x142/0x320
    [] kernel_thread_helper+0x7/0x14
    =======================

    Signed-off-by: Joonwoo Park
    Signed-off-by: Joel Becker
    Signed-off-by: Mark Fasheh

    Joonwoo Park
     
  • configfs has been alive and kicking for a while now. It underpins some
    non-EXPERIMENTAL subsystems, such as OCFS2's cluster stack.

    Signed-off-by: Joel Becker
    Signed-off-by: Mark Fasheh

    Joel Becker
     
  • Bump the printed version to 1.5.0. This helps us quickly identify which
    version of Ocfs2 a bug filer is running.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • Currently the process of dlm join contains 2 steps: query join and assert join.
    After query join, the joined node will set its joining_node. So if the joining
    node happens to panic before the 2nd step, the joined node will fail to clear
    its joining_node flag because that node isn't in the domain map. It at least
    cause 2 problems.
    1. All the new join request will fail. So no new node can mount the volume.
    2. The joined node can't umount the volume since during the umount process it
    has to wait for the joining_node to be unknown. So the umount will be hanged.

    The solution is to clear the joining_node before we check the domain map.

    Signed-off-by: Tao Ma
    Signed-off-by: Mark Fasheh

    Tao Ma
     
  • Convert byte order of constant instead of variable it will be done at
    compile time vs run time. Remove unused le32_and_cpu.

    Signed-off-by: Marcin Slusarz
    Signed-off-by: Mark Fasheh

    Marcin Slusarz
     
  • Lots of people are having trouble with the default timeouts, which are too
    low. These new values are derived from an informal survey taken on
    ocfs2-users, as well as data from bug reports. This should reduce the amount
    of cluster disconnects and subsequent fencing seen during normal workloads.

    Signed-off-by: Sunil Mushran
    Signed-off-by: Mark Fasheh

    Sunil Mushran
     
  • Explicitely convert loff_t to long long in printf. Just for sure...

    Signed-off-by: Jan Kara
    Signed-off-by: Mark Fasheh

    Jan Kara
     
  • We should use generic_file_llseek() and not default_llseek() so that
    s_maxbytes gets properly checked when seeking.

    Signed-off-by: Jan Kara
    Signed-off-by: Mark Fasheh

    Jan Kara
     
  • In ocfs2_read_inline_data() we should store file size in loff_t. Although
    the file size should fit in 32 bits we cannot be sure in case filesystem is
    corrupted.

    Signed-off-by: Jan Kara
    Signed-off-by: Mark Fasheh

    Jan Kara
     
  • Create separate lockdep lock classes for system file's i_mutexes. They are
    used to guard allocations and similar things and thus rank differently
    than i_mutex of a regular file or directory.

    Signed-off-by: Jan Kara
    Signed-off-by: Mark Fasheh

    Jan Kara
     
  • Hook up ocfs2_flock(), using the new flock lock type in dlmglue.c. A new
    mount option, "localflocks" is added so that users can revert to old
    functionality as need be.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • This adds a new dlmglue lock type which is intended to back flock()
    requests.

    Since these locks are driven from userspace, usage rules are much more
    liberal than the typical Ocfs2 internal cluster lock. As a result, we can't
    make use of most dlmglue features - lock caching and lock level
    optimizations in particular. Additionally, userspace is free to deadlock
    itself, so we have to deal with that in the same way as the rest of the
    kernel - by allowing a signal to abort a lock request.

    In order to keep ocfs2_cluster_lock() complexity down, ocfs2_file_lock()
    does it's own dlm coordination. We still use the same helper functions
    though, so duplicated code is kept to a minimum.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • Local alloc is a performance optimization in ocfs2 in which a node
    takes a window of bits from the global bitmap and then uses that for
    all small local allocations. This window size is fixed to 8MB currently.
    This patch allows users to specify the window size in MB including
    disabling it by passing in 0. If the number specified is too large,
    the fs will use the default value of 8MB.

    mount -o localalloc=X /dev/sdX /mntpoint

    Signed-off-by: Sunil Mushran
    Signed-off-by: Mark Fasheh

    Sunil Mushran
     
  • Mostly taken from ext3. This allows the user to set the jbd commit interval,
    in seconds. The default of 5 seconds stays the same, but now users can
    easily increase the commit interval. Typically, this would be increased in
    order to benefit performance at the expense of data-safety.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • Check that an online resize is being driven by a user with permission to
    change system resource limits.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • This patch adds the ability for a userspace program to request that a
    properly formatted cluster group be added to the main allocation bitmap for
    an Ocfs2 file system. The request is made via an ioctl, OCFS2_IOC_GROUP_ADD.
    On a high level, this is similar to ext3, but we use a different ioctl as
    the structure which has to be passed through is different.

    During an online resize, tunefs.ocfs2 will format any new cluster groups
    which must be added to complete the resize, and call OCFS2_IOC_GROUP_ADD on
    each one. Kernel verifies that the core cluster group information is valid
    and then does the work of linking it into the global allocation bitmap.

    Signed-off-by: Tao Ma
    Signed-off-by: Mark Fasheh

    Tao Ma
     
  • This patch adds the ability for a userspace program to request an extend of
    last cluster group on an Ocfs2 file system. The request is made via ioctl,
    OCFS2_IOC_GROUP_EXTEND. This is derived from EXT3_IOC_GROUP_EXTEND, but is
    obviously Ocfs2 specific.

    tunefs.ocfs2 would call this for an online-resize operation if the last
    cluster group isn't full.

    Signed-off-by: Tao Ma
    Signed-off-by: Mark Fasheh

    Tao Ma
     
  • This value is initialized from global_bitmap->id2.i_chain.cl_cpg. If there
    is only 1 group, it will be equal to the total clusters in the volume. So
    as for online resize, it should change for all the nodes in the cluster.
    It isn't easy and there is no corresponding lock for it.

    bitmap_cpg is only used in 2 areas:
    1. Check whether the suballoc is too large for us to allocate from the global
    bitmap, so it is little used. And now the suballoc size is 2048, it rarely
    meet this situation and the check is almost useless.
    2. Calculate which group a cluster belongs to. We use it during truncate to
    figure out which cluster group an extent belongs too. But we should be OK
    if we increase it though as the cluster group calculated shouldn't change
    and we only ever have a small bitmap_cpg on file systems with a single
    cluster group.

    Signed-off-by: Tao Ma
    Signed-off-by: Mark Fasheh

    Tao Ma
     
  • Remove 'readpages' from the list in ocfs2.txt. Instead of having two
    identical lists, I just removed the list in the OCFS2 section of fs/Kconfig
    and added a pointer to Documentation/filesystems/ocfs2.txt.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • Add ->readpages support to Ocfs2. This is rather trivial - all it required
    is a small update to ocfs2_get_block (for mapping full extents via b_size)
    and an ocfs2_readpages() function which partially mirrors ocfs2_readpage().

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • Call this the "inode_lock" now, since it covers both data and meta data.
    This patch makes no functional changes.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • The meta lock now covers both meta data and data, so this just removes the
    now-redundant data lock.

    Combining locks saves us a round of lock mastery per inode and one less lock
    to ping between nodes during read/write.

    We don't lose much - since meta locks were always held before a data lock
    (and at the same level) ordered writeout mode (the default) ensured that
    flushing for the meta data lock also pushed out data anyways.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • In order to extend inode lock coverage to inode data, we use the same data
    downconvert worker with only a small modification to only do work for
    regular files.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • The node maps that are set/unset by these votes are no longer relevant, thus
    we can remove the mount and umount votes. Since those are the last two
    remaining votes, we can also remove the entire vote infrastructure.

    The vote thread has been renamed to the downconvert thread, and the small
    amount of functionality related to managing it has been moved into
    fs/ocfs2/dlmglue.c. All references to votes have been removed or updated.

    Signed-off-by: Mark Fasheh

    Mark Fasheh
     
  • Now that the dlm exposes domain information to us, we don't need generic
    node up / node down callbacks. And since the DLM is only telling us when a
    node goes down unexpectedly, we no longer need to optimize away node down
    callbacks via the umount map.

    Signed-off-by: Mark Fasheh

    Mark Fasheh