ReiserFS
From Wikipedia, the free encyclopedia
It has been suggested that Namesys be merged into this article or section. (Discuss) |
Developer | Namesys |
---|---|
Full name | ReiserFS |
Introduced | 2001 (Linux 2.4.1) |
Partition identifier | Apple_UNIX_SVR2 (Apple Partition Map) 0x83 (MBR) EBD0A0A2-B9E5-4433-87C0-68B6B72699C7 (GPT) |
Structures | |
Directory contents | B+ tree |
File allocation | Bitmap [1] |
Limits | |
Max file size | 8 TiB [2] |
Max number of files | 232 (~4 billion) [3] |
Max filename length | 4032 bytes, limited to 255 by Linux VFS |
Max volume size | 16 TiB [4] |
Allowed characters in filenames | All bytes except NUL and '/' |
Features | |
Dates recorded | modification (mtime), metadata change (ctime), access (atime) |
Date range | December 14, 1901 - January 18, 2038 |
Date resolution | 1s |
Forks | Extended attributes |
File system permissions | Unix permissions, ACLs and arbitrary security attributes |
Transparent compression | Yes |
Transparent encryption | No |
Supported operating systems | Linux |
ReiserFS is a general-purpose, journaled computer file system designed and implemented by a team at Namesys led by Hans Reiser. ReiserFS is currently supported on Linux. Introduced in version 2.4.1 of the Linux kernel, it was the first journaling file system to be included in the standard kernel. ReiserFS is the default file system on the Elive, Xandros, Linspire, GoboLinux, Kurumin Linux[citation needed], and Yoper Linux distributions. ReiserFS was the default file system in Novell's SUSE Linux Enterprise until Novell decided to move to ext3 on October 12, 2006 for future releases. [1] Although the change was rumored to be a result of principal author Hans Reiser being charged with the murder of his wife (he was later convicted[2] ) two days earlier, SUSE stated that the timing of the announcement was coincidental and unrelated.[3]
Namesys considers ReiserFS (now occasionally referred to as Reiser3) stable and feature-complete and, with the exception of security updates and critical bug fixes, has thus ceased development on it to concentrate on its successor, Reiser4.
Contents |
[edit] Features
At the time of its introduction, ReiserFS offered features that had not been available in existing Linux file systems:
- Metadata-only journaling (also block journaling, since Linux 2.6.8), its most-publicized advantage over what was the stock Linux file system at the time, ext2.
- Online resizing (growth only), with or without an underlying volume manager such as LVM. Since then, Namesys has also provided tools to resize (both grow and shrink) ReiserFS file systems offline.
- Tail packing, a scheme to reduce internal fragmentation. Tail packing, however, can have a significant performance impact. Reiser4 may have improved this by packing tails where it does not hurt performance.[4]
[edit] Performance
Compared with ext2 and ext3 in version 2.4 of the Linux kernel, when dealing with files under 4 KiB and with tail packing enabled, ReiserFS is often faster by a factor of 10–15.[citation needed] This was said to be of great benefit in Usenet news spools, HTTP caches, mail delivery systems and other applications where performance with small files is critical. However, in practice news spools use a feature called cycbuf, which holds articles in one large file; fast HTTP caches and several Source Code Management systems use similar approach, nullifying these performance advantages. For email servers, reiserfs was problematic due to semantics problems explained below. Also, ReiserFS had a problem with very fast filesystem aging when compared to other filesystems - in several usage scenarios filesystem performance lowered dramatically with time.
Because ReiserFS still uses the Big Kernel Lock (BKL) — a global kernel-wide lock — in some places, it does not scale very well for systems with multiple cores, as the critical code parts are only ever executed by one core at a time.[3]
[edit] Criticism
Some directory operations (including unlink(2)) are not synchronous on ReiserFS, which can result in data corruption with applications relying heavily on file-based locks (such as mail transfer agents qmail[5] and Postfix[6]) if the machine halts before it has synchronized the disk.[7]
There are no programs to specifically defragment a ReiserFS file system, although tools have been written to automatically copy the contents of fragmented files hoping that more contiguous blocks of free space can be found. However, Reiser4 will have a repacker that optimizes file fragmentation.[8]
[edit] fsck
The tree rebuild process of ReiserFS's fsck has attracted much criticism: If the file system becomes so badly corrupt that its internal tree is unusable, performing a tree rebuild operation may further corrupt existing files or introduce new entries with unexpected contents.[9] But this action is not part of normal operation or a normal file system check and has to be explicitly initiated and confirmed by the administrator.
ReiserFS v3 images should not be stored on a ReiserFS v3 partition (e.g. backups or disk images for emulators) without transforming them (e.g., by compressing or encrypting) in order to avoid misleading the filesystem. Reformatting an existing ReiserFS v3 partition can also leave behind data that could confuse the rebuild operation and make files from the old system reappear. This also allows malicious users to intentionally store files that will confuse the rebuilder. As the metadata is always in a consistent state after a file system check, corruption here means that contents of files are merged in unexpected ways with the contained file system's metadata. The ReiserFS successor, Reiser4, fixes this problem.
[edit] Earlier issues
ReiserFS in versions of the Linux kernel before 2.4.16 were considered unstable by Namesys and not recommended for production use, especially in conjunction with NFS.[10]
Early implementations of ReiserFS (prior to that in Linux 2.6.2) were also susceptible to out-of-order write hazards. For example, files being appended to during a crash gained a tail of garbage upon next mount.[citation needed] But the current journaling implementation in ReiserFS is now on par with that of ext3's "ordered" journaling level.
[edit] Design
ReiserFS stores file metadata ("stat items"), directory entries ("directory items"), inode block lists ("indirect items"), and tails of files ("direct items") in a single, combined B+ tree keyed by a universal object ID. Disk blocks allocated to nodes of the tree are "formatted internal blocks". Blocks for leaf nodes (in which items are packed end-to-end) are "formatted leaf blocks". All other blocks are "unformatted blocks" containing file contents. Directory items with too many entries or indirect items which are too long to fit into a node spill over into the right leaf neighbour. Block allocation is tracked by free space bitmaps in fixed locations.
By contrast, ext2 and other Berkeley FFS-like file systems of that time simply used a fixed formula for computing inode locations, hence limiting the number of files they may contain.[11] Most such file systems also store directories as simple lists of entries, which makes directory lookups and updates linear time operations and degrades performance on very large directories. The single B+ tree design in ReiserFS avoids both of these problems due to better scalability properties.
[edit] See also
[edit] Notes and references
- ^ Shankland, Stephen (2006-10-12). "Novell makes file storage software shift". Business Tech (c). http://news.com.com/Novell+makes+file-storage+software+shift/2100-1016_3-6125509.html.
- ^ "Jury finds Oakland father guilty of estranged wife's death". San Francisco Chronicle. 2008-04-28. http://www.sfgate.com/cgi-bin/article.cgi?f=/c/a/2008/04/28/BA9O10D8B4.DTL&hw=hans+reiser+verdict&sn=001&sc=1000. Retrieved on 2008-04-28.
- ^ a b Mahoney, Jeff (2006-10-04). "Announcement was unrelated to Reiser's legal troubles". http://linux.wordpress.com/2006/09/27/suse-102-ditching-reiserfs-as-it-default-fs/.
- ^ Reiser, Hans. "Reiser4 is released!". http://www.namesys.com/v4/v4.html#BLOBs. Retrieved on 2006-07-15.
- ^ Daniel Robbins (2001), "Advanced file system implementor's guide". Retrieved 5. July 2006
- ^ Matthias Andree (2001), LKML post on Postfix synchronity assumptions. Retrieved 15. July 2006
- ^ NEOHAPSIS - Peace of Mind Through Integrity and Insight
- ^ Hans Reiser, Reiser4 design, repacker. Retrieved 5. July 2006
- ^ Theodore Ts'o LKML post. Retrieved 5. July 2006
- ^ ReiserFS download page, see warning. Retrieved 5. July 2006
- ^ Mingming Cao, Theodore Y. Ts'o, Badari Pulavarty, Suparna Bhattacharya (2005-07-26). "State of the Art: Where we are with the Ext3 file system". 2005 Linux Symposium, Ottawa, Canada: IBM Linux Technology Center. Retrieved on 2007-03-08.
[edit] External links
- Namesys web site (archived version from 2007 October)
- reiserfsprogs, new $HOME
- Theodore Ts'o critiques the ReiserFS block journaling implementation
- convertfs, a utility which performs in-place conversion between any two file systems with sparse file support
- An overview of the ReiserFS on-disk format
- Florian Buchholz's The structure of the Reiser file system, a very detailed description of the ReiserFS disk structures.
- Gentoo Forum Link - Discussion on ReiserFS fragmentation, including a script for measuring fragmentation and defragmenting files.
- Reiser4 Future Vision
- Windows utilities to access ReiserFS: RFSGUI & RFSTOOL, YAReG - Yet Another R(eiser)FStool GUI