dCache.Org eagle
black_bg
home | documentation | downloads | feedback | search | imprint
black_bg



Scope of the project

dCache in EMI

The goal of this project is to provide a system for storing and retrieving huge amounts of data, distributed among a large number of heterogenous server nodes, under a single virtual filesystem tree with a variety of standard access methods. Depending on the Persistency Model, dCache provides methods for exchanging data with backend (tertiary) Storage Systems as well as space management, pool attraction, dataset replication, hot spot determination and recovery from disk or node failures. Connected to a tertiary storage system, the cache simulates unlimited direct access storage space. Data exchanges to and from the underlying HSM are performed automatically and invisibly to the user. Beside HEP specific protocols, data in dCache can be accessed via NFSv4.1 (pNFS) as well as through WebDav.
more ...

Deployment

Golden Release Policy



News

  • WLCG Collaboration workshop was organized by dCache.org at DESY in July 11-13, 2011. (Video Recordings)
  • EMI 1 (Kebnekaise) released. Kebnekaise
  • Great success : 5th dCache workshop in Göttingen, 16/17 March, 2011
  • dCache Articles
  • European Middleware Initiative, EMI started May 2010. Factsheet
  • Security
    • dCache.org is introducing a new mailing list :
      security at dcache dot org
      dCache user should report problems or bugs to this list if there is the suspicion that the issue is security related or if the report may contain confidential information. (e.g. passwords). Only a very restricted number of people have access to this particular mailing list.
  • Newletters and announcements.
  • Chimera :
    In order to be prepared for the first year of LHC datataking, we recommend to upgrade the pnfs filesystem to chimera. Please checkout the migration instructions and give it a try. You can evaluate the entire migration procedure in a safe test environment. Some sites already started the migration end of last year. Up to know, the NDGF Tier I and about 10 dCache Tier II are operating chimera. No problems have been reported yet. More information is available from our documentation area. The main advantages of chimera are :
    • Chimera scales nicely with the hardware performance and the database backend.
    • You may run regular SQL queries to collect maintainance and monitoring information of the chimera filesystem.
    • File system ACL inheritance is only available with Chimera. With pnfs, newly created directory will get the default set of ACL's. With Chimera it will inherit its parent ACLs .
  • The dCache wiki : In addition to the Book, we offer a wiki were you may find some more helpful information. Check the link to findout on how you can contribute to the wiki with advise, documentation or tools.

Releases

Golden Releases
The currently recommended Golden Release 1.9.5 will be supported until the end of the technical LHC break beginning of 2012. In parallel, the next Golden Release (1.9.12) is out and will be supported for an extended period.


Supported and expected Releases
  • 2.0 coming soon
  • Fomerly known as version 1.9.14. Despite the version number increase, the number of changes are not bigger than between usual feature releases. The version number is increased because of changes in the version number format.

    • HTTP Basic Authentication for WebDAV.
    • Reduced latency for server side srmCopy.
    • ACL admin service integrated into pnfs manager.
    • Wildcards in pool manager commands.
    • SRM client's overwrite request can be honored without having to enable overwrite in other doors.
    • Pool to pool transfers use HTTP rather than DCAP.
    • Pluggable pool selection algorithm and a new write pool selection algorithm.
    • Lots of work on the webadmin component.
  • 1.9.13 is out
    • Reduced latency in pool selection, pinning, Chimera authorization, and single file listing through SRM.
    • Continous background checksum verification in pools.
    • Support SRM_FILE_UNAVAILABLE in SRM.
    • POSIX compliant lookup permissions checks for Chimera.
    • Space manager database performance improvements.
    • SRM can optionally skip pinning for ONLINE files.
    • SRM can optionally work without pin manager in installations without tape.
    • Plain text FTP can use gPlazma for authentication.
  • 1.9.12 Golden Release II, recommended
    • Supported until April 2013.
    • The ultimate dCache Golden Release upgrade guide by Gerd (NDGF).
    • GLUE 2 support.
    • New pin manager.
    • HTTP support for third party srmCopy transfers.
    • Proxy certificate and VOMS support in the HTTP/WebDAV door.
    • Reduced file open latency.
    • gPlazma 2 with ARGUS black listing.
  • 1.9.11 supported
  • 1.9.6 to 1.9.10 are deprecated.
  • 1.9.5 Golden Release will be supported until the end of the technical break primo 2012.
  • 1.9.4 and below are deprecated.
General Release Policy
  • Time Based Releases : The dCache project is moving away from feature based releases towards Time Based Releases. As the name already implices, this essentially means that we will be better in predicting when a release is being published. The drawback is that features which don't make it into the repository till some time before the release is due, just won't be part of that release. The advantage is that sites can do better planing in upgrading and that the synchronization with our distributors is eased.

Funding

Information, Contact, Mailing lists

Documentation : Publications, Presentations and more

dCache, the Book

More on mailing lists
Contact : or
More : The dCache wiki

Project Partners

dCache is a joint venture between the Deutsches Elektronen-Synchrotron, DESY, the Fermi National Accelerator Laboratory, FNAL and the Nordic Data Grid Facility, NDGF.

Project Status

Since end of 2001 our full production release is in use at an increasing number of sites world-wide and is delivering tera bytes of data from over hundreds of distributed server nodes.
black_bg
Copyright dCache.org © 2003 - 2012