Patch cvmfs client to support using shared alien cache on lustre, hadoop-fs, and dCache

Description

For about 6 months I and others have been researching configuring the cvmfs client to share an "alien" cache between worker nodes on local high speed storage, for the purpose of distributing what we call "auxiliary" data files. These data files are used by multiple jobs, but not by all jobs in a batch. We have succeeded in scale tests on lustre & hadoop at the University of Nebraska and on dCache at Fermilab. In addition we have a high speed stratum 1 on dCache in Nebraska. This has required a series of small patches to the cvmfs client to get them working properly. All of the patches are in the cvmfs-2.1.20 client that is now in testing upstream. Meanwhile we want to install the patched cvmfs-2.1.19 on a large number of production worker nodes at Fermilab, and in order to do that the administrators require software released through OSG. So this ticket is for tracking that process. The changes should have no affect on existing users, only on those that configure an alien cache for some repositories.

Freshdesk Tickets

None

Assignee

Suchandra Thapa

Reporter

Dave Dykstra

Priority

Minor

Labels

Components

Fix versions

Epic Link

None

Sprint

None
Configure