Changes between Version 3 and Version 4 of DroparconDataManagement

Timestamp:

2013-05-30T13:29:25+02:00 (11 years ago)

Author:

Pieter Neerincx

Comment:

--

DroparconDataManagement

@@ -9 +9 @@
 Data uploaded to the sftp server can be shared freely within Droparcon. If you want to share data with external partners, you need to request and get permission from all members of the steering group, so all groups are informed of the plans. 
 
+== SFTP Server ==
+
+The block size on the storage is relatively large (~ 5MB). Each file -regardless of its real size- will occupy at least 1 block on the file system. Hence the system is optimised to store large files and big genomic data is preferably stored in a few large files  as opposed to a multitude of small files. Typically things like many small logs, scripts, etc. should be compressed into one larger file per project for archiving.
+
 [http://www.molgenis.org/wiki/DataSharing/DataStorage General instructions on how to use the sftp.gcc.rug.nl server]
 
 == Directory structure a.k.a. what is where ==
 
-Droparcon data located on the Groningen cluster is stored in /target/gpfs2/gcc/groups/droparcon/. NOTE: When accessing the site via sftp this will be your root folder. Hence you will be chrooted to /target/gpfs2/gcc/groups/droparcon/, which will appear to be your /. We'll refer to /target/gpfs2/gcc/groups/droparcon/ as ${DROPARCON_HOME}.
+Droparcon data located on the Groningen cluster is stored in 
+{{{
+/target/gpfs2/gcc/groups/droparcon/
+}}}
+We'll refer to /target/gpfs2/gcc/groups/droparcon/ as 
+{{{
+${DROPARCON_HOME}
+}}}
+NOTE: When accessing the site via sftp this will be your root folder. Hence you will be chrooted to /target/gpfs2/gcc/groups/droparcon/, which will appear to be your /. 
 
  * ${DROPARCON_HOME}/**home/(your_account)/**
@@ -22 +34 @@
 
  * ${DROPARCON_HOME}/**projects/**
-    * Processed data like ongoing and finished assemblies
-
- 
+    * Processed data like ongoing and finished assemblies.