Tests on dCache 1.6.5-2

Spinoso V. - Donvito G.
INFN Bari

SEPTEMBER 1, 2005

Contents

• 1 Starting notes
• 2 Test suite
  • 2.1 Directory listing on dCache server via SRM: SUCCESSFUL
  • 2.2 Copy local fs -> dCache server via SRM: SUCCESSFUL
  • 2.3 Directory listing on dCache server via SRM, verifying the presence of the copied file: SUCCESSFUL
  • 2.4 Multiple access to the same file by many applications (deleting while transferring file): SUCCESSFUL
  • 2.5 Copy local fs -> dCache server via SRM, into a nonexistent directory: SUCCESSFUL
  • 2.6 Copy dCache server -> same dCache server via SRM: SUCCESSFUL
  • 2.7 Getting files stored on a removed pool (killing dcache-pool): SUCCESSFUL
  • 2.8 Interrupting transfer of a big file: SUCCESSFUL
  • 2.9 File access through many protocols: SUCCESSFUL
  • 2.10 Manipulating fs and permissions: SUCCESSFUL
  • 2.11 Remote copy, interaction among many SRM: SUCCESSFUL
  • 2.12 Multiple requests: SUCCESSFUL
  
  
• 3 Failure test
  • 3.1 Crashing postgresql while PreparetoPut: SUCCESSFUL
  • 3.2 Crashing a file server: SUCCESSFUL
  
  
• About this document ...

1 Starting notes

We remember:

a) srmcp doesn't allow overwriting an homonym file already stored on dCache server;

b) otherwise, srmcp overwrites WITHOUT WARNING an homonym file stored on local fs.

This test uses dCache 1.6.5-2.

2 Test suite

2.1 Directory listing on dCache server via SRM: SUCCESSFUL

[donvito@gridba1 ]$ /opt/d-cache/srm/bin/gridftplist gsiftp://alicegrid4.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/

-rw               13          2prova175rgrg

-rw               0           test10

-rw               12686       file_phed

-rw               13          2prova175

-rw               1128167400  test_big1

-rw               225633480   test9223

-rw               225633480   test9248

-rw               112816740   2prova1fdgsgfsdfsdfs

-rw               225633480   test1

-rw               2184        test2435

-rw               13          2prova12445655432

-rw               210         higz_windows.dat

-rw               0           test12

-rw               225633480   test2

-rw               112816740   2prova1fdgsg

-rw               1128167400  test_big2

-rw               42          fvdfvrgfer

-rw               1128167400  test_big

-rw               225633480   test3

-r-               79          test_kill

-rw               112816740   2prova1fdgsgfsdf

-rw               225633480   test4

drw               512         bt_NoPU8713_TkMu_2_g133_OSC

-rw               1128167400  test_big3

-rw               79          test_kill1

-rw               2884        infn_cert_240.tar.gz

-rw               225633480   test5

-rw               2184        test24354

-rw               2184        test243545

-rw               225633480   test92483265

-rw               225633480   test92482454

-rw               225633480   test922

-rw               1           very_big

-rw               225633480   test6

-rw               60643264    prova_dpm

-rw               9099264     test924832

-rw               0           test7

-rw               225633480   test924832653

-rw               13          2prova124456554

-rw               0           test8

-rw               0           test91

-rw               0           test9

-rw               225633480   test924824

-rw               0           test92

[donvito@gridba1 ]$

2.2 Copy local fs -> dCache server via SRM: SUCCESSFUL

[donvito@gridba1 donvito]$ /opt/d-cache/srm/bin/srmcp 

   file:////home/donvito/test_short

   srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/test_short

Storage Resource Manager (SRM) CP Client version 1.17

Copyright (c) 2002-2005 Fermi National Accelerator Laborarory

SRM Configuration:

        debug=true

        gsissl=true

        help=false

        pushmode=false

        userproxy=true

        buffer_size=131072

        tcp_buffer_size=0

        stream_num=10

        config_file=/home/donvito//.srmconfig/config.xml

        glue_mapfile=/opt/d-cache/srm/conf/SRMServerV1.map

        webservice_path=srm/managerv1.wsdl

        webservice_protocol=https

        gsiftpclinet=globus-url-copy

        protocols_list=http,gsiftp

        save_config_file=null

        srmcphome=/opt/d-cache/srm

        urlcopy=/opt/d-cache/srm/sbin/url-copy.sh

        x509_user_cert=/home/donvito//.globus/usercert.pem

        x509_user_key=/home/donvito//.globus/userkey.pem

        x509_user_proxy=/tmp/x509up_u5003

        x509_user_trusted_certificates=/etc/grid-security/certificates

        retry_num=20

        retry_timeout=10000

        wsdl_url=null

        use_urlcopy_script=false

        connect_to_wsdl=false

        delegate=true

        full_delegation=true

        from[0]=file:////home/donvito/test_short

        to=srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/test_short

Thu Sep 01 12:10:58 CEST 2005: starting SRMPutClient

Thu Sep 01 12:10:58 CEST 2005: SRMClient(https,srm/managerv1.wsdl,true)

Thu Sep 01 12:10:58 CEST 2005: connecting to server

Thu Sep 01 12:10:58 CEST 2005: connected to server, obtaining proxy

SRMClientV1 : connecting to srm at httpg://alicegrid4.ba.infn.it:8443/srm/managerv1

Thu Sep 01 12:10:59 CEST 2005: got proxy of type class org.dcache.srm.client.SRMClientV1

SRMClientV1 :   put, sources[0]="/home/donvito/test_short"

SRMClientV1 :   put, dests[0]="srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/test_short"

doneAddingJobs is false

SRMClientV1 :   put, protocols[0]="http"

SRMClientV1 :   put, protocols[1]="dcap"

SRMClientV1 :   put, protocols[2]="gsiftp"

copy_jobs is empty

SRMClientV1 :  put, contacting service httpg://alicegrid4.ba.infn.it:8443/srm/managerv1

Thu Sep 01 12:11:02 CEST 2005:  srm returned requestId = -2147483052

Thu Sep 01 12:11:02 CEST 2005: sleeping 1 seconds ...

Thu Sep 01 12:11:04 CEST 2005: FileRequestStatus with SURL=srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/test_short is Ready

Thu Sep 01 12:11:04 CEST 2005:        received TURL=gsiftp://pccms6.cmsfarm1.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/test_short

doneAddingJobs is false

copy_jobs is not empty

copying CopyJob, source = file:////home/donvito/test_short destination = gsiftp://pccms6.cmsfarm1.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/test_short

GridftpClient: memory buffer size is set to 131072

GridftpClient: connecting to pccms6.cmsfarm1.ba.infn.it on port 2811

GridftpClient: gridFTPClient tcp buffer size is set to 0

GridftpClient: gridFTPWrite started, source file is java.io.RandomAccessFile@d24e3f destination path is /pnfs/ba.infn.it/data/cms/test_short

GridftpClient: gridFTPWrite started, destination path is /pnfs/ba.infn.it/data/cms/test_short

GridftpClient: parallelism: 10

GridftpClient: adler 32 for file java.io.RandomAccessFile@d24e3f is 866587236

GridftpClient: waiting for completion of transfer

GridftpClient: gridFtpWrite: starting the transfer in emode to /pnfs/ba.infn.it/data/cms/test_short

GridftpClient: DiskDataSink.close() called

GridftpClient: gridFTPWrite() wrote 12686bytes

GridftpClient: closing client : org.dcache.srm.util.GridftpClient$FnalGridFTPClient@7cd37a

GridftpClient: closed client

execution of CopyJob, 

   source = file:////home/donvito/test_short 

   destination = gsiftp://pccms6.cmsfarm1.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/test_short 

   completed

setting file request -2147483051 status to Done

doneAddingJobs is true

copy_jobs is empty

stopping copier

2.3 Directory listing on dCache server via SRM, verifying the presence of the copied file: SUCCESSFUL

[donvito@gridba1 donvito]$ /opt/d-cache/srm/bin/gridftplist

   gsiftp://alicegrid4.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/

-rw               13          2prova175rgrg

-rw               0           test10

-rw               12686       file_phed

-rw               13          2prova175

-r-               1128167400  test_big1

-rw               225633480   test9223

-rw               225633480   test9248

-rw               112816740   2prova1fdgsgfsdfsdfs

-rw               225633480   test1

-rw               2184        test2435

-rw               13          2prova12445655432

-r-               210         higz_windows.dat

-rw               0           test12

-rw               225633480   test2

-rw               112816740   2prova1fdgsg

-r-               1128167400  test_big2

-r-               42          fvdfvrgfer

-r-               1128167400  test_big

-rw               225633480   test3

-rw               79          test_kill

-rw               112816740   2prova1fdgsgfsdf

-rw               225633480   test4

dr-               512         bt_NoPU8713_TkMu_2_g133_OSC

-r-               1128167400  test_big3

-r-               79          test_kill1

-r-               2884        infn_cert_240.tar.gz

-rw               225633480   test5

-rw               2184        test243545

-rw               225633480   test92483265

-rw               12686       test_small

-rw               225633480   test92482454

-rw               225633480   test922

-r-               1           very_big

-rw               225633480   test6

-r-               60643264    prova_dpm

-rw               9099264     test924832

-rw               0           test7

-rw               225633480   test924832653

-rw               13          2prova124456554

-rw               0           test8

-rw               0           test91

-rw               0           test9

-rw               12686       test_small_777

-rw               12686       test_short

-rw               225633480   test924824

-rw               0           test92

2.4 Multiple access to the same file by many applications (deleting while transferring file): SUCCESSFUL

This tests SRM pinning features. Started a copy dCache server -> local fs via SRM, we tried to delete the same file on the dCache pool using a second shell.

(sh 1):$ /opt/d-cache/srm/bin/srmcp

   srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/bigfile

   file:////home/donvito/test_big22

&

(sh 2):$ /opt/d-cache/srm/bin/srm-advisory-delete

   srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/bigfile

When (sh 2) returned, and while (sh 1) still transfering, we run gridftplist:

(sh 2):$ [donvito@gridba1 donvito]$ /opt/d-cache/srm/bin/gridftplist 

   gsiftp://alicegrid4.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/

-rw               12686       test_short2

-rw               13          2prova175rgrg

-rw               0           test10

-rw               12686       file_phed

-rw               13          2prova175

-r-               1128167400  test_big1

-rw               225633480   test9223

-rw               225633480   test9248

-rw               112816740   2prova1fdgsgfsdfsdfs

-rw               225633480   test1

-rw               2184        test2435

-rw               13          2prova12445655432

-r-               210         higz_windows.dat

-rw               0           test12

-rw               225633480   test2

-rw               112816740   2prova1fdgsg

-r-               1128167400  test_big2

-r-               42          fvdfvrgfer

-r-               1128167400  test_big

-rw               225633480   test3

-rw               79          test_kill

-rw               112816740   2prova1fdgsgfsdf

-rw               225633480   test4

dr-               512         bt_NoPU8713_TkMu_2_g133_OSC

-r-               1128167400  test_big3

-r-               79          test_kill1

-r-               2884        infn_cert_240.tar.gz

-rw               225633480   test5

-rw               2184        test243545

-rw               225633480   test92483265

-rw               12686       test_small

-rw               225633480   test92482454

-rw               225633480   test922

-r-               1           very_big

-rw               225633480   test6

-r-               60643264    prova_dpm

-rw               9099264     test924832

-rw               0           test7

-rw               225633480   test924832653

-rw               13          2prova124456554

-rw               0           test8

-rw               0           test91

-rw               0           test9

-rw               12686       test_small_777

-rw               12686       test_short

-rw               225633480   test924824

-rw               0           test92

Transfer on (sh 1) went on, until successful end of transfer, apart from previous deleting.

2.5 Copy local fs -> dCache server via SRM, into a nonexistent directory: SUCCESSFUL

In particular, srmcp self-creates the nonexistent directory (nonesisto/):

[donvito@gridba1 donvito]$ /opt/d-cache/srm/bin/srmcp 

   file:////home/donvito/test_short

   srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile

Storage Resource Manager (SRM) CP Client version 1.17

Copyright (c) 2002-2005 Fermi National Accelerator Laborarory

 

SRM Configuration:

        debug=true

        gsissl=true

        help=false

        pushmode=false

        userproxy=true

        buffer_size=131072

        tcp_buffer_size=0

        stream_num=10

        config_file=/home/donvito//.srmconfig/config.xml

        glue_mapfile=/opt/d-cache/srm/conf/SRMServerV1.map

        webservice_path=srm/managerv1.wsdl

        webservice_protocol=https

        gsiftpclinet=globus-url-copy

        protocols_list=http,gsiftp

        save_config_file=null

        srmcphome=/opt/d-cache/srm

        urlcopy=/opt/d-cache/srm/sbin/url-copy.sh

        x509_user_cert=/home/donvito//.globus/usercert.pem

        x509_user_key=/home/donvito//.globus/userkey.pem

        x509_user_proxy=/tmp/x509up_u5003

        x509_user_trusted_certificates=/etc/grid-security/certificates

        retry_num=20

        retry_timeout=10000

        wsdl_url=null

        use_urlcopy_script=false

        connect_to_wsdl=false

        delegate=true

        full_delegation=true

        from[0]=file:////home/donvito/test_short

        to=srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile

 

Thu Sep 01 12:43:15 CEST 2005: starting SRMPutClient

Thu Sep 01 12:43:15 CEST 2005: SRMClient(https,srm/managerv1.wsdl,true)

Thu Sep 01 12:43:15 CEST 2005: connecting to server

Thu Sep 01 12:43:15 CEST 2005: connected to server, obtaining proxy

SRMClientV1 : connecting to srm at httpg://alicegrid4.ba.infn.it:8443/srm/managerv1

Thu Sep 01 12:43:17 CEST 2005: got proxy of type class org.dcache.srm.client.SRMClientV1

SRMClientV1 :   put, sources[0]="/home/donvito/test_short"

SRMClientV1 :   put, dests[0]="srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile"

SRMClientV1 :   put, protocols[0]="http"

SRMClientV1 :   put, protocols[1]="dcap"

SRMClientV1 :   put, protocols[2]="gsiftp"

SRMClientV1 :  put, contacting service httpg://alicegrid4.ba.infn.it:8443/srm/managerv1

doneAddingJobs is false

copy_jobs is empty

Thu Sep 01 12:43:20 CEST 2005:  srm returned requestId = -2147483036

Thu Sep 01 12:43:20 CEST 2005: sleeping 1 seconds ...

Thu Sep 01 12:43:22 CEST 2005: FileRequestStatus with SURL=srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile is Ready

Thu Sep 01 12:43:22 CEST 2005:        received TURL=gsiftp://alicegrid4.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/nonesisto/shortfile

doneAddingJobs is false

copy_jobs is not empty

copying CopyJob, source = file:////home/donvito/test_short destination = gsiftp://alicegrid4.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/nonesisto/shortfile

GridftpClient: memory buffer size is set to 131072

GridftpClient: connecting to alicegrid4.ba.infn.it on port 2811

GridftpClient: gridFTPClient tcp buffer size is set to 0

GridftpClient: gridFTPWrite started, source file is java.io.RandomAccessFile@d24e3f destination path is /pnfs/ba.infn.it/data/cms/nonesisto/shortfile

GridftpClient: gridFTPWrite started, destination path is /pnfs/ba.infn.it/data/cms/nonesisto/shortfile

GridftpClient: parallelism: 10

GridftpClient: adler 32 for file java.io.RandomAccessFile@d24e3f is 866587236

GridftpClient: waiting for completion of transfer

GridftpClient: gridFtpWrite: starting the transfer in emode to /pnfs/ba.infn.it/data/cms/nonesisto/shortfile

GridftpClient: DiskDataSink.close() called

GridftpClient: gridFTPWrite() wrote 12686bytes

GridftpClient: closing client : org.dcache.srm.util.GridftpClient$FnalGridFTPClient@7cd37a

GridftpClient: closed client

execution of CopyJob, 

   source = file:////home/donvito/test_short 

   destination = gsiftp://alicegrid4.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/nonesisto/shortfile 

   completed

setting file request -2147483035 status to Done

doneAddingJobs is true

copy_jobs is empty

stopping copier

[donvito@gridba1 donvito]$ /opt/d-cache/srm/bin/gridftplist

   gsiftp://alicegrid4.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/ 

-rw               12686       test_short2

-rw               13          2prova175rgrg

-rw               0           test10

-rw               12686       file_phed

-rw               13          2prova175

drw               512         nonesisto

-r-               1128167400  test_big1

-rw               225633480   test9223

-rw               225633480   test9248

-rw               112816740   2prova1fdgsgfsdfsdfs

-rw               225633480   test1

-rw               2184        test2435

-rw               13          2prova12445655432

-r-               210         higz_windows.dat

-rw               0           test12

-rw               225633480   test2

-rw               112816740   2prova1fdgsg

-r-               1128167400  test_big2

-r-               42          fvdfvrgfer

-r-               1128167400  test_big

-rw               225633480   test3

-rw               79          test_kill

-rw               112816740   2prova1fdgsgfsdf

-rw               225633480   test4

dr-               512         bt_NoPU8713_TkMu_2_g133_OSC

-r-               1128167400  test_big3

-r-               79          test_kill1

-r-               2884        infn_cert_240.tar.gz

-rw               225633480   test5

-rw               2184        test243545

-rw               225633480   test92483265

-rw               12686       test_small

-rw               225633480   test92482454

-rw               225633480   test922

-r-               1           very_big

-rw               225633480   test6

-r-               60643264    prova_dpm

-rw               9099264     test924832

-rw               0           test7

-rw               225633480   test924832653

-rw               13          2prova124456554

-rw               0           test8

-rw               0           test91

-rw               0           test9

-rw               12686       test_small_777

-rw               12686       test_short

-rw               225633480   test924824

-rw               0           test92

 

[donvito@gridba1 donvito]$ /opt/d-cache/srm/bin/gridftplist

   gsiftp://alicegrid4.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/nonesisto/

-rw               12686       shortfile

2.6 Copy dCache server -> same dCache server via SRM: SUCCESSFUL

If you give identical endpoints (overwriting), dCache starts sleeping. CTRLC-ing transfer and changing filename, it succeedes in doing transfer.

[donvito@gridba1 donvito]$ /opt/d-cache/srm/bin/srmcp

   srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile

   srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile

Storage Resource Manager (SRM) CP Client version 1.17

Copyright (c) 2002-2005 Fermi National Accelerator Laborarory

 

SRM Configuration:

        debug=true

        gsissl=true

        help=false

        pushmode=false

        userproxy=true

        buffer_size=131072

        tcp_buffer_size=0

        stream_num=10

        config_file=/home/donvito//.srmconfig/config.xml

        glue_mapfile=/opt/d-cache/srm/conf/SRMServerV1.map

        webservice_path=srm/managerv1.wsdl

        webservice_protocol=https

        gsiftpclinet=globus-url-copy

        protocols_list=http,gsiftp

        save_config_file=null

        srmcphome=/opt/d-cache/srm

        urlcopy=/opt/d-cache/srm/sbin/url-copy.sh

        x509_user_cert=/home/donvito//.globus/usercert.pem

        x509_user_key=/home/donvito//.globus/userkey.pem

        x509_user_proxy=/tmp/x509up_u5003

        x509_user_trusted_certificates=/etc/grid-security/certificates

        retry_num=20

        retry_timeout=10000

        wsdl_url=null

        use_urlcopy_script=false

        connect_to_wsdl=false

        delegate=true

        full_delegation=true

        from[0]=srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile

        to=srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile

 

Thu Sep 01 12:49:46 CEST 2005: starting SRMCopyPullClient

Thu Sep 01 12:49:46 CEST 2005: SRMClient(https,srm/managerv1.wsdl,true)

Thu Sep 01 12:49:46 CEST 2005: connecting to server

Thu Sep 01 12:49:46 CEST 2005: connected to server, obtaining proxy

SRMClientV1 : connecting to srm at httpg://alicegrid4.ba.infn.it:8443/srm/managerv1

Thu Sep 01 12:49:48 CEST 2005: got proxy of type class org.dcache.srm.client.SRMClientV1

Thu Sep 01 12:49:48 CEST 2005: 

   copying srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile

   into srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile

SRMClientV1 :   copy, srcSURLS[0]="srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile"

SRMClientV1 :   copy, destSURLS[0]="srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile"

SRMClientV1 :  copy, contacting service httpg://alicegrid4.ba.infn.it:8443/srm/managerv1

Thu Sep 01 12:49:50 CEST 2005:  srm returned requestId = -2147483034

Thu Sep 01 12:49:50 CEST 2005: sleeping 1 seconds ...

Thu Sep 01 12:49:52 CEST 2005: sleeping 4 seconds ...

Thu Sep 01 12:49:56 CEST 2005: sleeping 4 seconds ...

Thu Sep 01 12:50:01 CEST 2005: sleeping 4 seconds ...

Thu Sep 01 12:50:06 CEST 2005: sleeping 4 seconds ...

Thu Sep 01 12:50:10 CEST 2005: sleeping 4 seconds ...

Thu Sep 01 12:50:15 CEST 2005: sleeping 7 seconds ...

>>> CTRL+C <<<

Thu Sep 01 12:50:18 CEST 2005: setting all remaining file statuses of request requestId=-2147483034 to "Done"

Thu Sep 01 12:50:18 CEST 2005: setting file request -2147483033 status to Done

Thu Sep 01 12:50:18 CEST 2005: set all file statuses to "Done"

[2]+  Done                    cp test_big bigfile

Here we change the filename:

[donvito@gridba1 donvito]$ /opt/d-cache/srm/bin/srmcp

   srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile

   srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile2

Storage Resource Manager (SRM) CP Client version 1.17

Copyright (c) 2002-2005 Fermi National Accelerator Laborarory

 

SRM Configuration:

        debug=true

        gsissl=true

        help=false

        pushmode=false

        userproxy=true

        buffer_size=131072

        tcp_buffer_size=0

        stream_num=10

        config_file=/home/donvito//.srmconfig/config.xml

        glue_mapfile=/opt/d-cache/srm/conf/SRMServerV1.map

        webservice_path=srm/managerv1.wsdl

        webservice_protocol=https

        gsiftpclinet=globus-url-copy

        protocols_list=http,gsiftp

        save_config_file=null

        srmcphome=/opt/d-cache/srm

        urlcopy=/opt/d-cache/srm/sbin/url-copy.sh

        x509_user_cert=/home/donvito//.globus/usercert.pem

        x509_user_key=/home/donvito//.globus/userkey.pem

        x509_user_proxy=/tmp/x509up_u5003

        x509_user_trusted_certificates=/etc/grid-security/certificates

        retry_num=20

        retry_timeout=10000

        wsdl_url=null

        use_urlcopy_script=false

        connect_to_wsdl=false

        delegate=true

        full_delegation=true

        from[0]=srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile

        to=srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile2

 

Thu Sep 01 12:50:34 CEST 2005: starting SRMCopyPullClient

Thu Sep 01 12:50:34 CEST 2005: SRMClient(https,srm/managerv1.wsdl,true)

Thu Sep 01 12:50:34 CEST 2005: connecting to server

Thu Sep 01 12:50:34 CEST 2005: connected to server, obtaining proxy

SRMClientV1 : connecting to srm at httpg://alicegrid4.ba.infn.it:8443/srm/managerv1

Thu Sep 01 12:50:35 CEST 2005: got proxy of type class org.dcache.srm.client.SRMClientV1

Thu Sep 01 12:50:35 CEST 2005: copying

   srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile into

   srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile2

SRMClientV1 :   copy, srcSURLS[0]="srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile"

SRMClientV1 :   copy, destSURLS[0]="srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile2"

SRMClientV1 :  copy, contacting service httpg://alicegrid4.ba.infn.it:8443/srm/managerv1

Thu Sep 01 12:50:38 CEST 2005:  srm returned requestId = -2147483032

Thu Sep 01 12:50:38 CEST 2005: sleeping 1 seconds ...

Thu Sep 01 12:50:40 CEST 2005: sleeping 4 seconds ...

Thu Sep 01 12:50:45 CEST 2005: FileRequestStatus fileID = -2147483031 is Done 

   => copying of srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/data/cms/nonesisto/shortfile

   is complete

2.7 Getting files stored on a removed pool (killing dcache-pool): SUCCESSFUL

If you kill dcache-pool on a pool and try to retrieve a file stored on THAT pool, srmcp starts sleeping (correctly), waiting for the availability of that pool. Then if you restart dcache-pool, srmcp gets the file from that pool.

2.8 Interrupting transfer of a big file: SUCCESSFUL

dCache doesn't pre-allocate any space (diskspace) or filename (see gridftplist on a second shell) until the transfer has finished, so interrupting transfer doesn't interfere with the ``status'' of the dCache fs.

2.9 File access through many protocols: SUCCESSFUL

All protocols work. Load balancing works with both dcap and gridftp.

With dccp:

[donvito@gridba1 donvito]$ dccp /home/donvito/test_short

   dcap://alicegrid4.ba.infn.it//pnfs/ba.infn.it/data/giacinto/shortf3

12686 bytes in 0 seconds

Gridftp commands tested. gridftp sees dCache shared fs:

[donvito@gridba1 donvito]$ edg-gridftp-ls -v

   gsiftp://alicegrid4.ba.infn.it:2811//pnfs/ba.infn.it/data/cms/

-rw               12686       test_short2

-rw               12686       short11123

-rw               13          2prova175rgrg

-rw               0           test10

-rw               12686       file_phed

-rw               13          2prova175

drw               512         nonesisto

-r-               1128167400  test_big1

-rw               225633480   test9223

-rw               225633480   test9248

-rw               112816740   2prova1fdgsgfsdfsdfs

-rw               225633480   test1

-rw               2184        test2435

-rw               13          2prova12445655432

-r-               210         higz_windows.dat

-rw               0           test12

-rw               225633480   test2

-rw               112816740   2prova1fdgsg

-r-               1128167400  test_big2

-r-               42          fvdfvrgfer

-r-               1128167400  test_big

-rw               225633480   test3

-rw               79          test_kill

-rw               112816740   2prova1fdgsgfsdf

-rw               225633480   test4

dr-               512         bt_NoPU8713_TkMu_2_g133_OSC

-rw               12686       short1112

-r-               1128167400  test_big3

-r-               79          test_kill1

-rw               12686       short111

-r-               2884        infn_cert_240.tar.gz

-rw               225633480   test5

-rw               2184        test243545

-rw               225633480   test92483265

-rw               12686       test_small

-rw               225633480   test92482454

-rw               225633480   test922

-r-               1           very_big

-rw               225633480   test6

-r-               60643264    prova_dpm

-rw               9099264     test924832

-rw               12686       short1112222

-rw               0           test7

-rw               225633480   test924832653

-rw               13          2prova124456554

-rw               0           test8

-rw               0           test91

-rw               0           test9

-rw               12686       test_small_777

-rw               12686       test_short

-rw               225633480   test924824

-rw               0           test92

[donvito@gridba1 donvito]$

globus-url-copy refers to alicegrid4, which is the dCache admin node, but in this case the file is physically stored on the other pool (pccms6); that's to say, globus-url-copy can store files on the other pool in a trasparent way.

globus-url-copy file:///home/donvito/test_big

   gsiftp://alicegrid4.ba.infn.it:2811/pnfs/ba.infn.it/data/cms/test_globuscp

2.10 Manipulating fs and permissions: SUCCESSFUL

No problems. Permissions are correctly handled.

2.11 Remote copy, interaction among many SRM: SUCCESSFUL

Working interactions:

dCache <-> DPM OK

dCache <-> CASTOR OK

In particular, DPM (towards dCache) behaves like Castor:

srm2srm: dCache Locale -> DPM Locale, pushmode=true

/opt/d-cache/srm/bin/srmcp -pushmode=true

   srm://alicegrid4.ba.infn.it:8443/pnfs/ba.infn.it/cms/prova_dpm 

   srm://pccms5.cmsfarm1.ba.infn.it:8443/dpm/ba.infn.it/home/cms/test_donvito34

See http://www.dcache.org/manuals/experts_docs/pushpull.html for further details.

2.12 Multiple requests: SUCCESSFUL

Multiple requested are shared among two machines.

3 Failure test

3.1 Crashing postgresql while PreparetoPut: SUCCESSFUL

If transfer begins while postgresql daemon is off, srmcp waits, retrying periodically; if mysql wakes up in the meanwhile, then srmcp handles transfer again, as expected.

3.2 Crashing a file server: SUCCESSFUL

If you kill, for example, dcache-opt daemon on the admin node (which stops gridftpdoor, gsidcapdoor, srmdomain) or just gridftpdoor, and then start transferring, then connction is refused, and srmcp starts sleeping; if you restart dcache-opt, sleeping ends, and srmcp gets the connection and transfers the file.

Otherwise, if you kill dcache-pool on one pool, the transfer happens anyhow: this means that if there is an available dcache-pool on some machine, it will be contacted through dcap libs.

About this document ...

Tests on dCache 1.6.5-2

This document was generated using the LaTeX2HTML translator Version 2002 (1.62)

Copyright © 1993, 1994, 1995, 1996, Nikos Drakos, Computer Based Learning Unit, University of Leeds.
Copyright © 1997, 1998, 1999, Ross Moore, Mathematics Department, Macquarie University, Sydney.

The command line arguments were:
latex2html -no_subdir -split 0 -show_section_numbers /tmp/lyx_tmpdir29465ogsMft/lyx_tmpbuf1/dCache-test-suite.tex

The translation was initiated by on 2005-09-01