ViewVC Help
View File | Revision Log | Show Annotations | Root Listing
root/cvsroot/COMP/CRAB/python/GetOutputServer.py
Revision 1.44 - (view) (annotate) - [select for diffs]
Wed Jul 22 17:55:18 2009 UTC (15 years, 9 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_6_1, CRAB_2_6_2, CRAB_2_6_2_pre1, CRAB_2_6_2_pre2, CRAB_2_7_0_pre1, test_1
Branch point for: CRAB_2_6_X_br
Changes since 1.43: +5 -3 lines
Diff to previous 1.43
fix time out for server at caf

Revision 1.43 - (view) (annotate) - [select for diffs]
Fri Jul 3 10:25:46 2009 UTC (15 years, 10 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_2_6_1_pre1, CRAB_2_6_1_pre2, CRAB_2_6_1_pre3, CRAB_2_6_1_pre4
Changes since 1.42: +4 -2 lines
Diff to previous 1.42
add debug in case of CS comunication failure

Revision 1.42 - (view) (annotate) - [select for diffs]
Thu Jul 2 13:27:14 2009 UTC (15 years, 10 months ago) by spiga
Branch: MAIN
Changes since 1.41: +6 -4 lines
Diff to previous 1.41
set timeout per single file to copy

Revision 1.41 - (view) (annotate) - [select for diffs]
Wed Jul 1 16:03:37 2009 UTC (15 years, 10 months ago) by spiga
Branch: MAIN
Changes since 1.40: +3 -5 lines
Diff to previous 1.40
removed time out. GO operation can take long time for big task. need to discuss here..

Revision 1.40 - (view) (annotate) - [select for diffs]
Wed Jul 1 09:04:43 2009 UTC (15 years, 10 months ago) by spiga
Branch: MAIN
Changes since 1.39: +5 -3 lines
Diff to previous 1.39
set a 10min timeout in the client-storage interaction

Revision 1.39 - (view) (annotate) - [select for diffs]
Tue May 26 10:23:00 2009 UTC (15 years, 11 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_6_0, CRAB_2_6_0_pre10, CRAB_2_6_0_pre11, CRAB_2_6_0_pre12, CRAB_2_6_0_pre13, CRAB_2_6_0_pre14, CRAB_2_6_0_pre3, CRAB_2_6_0_pre4, CRAB_2_6_0_pre5, CRAB_2_6_0_pre6, CRAB_2_6_0_pre7, CRAB_2_6_0_pre8, CRAB_2_6_0_pre9
Changes since 1.38: +11 -11 lines
Diff to previous 1.38
adapting code to logging usage. (crab_logger removed)

Revision 1.38 - (view) (annotate) - [select for diffs]
Mon Jan 19 15:09:38 2009 UTC (16 years, 3 months ago) by mcinquil
Branch: MAIN
CVS Tags: CRAB_2_4_4, CRAB_2_4_4_pre3, CRAB_2_4_4_pre4, CRAB_2_4_4_pre5, CRAB_2_4_4_pre6, CRAB_2_5_0, CRAB_2_5_0_pre1, CRAB_2_5_0_pre2, CRAB_2_5_0_pre3, CRAB_2_5_0_pre4, CRAB_2_5_0_pre5, CRAB_2_5_0_pre6, CRAB_2_5_0_pre7, CRAB_2_5_1, CRAB_2_5_1_pre1, CRAB_2_5_1_pre2, CRAB_2_5_1_pre3, CRAB_2_5_1_pre4, CRAB_2_6_0_pre1, CRAB_2_6_0_pre2
Changes since 1.37: +2 -18 lines
Diff to previous 1.37
Rstoring..integration for next release

Revision 1.37 - (view) (annotate) - [select for diffs]
Mon Jan 19 13:09:00 2009 UTC (16 years, 3 months ago) by mcinquil
Branch: MAIN
Changes since 1.36: +20 -4 lines
Diff to previous 1.36
Passing list of file for get-output (faster transfer using globus-url-copy + less load on server)

Revision 1.35 - (view) (annotate) - [select for diffs]
Wed Oct 1 15:21:33 2008 UTC (16 years, 7 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_2_4_0_pre5, CRAB_2_4_0_pre6, CRAB_2_4_0_pre7
Changes since 1.34: +3 -3 lines
Diff to previous 1.34
minor change in interface

Revision 1.34 - (view) (annotate) - [select for diffs]
Tue Sep 23 09:27:53 2008 UTC (16 years, 7 months ago) by ewv
Branch: MAIN
CVS Tags: CRAB_2_4_0_pre2, CRAB_2_4_0_pre3, CRAB_2_4_0_pre4
Changes since 1.33: +7 -6 lines
Diff to previous 1.33
Fix bugs in fetching STDERR/STDOUT for CondorG

Revision 1.33 - (view) (annotate) - [select for diffs]
Fri Sep 19 12:31:21 2008 UTC (16 years, 7 months ago) by ewv
Branch: MAIN
CVS Tags: CRAB_2_4_0_pre1
Changes since 1.32: +2 -3 lines
Diff to previous 1.32
n/c

Revision 1.32 - (view) (annotate) - [select for diffs]
Fri Sep 19 12:24:44 2008 UTC (16 years, 7 months ago) by ewv
Branch: MAIN
Changes since 1.31: +42 -27 lines
Diff to previous 1.31
Fetch stderr/out for Condor scheds

Revision 1.31 - (view) (annotate) - [select for diffs]
Fri Jul 4 14:12:10 2008 UTC (16 years, 9 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_3_2, CRAB_2_3_2_Fnal, CRAB_2_3_2_pre1, CRAB_2_3_2_pre2, CRAB_2_3_2_pre3, CRAB_2_3_2_pre4, CRAB_2_3_2_pre5, CRAB_2_3_2_pre7, CRAB_2_4_0_test, CRAB_DLS_PHED, CRAB_DLS_PHED1
Branch point for: AnaDataSet
Changes since 1.30: +0 -2 lines
Diff to previous 1.30
removed EE temporary status...in case of server usage

Revision 1.30 - (view) (annotate) - [select for diffs]
Thu Jun 12 18:43:58 2008 UTC (16 years, 10 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_3_0, CRAB_2_3_0_pre1, CRAB_2_3_0_pre6, CRAB_2_3_1_pre1, CRAB_2_3_1_pre2, CRAB_2_3_1_pre3, CRAB_2_3_1_pre4
Branch point for: CRAB_2_3_0_br
Changes since 1.29: +1 -1 lines
Diff to previous 1.29
Added TEMPORARY check on retrieved output avoiding multiple getOutput

Revision 1.29 - (view) (annotate) - [select for diffs]
Fri Jun 6 09:33:01 2008 UTC (16 years, 10 months ago) by farinafa
Branch: MAIN
CVS Tags: CRAB_2_2_2_pre5
Changes since 1.28: +21 -8 lines
Diff to previous 1.28
Safer strategy to notify the server on getOutput success/failure

Revision 1.28 - (view) (annotate) - [select for diffs]
Tue May 27 15:31:28 2008 UTC (16 years, 11 months ago) by farinafa
Branch: MAIN
CVS Tags: CRAB_2_2_1, CRAB_2_2_1_pre4, CRAB_2_2_1_pre5, CRAB_2_2_1_pre6, CRAB_2_2_2_pre1, CRAB_2_2_2_pre2, CRAB_2_2_2_pre3, CRAB_2_2_2_pre4, PRODCOMMON_0_10_7_testCS2
Changes since 1.27: +4 -1 lines
Diff to previous 1.27
Fix for the base64 padding mess

Revision 1.27 - (view) (annotate) - [select for diffs]
Thu May 8 16:32:45 2008 UTC (16 years, 11 months ago) by fanzago
Branch: MAIN
CVS Tags: CRAB_2_2_0, CRAB_2_2_0_pre19, CRAB_2_2_0_pre21, CRAB_2_2_1_pre1, CRAB_2_2_1_pre2, CRAB_2_2_1_pre3
Changes since 1.26: +1 -1 lines
Diff to previous 1.26
fixed problems with user log and output dir

Revision 1.26 - (view) (annotate) - [select for diffs]
Wed Apr 30 14:37:13 2008 UTC (17 years ago) by mcinquil
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre15, CRAB_2_2_0_pre16, CRAB_2_2_0_pre17, CRAB_2_2_0_pre18
Changes since 1.25: +3 -2 lines
Diff to previous 1.25
Returning correct job id

Revision 1.25 - (view) (annotate) - [select for diffs]
Wed Apr 30 12:36:57 2008 UTC (17 years ago) by farinafa
Branch: MAIN
Changes since 1.24: +1 -1 lines
Diff to previous 1.24
One more fix on a misleading api call

Revision 1.24 - (view) (annotate) - [select for diffs]
Wed Apr 30 12:32:55 2008 UTC (17 years ago) by farinafa
Branch: MAIN
Changes since 1.23: +1 -1 lines
Diff to previous 1.23
Typo fix

Revision 1.23 - (view) (annotate) - [select for diffs]
Tue Apr 29 15:20:48 2008 UTC (17 years ago) by farinafa
Branch: MAIN
Changes since 1.22: +6 -4 lines
Diff to previous 1.22
More cautious get output for server

Revision 1.22 - (view) (annotate) - [select for diffs]
Sat Apr 26 08:25:00 2008 UTC (17 years ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre13
Changes since 1.21: +4 -29 lines
Diff to previous 1.21
Correct proxy management....not safe to check it everywhere. Added support for caf (e.g. local ) server. Code reorganization..

Revision 1.21 - (view) (annotate) - [select for diffs]
Sun Apr 20 09:12:46 2008 UTC (17 years ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre10, CRAB_2_2_0_pre11, CRAB_2_2_0_pre12
Changes since 1.20: +2 -18 lines
Diff to previous 1.20
revisited debug and logger message (removed print), added protection for non retrieved output, adjustment on inheritance

Revision 1.20 - (view) (annotate) - [select for diffs]
Sat Apr 19 10:40:30 2008 UTC (17 years ago) by spiga
Branch: MAIN
Changes since 1.19: +3 -3 lines
Diff to previous 1.19
support for zipped stream plus some improvment on prinout message

Revision 1.19 - (view) (annotate) - [select for diffs]
Thu Apr 17 12:18:51 2008 UTC (17 years ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre8, CRAB_2_2_0_pre9, bp_osg_bdii
Branch point for: osg_bdii
Changes since 1.18: +44 -31 lines
Diff to previous 1.18
SE API usage to support client communication with a generic SE are there both for submission and getoutput. Better exception catching and refactorized a bit the code

Revision 1.18 - (view) (annotate) - [select for diffs]
Tue Apr 15 14:20:18 2008 UTC (17 years ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre7
Changes since 1.17: +36 -28 lines
Diff to previous 1.17
many improvement on getOutput. Both on client and standalone classes

Revision 1.17 - (view) (annotate) - [select for diffs]
Fri Apr 11 14:54:22 2008 UTC (17 years ago) by slacapra
Branch: MAIN
Changes since 1.16: +3 -5 lines
Diff to previous 1.16
Many changes to have LSF working with BossLite
Introduce Killer class to handle -kill which works again
Work_space::res() return the correct output directory also in case user has set a non default one, Likewise for logDir()
USER.outputdir is not to be used anywhere outside workspace class
Some cleanup in submit logic, to reduce call of Scheduler specific classes from Submitter.py
crab -clean works as well (well, almost, still need to remove twice the directory)
Fill startDirectory and outputDirectory to Task
GetOuput check status and not schedulerStatus (not stantard)
Some cleanup in the use of BlackWhiteListParser
No explicit check of scheduler concrete type in Submitter at listMatch level: move different behaviour in SchedulerXYZ implementation
Plus other things I'm forgetting...

Stefano

Revision 1.16 - (view) (annotate) - [select for diffs]
Sat Apr 5 16:38:42 2008 UTC (17 years ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre5
Changes since 1.15: +21 -2 lines
Diff to previous 1.15
minor fixex on getoutput server

Revision 1.15 - (view) (annotate) - [select for diffs]
Fri Apr 4 14:50:00 2008 UTC (17 years ago) by farinafa
Branch: MAIN
Changes since 1.14: +29 -4 lines
Diff to previous 1.14
Update for the GetOutputServer feature

Revision 1.14 - (view) (annotate) - [select for diffs]
Thu Apr 3 17:56:12 2008 UTC (17 years ago) by farinafa
Branch: MAIN
Changes since 1.13: +67 -91 lines
Diff to previous 1.13
Code refactoring for StatusServer and prototype for GetOutputServer

Revision 1.13 - (view) (annotate) - [select for diffs]
Mon Jan 28 10:49:35 2008 UTC (17 years, 3 months ago) by mcinquil
Branch: MAIN
CVS Tags: CRAB_2_1_0, CRAB_2_1_0_pre4, CRAB_2_1_0_pre5, CRAB_2_1_0_pre6, CRAB_2_1_1, CRAB_2_1_1_pre1, CRAB_2_1_1_pre3, CRAB_2_1_2, CRAB_2_1_2_pre1, CRAB_2_1_2_pre2, CRAB_2_2_0_pre1, CRAB_2_2_0_pre2, CRAB_2_2_0_pre4
Branch point for: CRAB_2_1_1_pre2, CRAB_2_1_2_br
Changes since 1.12: +8 -1 lines
Diff to previous 1.12
Enforced getoutput for server

Revision 1.12 - (view) (annotate) - [select for diffs]
Fri Jan 4 17:30:56 2008 UTC (17 years, 3 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_2_1_0_pre1, CRAB_2_1_0_pre2, CRAB_2_1_0_pre3
Changes since 1.11: +0 -1 lines
Diff to previous 1.11
Add support for LSF/CAF direct submission
Re-establish a correct inheritance pattern for Scheruled* classes
Start to remove some unneeded try: catch: statement and replace them with appropriate if:then:
Erase any use of cfg_param as a common block (expecially in conjuction with apmon) and replace it with the user of task DB
Several minor cleanup

Revision 1.11 - (view) (annotate) - [select for diffs]
Tue Dec 11 09:05:08 2007 UTC (17 years, 4 months ago) by mcinquil
Branch: MAIN
CVS Tags: CRAB_2_0_4, CRAB_2_0_4_pre1, CRAB_2_0_4_pre2
Changes since 1.10: +2 -0 lines
Diff to previous 1.10
Added check and fix for server_name (path)

Revision 1.10 - (view) (annotate) - [select for diffs]
Mon Nov 19 18:01:19 2007 UTC (17 years, 5 months ago) by farinafa
Branch: MAIN
CVS Tags: CRAB_2_0_3, CRAB_2_0_3_pre1
Changes since 1.9: +2 -3 lines
Diff to previous 1.9
Replaced PyXML dependencies with standard xml.dom + fixed the traceback back-compatibility printout problem

Revision 1.9 - (view) (annotate) - [select for diffs]
Wed Oct 10 10:13:39 2007 UTC (17 years, 6 months ago) by farinafa
Branch: MAIN
CVS Tags: CRAB_2_0_1, CRAB_2_0_1_pre1, CRAB_2_0_2, CRAB_2_0_2_pre1, CRAB_2_0_2_pre2, CRAB_2_0_2_pre3, CRAB_2_0_2_pre4, CRAB_2_0_2_pre5, CRAB_2_0_2_pre6
Changes since 1.8: +3 -3 lines
Diff to previous 1.8
Improved printout for server getoutput

Revision 1.8 - (view) (annotate) - [select for diffs]
Wed Oct 3 09:24:34 2007 UTC (17 years, 7 months ago) by farinafa
Branch: MAIN
CVS Tags: CRAB_2_0_0, CRAB_2_0_0_pre10
Changes since 1.7: +2 -4 lines
Diff to previous 1.7
Fix to kill and submit ranges interactions

Revision 1.7 - (view) (annotate) - [select for diffs]
Thu Jul 19 18:11:25 2007 UTC (17 years, 9 months ago) by mcinquil
Branch: MAIN
CVS Tags: CRAB_1_5_3, CRAB_1_5_3_pre4, CRAB_1_5_3_pre5, CRAB_1_5_4, CRAB_1_5_4_pre1, CRAB_1_5_4_pre2, CRAB_2_0_0_pre6, CRAB_2_0_0_pre7, CRAB_2_0_0_pre9
Branch point for: CRAB_1_5_4_SLC3_start
Changes since 1.6: +11 -9 lines
Diff to previous 1.6
Minor output fix

Revision 1.6 - (view) (annotate) - [select for diffs]
Thu Jun 21 07:54:25 2007 UTC (17 years, 10 months ago) by mcinquil
Branch: MAIN
CVS Tags: CRAB_1_5_3_pre2, CRAB_1_5_3_pre3, CRAB_2_0_0_pre4, CRAB_2_0_0_pre5, configure
Changes since 1.5: +2 -2 lines
Diff to previous 1.5
Cpoy of the new output tarball

Revision 1.5 - (view) (annotate) - [select for diffs]
Wed May 23 15:47:58 2007 UTC (17 years, 11 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_1_5_1, CRAB_1_5_2, CRAB_1_5_3_pre1, CRAB_2_0_0_pre1, CRAB_2_0_0_pre2, CRAB_2_0_0_pre3
Changes since 1.4: +1 -1 lines
Diff to previous 1.4
bug fix for output dir name

Revision 1.4 - (view) (annotate) - [select for diffs]
Wed May 23 07:16:05 2007 UTC (17 years, 11 months ago) by mcinquil
Branch: MAIN
Changes since 1.3: +1 -1 lines
Diff to previous 1.3
More detailed status; bug fix

Revision 1.3 - (view) (annotate) - [select for diffs]
Mon May 21 07:26:08 2007 UTC (17 years, 11 months ago) by spiga
Branch: MAIN
Changes since 1.2: +9 -3 lines
Diff to previous 1.2
added some protection for server parameters

Revision 1.2 - (view) (annotate) - [select for diffs]
Fri May 18 09:04:14 2007 UTC (17 years, 11 months ago) by mcinquil
Branch: MAIN
Changes since 1.1: +40 -6 lines
Diff to previous 1.1
Suppport to the new xml; use of jobdb; printout

Revision 1.1 - (view) (annotate) - [select for diffs]
Thu Apr 19 17:45:24 2007 UTC (18 years ago) by spiga
Branch: MAIN
CVS Tags: CRAB_1_5_1_pre1, CRAB_1_5_1_pre2, CRAB_1_5_1_pre3, CRAB_1_5_1_pre4
first commit for the new classes to support the crab client-server usage

Convenience Links

Links to HEAD: (view) (annotate) Links to test_1: (view) (annotate)

Compare Revisions

This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, select a symbolic revision name using the selection box, or choose 'Use Text Field' and enter a numeric revision.

  Diffs between and
  Type of Diff should be a