ViewVC Help
View File | Revision Log | Show Annotations | Root Listing
root/cvsroot/COMP/CRAB/python/SchedulerGlite.py
Revision 1.47 - (view) (annotate) - [select for diffs]
Tue Apr 15 09:37:47 2008 UTC (17 years ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre10, CRAB_2_2_0_pre7, CRAB_2_2_0_pre8, CRAB_2_2_0_pre9, bp_osg_bdii
Branch point for: osg_bdii
Changes since 1.46: +9 -15 lines
Diff to previous 1.46
PostMortem functionality restored. Many reorganization to allow inheritation from Server calss. Fix and improvement on Logging parsing

Revision 1.46 - (view) (annotate) - [select for diffs]
Fri Apr 11 14:54:22 2008 UTC (17 years ago) by slacapra
Branch: MAIN
Changes since 1.45: +1 -0 lines
Diff to previous 1.45
Many changes to have LSF working with BossLite
Introduce Killer class to handle -kill which works again
Work_space::res() return the correct output directory also in case user has set a non default one, Likewise for logDir()
USER.outputdir is not to be used anywhere outside workspace class
Some cleanup in submit logic, to reduce call of Scheduler specific classes from Submitter.py
crab -clean works as well (well, almost, still need to remove twice the directory)
Fill startDirectory and outputDirectory to Task
GetOuput check status and not schedulerStatus (not stantard)
Some cleanup in the use of BlackWhiteListParser
No explicit check of scheduler concrete type in Submitter at listMatch level: move different behaviour in SchedulerXYZ implementation
Plus other things I'm forgetting...

Stefano

Revision 1.45 - (view) (annotate) - [select for diffs]
Thu Apr 10 13:13:59 2008 UTC (17 years ago) by ewv
Branch: MAIN
Changes since 1.44: +24 -85 lines
Diff to previous 1.44
Split wsSetupEnvironment into Grid, Glite, and CondorG parts

Revision 1.44 - (view) (annotate) - [select for diffs]
Tue Apr 1 14:53:36 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre2, CRAB_2_2_0_pre4, CRAB_2_2_0_pre5
Changes since 1.43: +85 -85 lines
Diff to previous 1.43
restored output functionality. Some fix on arguments format avoiding wrapper crash. Implemented tarball creation for output sanbox... still remaining to enable the check on output sandbox size...and the related backup solution

Revision 1.43 - (view) (annotate) - [select for diffs]
Thu Mar 27 16:29:39 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.42: +1 -1 lines
Diff to previous 1.42
better protection for listmatch if condorG, plus minor bugFix

Revision 1.42 - (view) (annotate) - [select for diffs]
Thu Mar 27 15:22:31 2008 UTC (17 years, 1 month ago) by ewv
Branch: MAIN
Changes since 1.41: +14 -13 lines
Diff to previous 1.41
Move checkProxy() to SchedulerGlite

Revision 1.41 - (view) (annotate) - [select for diffs]
Fri Mar 21 16:30:10 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.40: +2 -2 lines
Diff to previous 1.40
Implemented the listmatch support. Cleaned also the code by many old method and workarounds...

Revision 1.40 - (view) (annotate) - [select for diffs]
Tue Mar 18 11:03:10 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.39: +1 -1 lines
Diff to previous 1.39
restored the possibility to change WMS (the simply endpoint and/or the full config files) at submission time via command line, plus some adjustments on submission conde

Revision 1.39 - (view) (annotate) - [select for diffs]
Mon Mar 17 14:00:59 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.38: +44 -26 lines
Diff to previous 1.38
Many changes to integrate BossLite. Creation step fully implemented and optimized... Submission is now working again. Here the missing things are the support for jobs submission by range, the message sending to ML, and the listmatch_match check. Actually the requirements can be changed on the fly as was in the past. The status is fully working with BossLite. The exit code display is not there since the new boss does not implement the RealTime mon.. here the functionality is under development by Federica: to be integrated.

Revision 1.38 - (view) (annotate) - [select for diffs]
Tue Mar 4 11:38:15 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.37: +5 -9 lines
Diff to previous 1.37
sched_param must be cleaned for each job

Revision 1.37 - (view) (annotate) - [select for diffs]
Tue Mar 4 11:09:13 2008 UTC (17 years, 1 month ago) by fanzago
Branch: MAIN
Changes since 1.36: +32 -19 lines
Diff to previous 1.36
re-added some changes for clean of wrapper

Revision 1.36 - (view) (annotate) - [select for diffs]
Mon Mar 3 20:40:56 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre1
Changes since 1.35: +98 -107 lines
Diff to previous 1.35
ported to bosslite. deprecated all the stuff related to xml creation needed for the old boss, reorganized requirements (scheduler specific) management. Any file is now writted.. scheduler parameters are filled into DB

Revision 1.35 - (view) (annotate) - [select for diffs]
Mon Mar 3 16:41:24 2008 UTC (17 years, 1 month ago) by fanzago
Branch: MAIN
Changes since 1.34: +40 -24 lines
Diff to previous 1.34
first changes about wrapper

Revision 1.34 - (view) (annotate) - [select for diffs]
Tue Feb 26 22:24:21 2008 UTC (17 years, 2 months ago) by ewv
Branch: MAIN
CVS Tags: CRAB_2_1_1, CRAB_2_1_1_pre1, CRAB_2_1_1_pre3, CRAB_2_1_2, CRAB_2_1_2_pre1, CRAB_2_1_2_pre2
Branch point for: CRAB_2_1_1_pre2, CRAB_2_1_2_br
Changes since 1.33: +2 -2 lines
Diff to previous 1.33
Python config file, remove reliance on sed

Revision 1.33 - (view) (annotate) - [select for diffs]
Tue Feb 12 15:48:53 2008 UTC (17 years, 2 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_2_1_0, CRAB_2_1_0_pre5, CRAB_2_1_0_pre6
Changes since 1.32: +2 -2 lines
Diff to previous 1.32
fix scheduler name in case of glitecoll plus cleanup

Revision 1.32 - (view) (annotate) - [select for diffs]
Mon Jan 21 14:35:34 2008 UTC (17 years, 3 months ago) by mcinquil
Branch: MAIN
CVS Tags: CRAB_2_1_0_pre4
Changes since 1.31: +2 -2 lines
Diff to previous 1.31
Changed check on ce_white/black_list

Revision 1.31 - (view) (annotate) - [select for diffs]
Fri Jan 18 18:41:04 2008 UTC (17 years, 3 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_2_1_0_pre3
Changes since 1.30: +17 -15 lines
Diff to previous 1.30
Redesign the inheritance three of Scheduler Classes, and remove the SchedulerBoss one
Introduce ScheuledGrid and ScheduleLocal as base classes for Grid and local scheduler, respectively.
All interaction with boss are done via Boss class, whose (unique) instance is owned by Scheduler
These changes are done to reduce code duplication.

Plus other minor modification and cosmetcs, as usual

Revision 1.30 - (view) (annotate) - [select for diffs]
Thu Jan 10 16:36:06 2008 UTC (17 years, 3 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_2_1_0_pre2
Changes since 1.29: +0 -55 lines
Diff to previous 1.29
cleanup

Revision 1.29 - (view) (annotate) - [select for diffs]
Fri Dec 7 16:50:13 2007 UTC (17 years, 4 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_0_4, CRAB_2_0_4_pre1, CRAB_2_0_4_pre2, CRAB_2_1_0_pre1
Changes since 1.28: +2 -1 lines
Diff to previous 1.28
imported fixes for additional jdl paramameters management

Revision 1.28 - (view) (annotate) - [select for diffs]
Wed Nov 14 16:35:21 2007 UTC (17 years, 5 months ago) by ewv
Branch: MAIN
CVS Tags: CRAB_2_0_2, CRAB_2_0_2_pre5, CRAB_2_0_2_pre6, CRAB_2_0_3, CRAB_2_0_3_pre1
Changes since 1.27: +26 -36 lines
Diff to previous 1.27
Remove references to GRID3

Revision 1.27 - (view) (annotate) - [select for diffs]
Wed Nov 7 18:13:31 2007 UTC (17 years, 5 months ago) by mcinquil
Branch: MAIN
CVS Tags: CRAB_2_0_2_pre3, CRAB_2_0_2_pre4
Changes since 1.26: +1 -1 lines
Diff to previous 1.26
Adjustment on getout timeout

Revision 1.26 - (view) (annotate) - [select for diffs]
Wed Nov 7 13:18:09 2007 UTC (17 years, 5 months ago) by fanzago
Branch: MAIN
CVS Tags: CRAB_2_0_2_pre2
Changes since 1.25: +10 -19 lines
Diff to previous 1.25
changes to improve crab stdout

Revision 1.25 - (view) (annotate) - [select for diffs]
Fri Oct 19 11:48:01 2007 UTC (17 years, 6 months ago) by mcinquil
Branch: MAIN
CVS Tags: CRAB_2_0_2_pre1
Changes since 1.24: +11 -6 lines
Diff to previous 1.24
Using OSG_JOB_CONTACT instead of GLOBUS_GRAM_JOB_CONTACT

Revision 1.24 - (view) (annotate) - [select for diffs]
Wed Oct 10 12:55:58 2007 UTC (17 years, 6 months ago) by mcinquil
Branch: MAIN
CVS Tags: CRAB_2_0_1, CRAB_2_0_1_pre1
Changes since 1.23: +3 -3 lines
Diff to previous 1.23
Allowing submission for tasks with a missing location for a block - this is a first version that block the creation and then the submision of jobs assigned to no location

Revision 1.23 - (view) (annotate) - [select for diffs]
Mon Oct 8 20:57:13 2007 UTC (17 years, 6 months ago) by mcinquil
Branch: MAIN
Changes since 1.22: +2 -2 lines
Diff to previous 1.22
Bug fix [removing hardcoded misstype]

Revision 1.22 - (view) (annotate) - [select for diffs]
Mon Oct 8 18:26:16 2007 UTC (17 years, 6 months ago) by mcinquil
Branch: MAIN
Changes since 1.21: +12 -2 lines
Diff to previous 1.21
Now getting the right site name from osg wn

Revision 1.21 - (view) (annotate) - [select for diffs]
Fri Oct 5 12:55:05 2007 UTC (17 years, 6 months ago) by fanzago
Branch: MAIN
CVS Tags: CRAB_2_0_0
Changes since 1.20: +36 -37 lines
Diff to previous 1.20
removed data registration in lcg catalog

Revision 1.20 - (view) (annotate) - [select for diffs]
Fri Oct 5 12:09:51 2007 UTC (17 years, 6 months ago) by mcinquil
Branch: MAIN
Changes since 1.19: +19 -2 lines
Diff to previous 1.19
Added ce_white/black_list in glite list-match + bug fix ce_white_list

Revision 1.19 - (view) (annotate) - [select for diffs]
Wed Oct 3 23:56:29 2007 UTC (17 years, 6 months ago) by gutsche
Branch: MAIN
Changes since 1.18: +2 -2 lines
Diff to previous 1.18
changed EDG_WL_LOG_DESTINATION to GLITE_WL_LOG_DESTINATION for SyncCE report from WN

Revision 1.18 - (view) (annotate) - [select for diffs]
Wed Oct 3 16:31:25 2007 UTC (17 years, 6 months ago) by mcinquil
Branch: MAIN
CVS Tags: CRAB_2_0_0_pre10
Changes since 1.17: +1 -1 lines
Diff to previous 1.17
Increased the timeout for single job to 180

Revision 1.17 - (view) (annotate) - [select for diffs]
Wed Aug 15 10:16:17 2007 UTC (17 years, 8 months ago) by fanzago
Branch: MAIN
CVS Tags: CRAB_1_5_3, CRAB_1_5_4, CRAB_1_5_4_pre1, CRAB_1_5_4_pre2, CRAB_2_0_0_pre6, CRAB_2_0_0_pre7, CRAB_2_0_0_pre9
Branch point for: CRAB_1_5_4_SLC3_start
Changes since 1.16: +8 -8 lines
Diff to previous 1.16
moved export SE and SE_PATH from wsSetupEnvironment to copyOutput in SchedulerEdg

Revision 1.16 - (view) (annotate) - [select for diffs]
Thu Jul 26 03:02:58 2007 UTC (17 years, 9 months ago) by gutsche
Branch: MAIN
CVS Tags: CRAB_1_5_3_pre4, CRAB_1_5_3_pre5
Changes since 1.15: +2 -2 lines
Diff to previous 1.15
moved parsing of black/white se lists into

BlackWhiteListParser.py

which is intantiated in

SchedulerEdg.py: list parsing during xml creation
cms_cmssw.py:    list parsing for screen output

also SchedulerGlite.py has to use new member functions and had to be changed

Revision 1.15 - (view) (annotate) - [select for diffs]
Sat Jul 14 08:38:21 2007 UTC (17 years, 9 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_0_0_pre5
Changes since 1.14: +14 -2 lines
Diff to previous 1.14
moved SE white and Black list management after jobDB.destination filling

Revision 1.14 - (view) (annotate) - [select for diffs]
Mon Jun 25 14:21:56 2007 UTC (17 years, 10 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_1_5_3_pre2, CRAB_1_5_3_pre3, CRAB_2_0_0_pre4, configure
Changes since 1.13: +4 -0 lines
Diff to previous 1.13
added def submitTout which retoun the timeout value

Revision 1.13 - (view) (annotate) - [select for diffs]
Wed Feb 28 14:10:33 2007 UTC (18 years, 2 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_1_5_0, CRAB_1_5_0_pre7, CRAB_1_5_0_pre8, CRAB_1_5_0_pre9, CRAB_1_5_1, CRAB_1_5_1_pre1, CRAB_1_5_1_pre2, CRAB_1_5_1_pre3, CRAB_1_5_1_pre4, CRAB_1_5_2, CRAB_1_5_3_pre1, CRAB_2_0_0_pre1, CRAB_2_0_0_pre2, CRAB_2_0_0_pre3
Changes since 1.12: +25 -33 lines
Diff to previous 1.12
cleanup code for jdl requirements

Revision 1.12 - (view) (annotate) - [select for diffs]
Mon Feb 26 12:02:25 2007 UTC (18 years, 2 months ago) by slacapra
Branch: MAIN
Changes since 1.11: +1 -1 lines
Diff to previous 1.11
blah and not *blah*

Revision 1.11 - (view) (annotate) - [select for diffs]
Sat Jan 20 13:47:46 2007 UTC (18 years, 3 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_1_5_0_pre6
Changes since 1.10: +7 -3 lines
Diff to previous 1.10
added requirement to skip gLite CE

Revision 1.10 - (view) (annotate) - [select for diffs]
Wed Jan 17 18:17:58 2007 UTC (18 years, 3 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_1_5_0_pre4, CRAB_1_5_0_pre5
Changes since 1.9: +0 -1 lines
Diff to previous 1.9
many minor fixes reported by pychecker, mostly unsude import and unused variables

Revision 1.9 - (view) (annotate) - [select for diffs]
Fri Nov 17 15:28:47 2006 UTC (18 years, 5 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_1_4_1, CRAB_1_4_2, CRAB_1_5_0_pre1, CRAB_1_5_0_pre2, CRAB_1_5_0_pre3
Branch point for: branch_1_4_1
Changes since 1.8: +5 -5 lines
Diff to previous 1.8
removed empty space while writing black & white list

Revision 1.8 - (view) (annotate) - [select for diffs]
Tue Oct 17 10:06:53 2006 UTC (18 years, 6 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_1_4_0, CRAB_1_4_0_pre4, CRAB_1_4_1_pre1, CRAB_1_4_1_pre2
Changes since 1.7: +1 -1 lines
Diff to previous 1.7
logging info to v 3

Revision 1.7 - (view) (annotate) - [select for diffs]
Tue Oct 17 09:52:57 2006 UTC (18 years, 6 months ago) by slacapra
Branch: MAIN
Changes since 1.6: +3 -6 lines
Diff to previous 1.6
add EDG.additional_jdl_parameters card to add additional parameters to JDL

Revision 1.6 - (view) (annotate) - [select for diffs]
Thu Oct 12 14:51:12 2006 UTC (18 years, 6 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_1_4_0_pre3
Changes since 1.5: +6 -5 lines
Diff to previous 1.5
fix problem with destination for group>1

Revision 1.5 - (view) (annotate) - [select for diffs]
Thu Oct 12 10:08:48 2006 UTC (18 years, 6 months ago) by slacapra
Branch: MAIN
Changes since 1.4: +1 -1 lines
Diff to previous 1.4
cosmetics

Revision 1.4 - (view) (annotate) - [select for diffs]
Wed Oct 11 15:45:53 2006 UTC (18 years, 6 months ago) by fanzago
Branch: MAIN
Changes since 1.3: +21 -4 lines
Diff to previous 1.3
changes to switch glite broker

Revision 1.3 - (view) (annotate) - [select for diffs]
Mon Oct 9 15:30:41 2006 UTC (18 years, 6 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_1_4_0_pre2
Changes since 1.2: +16 -17 lines
Diff to previous 1.2
fix for None input

Revision 1.2 - (view) (annotate) - [select for diffs]
Fri Oct 6 16:29:12 2006 UTC (18 years, 6 months ago) by spiga
Branch: MAIN
Changes since 1.1: +246 -0 lines
Diff to previous 1.1
changes to support bulk (by Fede)

Revision 1.1
Wed Jul 19 14:58:22 2006 UTC (18 years, 9 months ago) by spiga
Branch: MAIN
Branch point for: CRAB_BOSS4
FILE REMOVED
file SchedulerGlite.py was initially added on branch CRAB_BOSS4.

Convenience Links

Links to HEAD: (view) (annotate) Links to osg_bdii: (view) (annotate)

Compare Revisions

This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, select a symbolic revision name using the selection box, or choose 'Use Text Field' and enter a numeric revision.

  Diffs between and
  Type of Diff should be a