ViewVC Help
View File | Revision Log | Show Annotations | Root Listing
root/cvsroot/COMP/CRAB/python/Boss.py
Revision 1.39 - (view) (annotate) - [select for diffs]
Thu Jul 17 10:17:18 2008 UTC (16 years, 9 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_2_3_2, CRAB_2_3_2_Fnal, CRAB_2_3_2_pre1, CRAB_2_3_2_pre2, CRAB_2_3_2_pre3, CRAB_2_3_2_pre4, CRAB_2_3_2_pre5, CRAB_2_3_2_pre7, CRAB_2_4_0_pre1, CRAB_DLS_PHED, CRAB_DLS_PHED1
Branch point for: AnaDataSet
Changes since 1.38: +3 -2 lines
Diff to previous 1.38
default RB is CERN if none is set

Revision 1.38 - (view) (annotate) - [select for diffs]
Wed Jul 2 09:51:29 2008 UTC (16 years, 10 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_3_1_pre3, CRAB_2_4_0_test
Changes since 1.37: +1 -0 lines
Diff to previous 1.37
added time out

Revision 1.37 - (view) (annotate) - [select for diffs]
Mon Jun 9 17:50:45 2008 UTC (16 years, 10 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_2_pre5, CRAB_2_3_0, CRAB_2_3_0_pre1, CRAB_2_3_0_pre6, CRAB_2_3_1_pre1, CRAB_2_3_1_pre2
Branch point for: CRAB_2_3_0_br
Changes since 1.36: +7 -9 lines
Diff to previous 1.36
bug fix

Revision 1.36 - (view) (annotate) - [select for diffs]
Mon Jun 9 15:39:42 2008 UTC (16 years, 10 months ago) by spiga
Branch: MAIN
Changes since 1.35: +5 -1 lines
Diff to previous 1.35
print parent scheduler Id (for each collection) in the crab log

Revision 1.35 - (view) (annotate) - [select for diffs]
Mon Jun 2 17:14:17 2008 UTC (16 years, 11 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_2_pre2, CRAB_2_2_2_pre3, CRAB_2_2_2_pre4
Changes since 1.34: +2 -2 lines
Diff to previous 1.34
At the submission level is now used the "fast" listmatch while the full one is performed while testing Jdl (-testJdl or -match)

Revision 1.34 - (view) (annotate) - [select for diffs]
Fri May 30 09:06:50 2008 UTC (16 years, 11 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_1, CRAB_2_2_1_pre5, CRAB_2_2_1_pre6, CRAB_2_2_2_pre1
Changes since 1.33: +3 -1 lines
Diff to previous 1.33
write in the log the used service (one for each collection)

Revision 1.33 - (view) (annotate) - [select for diffs]
Mon May 26 13:13:37 2008 UTC (16 years, 11 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_2_2_1_pre3, CRAB_2_2_1_pre4, PRODCOMMON_0_10_7_testCS2
Changes since 1.32: +2 -1 lines
Diff to previous 1.32
adding Sge scheduler

Revision 1.32 - (view) (annotate) - [select for diffs]
Mon May 5 18:34:17 2008 UTC (16 years, 11 months ago) by ewv
Branch: MAIN
CVS Tags: CRAB_2_2_0, CRAB_2_2_0_pre17, CRAB_2_2_0_pre18, CRAB_2_2_0_pre19, CRAB_2_2_0_pre21, CRAB_2_2_1_pre1, CRAB_2_2_1_pre2
Changes since 1.31: +2 -2 lines
Diff to previous 1.31
Missing ]

Revision 1.31 - (view) (annotate) - [select for diffs]
Mon May 5 14:44:23 2008 UTC (16 years, 11 months ago) by spiga
Branch: MAIN
Changes since 1.30: +2 -5 lines
Diff to previous 1.30
missed a change for scheduler specific params configuration

Revision 1.30 - (view) (annotate) - [select for diffs]
Tue Apr 29 15:47:28 2008 UTC (17 years ago) by ewv
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre15, CRAB_2_2_0_pre16
Changes since 1.29: +6 -5 lines
Diff to previous 1.29
Add vanilla Condor

Revision 1.29 - (view) (annotate) - [select for diffs]
Mon Apr 28 22:33:45 2008 UTC (17 years ago) by spiga
Branch: MAIN
Changes since 1.28: +1 -1 lines
Diff to previous 1.28
added protection

Revision 1.28 - (view) (annotate) - [select for diffs]
Sat Apr 26 17:27:09 2008 UTC (17 years ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre13
Changes since 1.27: +15 -3 lines
Diff to previous 1.27
Added -printJdl functionality plus many bugs fixed

Revision 1.27 - (view) (annotate) - [select for diffs]
Sat Apr 26 09:08:29 2008 UTC (17 years ago) by spiga
Branch: MAIN
Changes since 1.26: +1 -1 lines
Diff to previous 1.26
pass corect arguments to submit blite  api..very strange that it worked before...

Revision 1.26 - (view) (annotate) - [select for diffs]
Sun Apr 20 19:32:37 2008 UTC (17 years ago) by afanfani
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre11, CRAB_2_2_0_pre12
Changes since 1.25: +1 -1 lines
Diff to previous 1.25
use the correct arguments as white/black list in lcgInfo

Revision 1.25 - (view) (annotate) - [select for diffs]
Thu Apr 17 10:51:49 2008 UTC (17 years ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre10, CRAB_2_2_0_pre8, CRAB_2_2_0_pre9, bp_osg_bdii
Branch point for: osg_bdii
Changes since 1.24: +1 -1 lines
Diff to previous 1.24
implement -testJdl==-listMatch==-match functionality

Revision 1.24 - (view) (annotate) - [select for diffs]
Wed Apr 16 15:15:22 2008 UTC (17 years ago) by spiga
Branch: MAIN
Changes since 1.23: +1 -2 lines
Diff to previous 1.23
executable use just the basename

Revision 1.23 - (view) (annotate) - [select for diffs]
Tue Apr 15 22:16:01 2008 UTC (17 years ago) by ewv
Branch: MAIN
Changes since 1.22: +15 -14 lines
Diff to previous 1.22
New scheduler for CondorG, add one for glidein

Revision 1.22 - (view) (annotate) - [select for diffs]
Tue Apr 15 09:37:47 2008 UTC (17 years ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre7
Changes since 1.21: +13 -0 lines
Diff to previous 1.21
PostMortem functionality restored. Many reorganization to allow inheritation from Server calss. Fix and improvement on Logging parsing

Revision 1.21 - (view) (annotate) - [select for diffs]
Fri Apr 11 14:54:22 2008 UTC (17 years ago) by slacapra
Branch: MAIN
Changes since 1.20: +33 -67 lines
Diff to previous 1.20
Many changes to have LSF working with BossLite
Introduce Killer class to handle -kill which works again
Work_space::res() return the correct output directory also in case user has set a non default one, Likewise for logDir()
USER.outputdir is not to be used anywhere outside workspace class
Some cleanup in submit logic, to reduce call of Scheduler specific classes from Submitter.py
crab -clean works as well (well, almost, still need to remove twice the directory)
Fill startDirectory and outputDirectory to Task
GetOuput check status and not schedulerStatus (not stantard)
Some cleanup in the use of BlackWhiteListParser
No explicit check of scheduler concrete type in Submitter at listMatch level: move different behaviour in SchedulerXYZ implementation
Plus other things I'm forgetting...

Stefano

Revision 1.20 - (view) (annotate) - [select for diffs]
Wed Apr 9 07:52:58 2008 UTC (17 years ago) by spiga
Branch: MAIN
Changes since 1.19: +3 -3 lines
Diff to previous 1.19
minor fixes

Revision 1.19 - (view) (annotate) - [select for diffs]
Tue Apr 8 15:36:11 2008 UTC (17 years ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre5
Changes since 1.18: +2 -0 lines
Diff to previous 1.18
added fjr into OSB also out of tarball

Revision 1.18 - (view) (annotate) - [select for diffs]
Mon Apr 7 15:01:01 2008 UTC (17 years ago) by spiga
Branch: MAIN
Changes since 1.17: +1 -1 lines
Diff to previous 1.17
.BrokerInfo must be retrieved only for gLite middleware

Revision 1.17 - (view) (annotate) - [select for diffs]
Fri Apr 4 15:52:16 2008 UTC (17 years ago) by spiga
Branch: MAIN
Changes since 1.16: +43 -16 lines
Diff to previous 1.16
implementation of exception catching while interacting with Scheduler and Database

Revision 1.16 - (view) (annotate) - [select for diffs]
Tue Apr 1 14:53:36 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre2, CRAB_2_2_0_pre4
Changes since 1.15: +11 -10 lines
Diff to previous 1.15
restored output functionality. Some fix on arguments format avoiding wrapper crash. Implemented tarball creation for output sanbox... still remaining to enable the check on output sandbox size...and the related backup solution

Revision 1.15 - (view) (annotate) - [select for diffs]
Fri Mar 28 17:18:20 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.14: +7 -154 lines
Diff to previous 1.14
removed getOutput stuff and various fix...

Revision 1.14 - (view) (annotate) - [select for diffs]
Wed Mar 26 19:15:24 2008 UTC (17 years, 1 month ago) by ewv
Branch: MAIN
Changes since 1.13: +44 -44 lines
Diff to previous 1.13
Condor G + BossLite

Revision 1.13 - (view) (annotate) - [select for diffs]
Wed Mar 26 11:12:28 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.12: +1 -3 lines
Diff to previous 1.12
the executable in jdl must be without absolute path. The wrapper must be included within the inifiles

Revision 1.12 - (view) (annotate) - [select for diffs]
Tue Mar 25 16:29:12 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.11: +1 -1 lines
Diff to previous 1.11
still another fix on the job index plus bosslite integration optimization.

Revision 1.11 - (view) (annotate) - [select for diffs]
Tue Mar 25 09:49:41 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.10: +1 -1 lines
Diff to previous 1.10
enabled submission by range...as in the past

Revision 1.10 - (view) (annotate) - [select for diffs]
Fri Mar 21 16:30:10 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.9: +14 -138 lines
Diff to previous 1.9
Implemented the listmatch support. Cleaned also the code by many old method and workarounds...

Revision 1.9 - (view) (annotate) - [select for diffs]
Tue Mar 18 11:03:09 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.8: +35 -44 lines
Diff to previous 1.8
restored the possibility to change WMS (the simply endpoint and/or the full config files) at submission time via command line, plus some adjustments on submission conde

Revision 1.8 - (view) (annotate) - [select for diffs]
Mon Mar 17 14:00:59 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.7: +30 -67 lines
Diff to previous 1.7
Many changes to integrate BossLite. Creation step fully implemented and optimized... Submission is now working again. Here the missing things are the support for jobs submission by range, the message sending to ML, and the listmatch_match check. Actually the requirements can be changed on the fly as was in the past. The status is fully working with BossLite. The exit code display is not there since the new boss does not implement the RealTime mon.. here the functionality is under development by Federica: to be integrated.

Revision 1.7 - (view) (annotate) - [select for diffs]
Fri Mar 7 17:25:23 2008 UTC (17 years, 1 month ago) by slacapra
Branch: MAIN
Changes since 1.6: +16 -4 lines
Diff to previous 1.6
initial mods to have LSF working with BossLite: still way to go...

Revision 1.6 - (view) (annotate) - [select for diffs]
Fri Mar 7 09:27:51 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.5: +9 -3 lines
Diff to previous 1.5
 First version which submit jobs using blite. Not yet fully working. Minor problem with jdl arguments. Submission dose not take range yet

Revision 1.5 - (view) (annotate) - [select for diffs]
Wed Mar 5 18:32:03 2008 UTC (17 years, 1 month ago) by spiga
Branch: MAIN
Changes since 1.4: +35 -32 lines
Diff to previous 1.4
first change for submission

Revision 1.4 - (view) (annotate) - [select for diffs]
Mon Mar 3 20:36:46 2008 UTC (17 years, 2 months ago) by spiga
Branch: MAIN
CVS Tags: CRAB_2_2_0_pre1
Changes since 1.3: +42 -281 lines
Diff to previous 1.3
ported to Bosslite. Removed all the jobtype/scheduler... checks requested by old Boss. revisited jobs declaration also

Revision 1.3 - (view) (annotate) - [select for diffs]
Mon Feb 4 16:26:06 2008 UTC (17 years, 2 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_2_1_0, CRAB_2_1_0_pre4, CRAB_2_1_0_pre5, CRAB_2_1_0_pre6, CRAB_2_1_1, CRAB_2_1_1_pre1, CRAB_2_1_1_pre3, CRAB_2_1_2, CRAB_2_1_2_pre1, CRAB_2_1_2_pre2
Branch point for: CRAB_2_1_1_pre2, CRAB_2_1_2_br
Changes since 1.2: +1 -1 lines
Diff to previous 1.2
fix kill and resubmit

Revision 1.2 - (view) (annotate) - [select for diffs]
Fri Feb 1 15:23:44 2008 UTC (17 years, 3 months ago) by slacapra
Branch: MAIN
Changes since 1.1: +2 -0 lines
Diff to previous 1.1
protect delete of empty bossUser and bossAdmin

Revision 1.1 - (view) (annotate) - [select for diffs]
Fri Jan 18 18:41:03 2008 UTC (17 years, 3 months ago) by slacapra
Branch: MAIN
CVS Tags: CRAB_2_1_0_pre3
Redesign the inheritance three of Scheduler Classes, and remove the SchedulerBoss one
Introduce ScheuledGrid and ScheduleLocal as base classes for Grid and local scheduler, respectively.
All interaction with boss are done via Boss class, whose (unique) instance is owned by Scheduler
These changes are done to reduce code duplication.

Plus other minor modification and cosmetcs, as usual

Convenience Links

Links to HEAD: (view) (annotate) Links to AnaDataSet: (view) (annotate)

Compare Revisions

This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, select a symbolic revision name using the selection box, or choose 'Use Text Field' and enter a numeric revision.

  Diffs between and
  Type of Diff should be a