move OSB sixe check to Scheduler.py https://savannah.cern.ch/bugs/index.php?95466
human readable OSBsize
removed the parameter req[task] out of a try
change messages for savannah 73010
Refinements for bug #68550: shallow_retry set to -1, retry_count to 0
fix for bug #67409
Fix for bug #65966: set properly NodeDefaults for retry and shallowRetry
Fix for bug #65966: set properly NodeDefaults for retry and shallowRetry
Complete fix for bug #65703: uses the WMCore head version of the Service class to get cache files and it adds HTTPException in order to manage download problems
Added a guard for bug #65703: problem with silent 404 http error now catched explicitly
sr #112468: from lcg-info to glite-wms-job-list-match
define the right variable!
use default cache definition
from logging info to logging debug
grom GliteConfig to Downloader
set job exit code value after checking OSB size
removing check to skip gLite CE
changes to allows use of CREAM ce by setting GRID.use_cream = 1
delegate proxy to WMS for each task submission
Introduce a CrabLogger class which hanlde the std python logging
adapting code to EDG --> GRID migration
adapting code to logging usage. (crab_logger removed)
Return right values if no CE white/blacklist
SiteDB names for CE and gLite
skip wms Auth. is set to 1 by default.
fix error when rb is not set: see <http://savannah.cern.ch/bugs/?42975>
Move sched_fix_parameter from glite to grid, clean up a bit
Fix for Dashboard reporting in CondorG
EDG.rb is needed also here: I wonder why... Plus change to cope with checkBlackList checkWhiteList interface changes
default RB is CERN if none is set
userName is already defined
others adjustments on check proxy. Now shoud be ok.
unuseful comments and old function
add skipwmsauth option
fixed OS size value
use size not sum
missing double quote
removed func_exit() from template. Now it is written by crab... and configured with scheduler specific needed. Restored check for OSB size if scheduler is gLite, reorganized the real scheduler (means the BLite script interacting with real scheduler) configuration parameters. Now the dictionary is prepared by different schedulers and any needed parameters can be shipped.
check proxy adjustments
No need for separate gLite/Condor wsSetupEnvironment
removed eval usage for dlsDest
PostMortem functionality restored. Many reorganization to allow inheritation from Server calss. Fix and improvement on Logging parsing
Many changes to have LSF working with BossLite Introduce Killer class to handle -kill which works again Work_space::res() return the correct output directory also in case user has set a non default one, Likewise for logDir() USER.outputdir is not to be used anywhere outside workspace class Some cleanup in submit logic, to reduce call of Scheduler specific classes from Submitter.py crab -clean works as well (well, almost, still need to remove twice the directory) Fill startDirectory and outputDirectory to Task GetOuput check status and not schedulerStatus (not stantard) Some cleanup in the use of BlackWhiteListParser No explicit check of scheduler concrete type in Submitter at listMatch level: move different behaviour in SchedulerXYZ implementation Plus other things I'm forgetting... Stefano
Split wsSetupEnvironment into Grid, Glite, and CondorG parts
restored output functionality. Some fix on arguments format avoiding wrapper crash. Implemented tarball creation for output sanbox... still remaining to enable the check on output sandbox size...and the related backup solution
better protection for listmatch if condorG, plus minor bugFix
Move checkProxy() to SchedulerGlite
Implemented the listmatch support. Cleaned also the code by many old method and workarounds...
restored the possibility to change WMS (the simply endpoint and/or the full config files) at submission time via command line, plus some adjustments on submission conde
Many changes to integrate BossLite. Creation step fully implemented and optimized... Submission is now working again. Here the missing things are the support for jobs submission by range, the message sending to ML, and the listmatch_match check. Actually the requirements can be changed on the fly as was in the past. The status is fully working with BossLite. The exit code display is not there since the new boss does not implement the RealTime mon.. here the functionality is under development by Federica: to be integrated.
sched_param must be cleaned for each job
re-added some changes for clean of wrapper
ported to bosslite. deprecated all the stuff related to xml creation needed for the old boss, reorganized requirements (scheduler specific) management. Any file is now writted.. scheduler parameters are filled into DB
first changes about wrapper
Python config file, remove reliance on sed
fix scheduler name in case of glitecoll plus cleanup
Changed check on ce_white/black_list
Redesign the inheritance three of Scheduler Classes, and remove the SchedulerBoss one Introduce ScheuledGrid and ScheduleLocal as base classes for Grid and local scheduler, respectively. All interaction with boss are done via Boss class, whose (unique) instance is owned by Scheduler These changes are done to reduce code duplication. Plus other minor modification and cosmetcs, as usual
cleanup
imported fixes for additional jdl paramameters management
Remove references to GRID3
Adjustment on getout timeout
changes to improve crab stdout
Using OSG_JOB_CONTACT instead of GLOBUS_GRAM_JOB_CONTACT
Using OSG_JOB_CONTACT instead of GLOBUS_GRAM_JOB_CONTACT
Allowing submission for tasks with a missing location for a block - this is a first version that block the creation and then the submision of jobs assigned to no location
Allowing submission for tasks with a missing location for a block - this is a first version that block the creation and then the submision of jobs assigned to no location
crab_1_5_4_slc3_pre1
Bug fix [removing hardcoded misstype]
Now getting the right site name from osg wn
removed data registration in lcg catalog
Added ce_white/black_list in glite list-match + bug fix ce_white_list
changed EDG_WL_LOG_DESTINATION to GLITE_WL_LOG_DESTINATION for SyncCE report from WN
Increased the timeout for single job to 180
moved export SE and SE_PATH from wsSetupEnvironment to copyOutput in SchedulerEdg
moved parsing of black/white se lists into BlackWhiteListParser.py which is intantiated in SchedulerEdg.py: list parsing during xml creation cms_cmssw.py: list parsing for screen output also SchedulerGlite.py has to use new member functions and had to be changed
moved SE white and Black list management after jobDB.destination filling
added def submitTout which retoun the timeout value
cleanup code for jdl requirements
blah and not *blah*
added requirement to skip gLite CE
many minor fixes reported by pychecker, mostly unsude import and unused variables
removed empty space while writing black & white list
logging info to v 3
add EDG.additional_jdl_parameters card to add additional parameters to JDL
fix problem with destination for group>1
cosmetics
changes to switch glite broker
fix for None input
changes to support bulk (by Fede)
SchedulerEdg and SchedulerGLite are similar, we can remove one of this,taking care of scheduler name
merged with last changes
bug fix into xml writer function
add list match for boss4 and changed some hardcoded parameter
changes for boss4
file SchedulerGlite.py was initially added on branch CRAB_BOSS4.
This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, select a symbolic revision name using the selection box, or choose 'Use Text Field' and enter a numeric revision.