removed the already deprecated scheduler EDG
fix ce_black/white_list handling choerently with SchedulerGrid (otherwise edg job creation was failing if ce_black/white_list were present)
fixed sintax error while checking addJdlParam
Redesign the inheritance three of Scheduler Classes, and remove the SchedulerBoss one Introduce ScheuledGrid and ScheduleLocal as base classes for Grid and local scheduler, respectively. All interaction with boss are done via Boss class, whose (unique) instance is owned by Scheduler These changes are done to reduce code duplication. Plus other minor modification and cosmetcs, as usual
Add support for LSF/CAF direct submission Re-establish a correct inheritance pattern for Scheruled* classes Start to remove some unneeded try: catch: statement and replace them with appropriate if:then: Erase any use of cfg_param as a common block (expecially in conjuction with apmon) and replace it with the user of task DB Several minor cleanup
fixed problem with output copy and check output sandbox size
fixed bug for additional jdl parameter management
Remove references to GRID3
Adjusting env proxy check
fix for X509_USER_proxy search..
Adjustment on getout timeout
changes to improve crab stdout
Using OSG_JOB_CONTACT instead of GLOBUS_GRAM_JOB_CONTACT
Using OSG_JOB_CONTACT instead of GLOBUS_GRAM_JOB_CONTACT
add check if both return_data and copy_data are set to 1: in case raise exceptionSchedulerCondor_g.py
Fixed check of myproxy
add check if both return_data and copy_data are set to 1: in case raise exception
Allowing submission for tasks with a missing location for a block - this is a first version that block the creation and then the submision of jobs assigned to no location
Allowing submission for tasks with a missing location for a block - this is a first version that block the creation and then the submision of jobs assigned to no location
added control for output production before copy
added a control about output production, before copy
crab_1_5_4_slc3_pre1
Bug fix [removing hardcoded misstype]
Now getting the right site name from osg wn
removed data registration in lcg catalog
other change copy message
change copy message
removed lcg_version
changes for output copy to SE
remoevd temporary patch introduced to avoid problems with X509_USER_PROXY variable
hopefully very temporary patch to avoid cmssw/lcg compatibility env. problems
modify copy_output section in order to use the new cmscp function defined in crab_tempalte.sh + remove copy and register
removed lcg-cp command and removed some old comments
if the output copy to a SE fails, the SE name is set as empty string for publication
wrong position.....
fix a missing checkProxy
moved parsing of black/white se lists into BlackWhiteListParser.py which is intantiated in SchedulerEdg.py: list parsing during xml creation cms_cmssw.py: list parsing for screen output also SchedulerGlite.py has to use new member functions and had to be changed
remove mkdir ~/.srmconfig
moved SE white and Black list management after jobDB.destination filling. In addition Switched edg-brockerinfo to glite-brokerinfo... edg will be oblsolete on slc4
add string.strip for UserGridName to avoid problem on SE_PATH if publish data = 1
more robust extraction of user name from voms-proxy-init -identity
removed a slash in srmcp command and rewrite the original lcg-cp command
convert srt to int
changes to run in OSG --> voms-proxy-info problem
Maybe it doesn't harm, but added a newline which was missing
added def submitTout which retoun the timeout value
removed old USER.processed_data
changes to copy output to lnl srm
add check if both copy_data and return_data are set to 1: raise exception
small bug fix on checkProxy method
add user-proxy-location info, and changed chain_name in boss xml file
Removed duplication of additional input files in InputSandbox
fixed bug for JOB_EXIT_STATUS
many minor fixes reported by pychecker, mostly unsude import and unused variables
set relative path also for additional input files
no absolute path in boss xml file
import from 1_4_2 fix for seroius bug for edg requirements
Changed Boss cache dir
fix serious bug in adding requirements
fix serious bug in adding requirements
ML files added to the tgz
removed empty space while writing black & white list
optimization for status: instead of getting the status of the jobs one by one, load into memory that of all and use the cached result. Second optimization: use range of type <first:last> for consecutive jobs in all boss commnand, instead of passing the full list n,n+1,n+2,...m-1,m
The FJR produced by each jobs is always returned via output sandbox even if the ouput is copied to a SE, as already happens for stdout and err
add new card <EDG.dont_check_proxy> which swich off the proxy check (as well as proxy delegation) as requested by Brian Bockelman
add card to copy input data (not used)
add EDG.additional_jdl_parameters card to add additional parameters to JDL
removed print
changes to switch glite broker
ShallowRetryCount
add ShallowResubmissionRetryCount
add FrameworkJobReport python WN parsing script per default to input sandbox
minor fix in group and requirements
updated maximal voms proxy length to 192 h
Changed messages, fixed minor bug for SE output
Ok, the next one who changes this file w/o careful check, will be hanged :-)
corrected my wrong commit
more problem in merging
add block in JobDB and recover SchedulerEdg
moved requirement from XML to classadd (a classad for each group)
change order of srmcp and lcg-cp
next fix for removal of analisys_common_info. analisys_common_info previously hold a flag for copy_input_data probably needed by famos to stage in input files to deactvate stage-in for cmssw. As ORCA support is dropped in >= CRAB_1_3_0, we can safely set this to 0 in SchedulerEdg.py
use in srmcp command
reordered middleware discovery
bug fix to write correctly xml in case of None datasetPath jobs
delete a space in inbox files list
more mode for merging with boss4 branch
BOSS4 + sub-file splitting + taskDB
SchedulerEdg and SchedulerGLite are similar, we can remove one of this,taking care of scheduler name
optimization of xml creation
add strip agruments into the wrapper
add iterator for xml and other changes related to the xml sintax
first attempt to remove old functions
fixed stderr-stdout
changed for xml creation
first changes to use iterator
removed test branch
test branch
support VOMS role and use VO as defined in crab.cfg
Commit for Malina: Handled block-splitting for CMSSW and CE->SE in .jdl files
lcg-cp verbose for debug level >= 5
Burt Holzman fix for arguments and VO_CMS_SW_DIR/cmsset_default.sh
Burt Holzman fix for arguments and /uscmst1/prod/sw/cms/cmsset_default.sh
fixed stderr and stdout
Increased timeouts
add list match for boss4 and changed some hardcoded parameter
changes for boss4
test_branch_2
test_branch
Commit for Malina (who is waiting for enough Karma): added usage of gLite UI on OSG sites to use lcg-cp. If lcg-cp fails, try srmcp both on OSG and LCG sites
copy_input_pu_exit_status error
change some echos
from /afs/cern.ch/user/f/fanzago/scratch0/CRAB/python to RUNTIME_AREA
redirection of voms error
... sh error
...txt error...
change about output copy to SE
removed GridSyncJobId from the fields which are reported every time from the WN script to the DashBoard
changes WN wrapper script ML reporting to report only the relevant information (repo is deleted after report to ML) at any stage of WN script
removed bug in copy_exit_status
cleanup in code for requirements
protection for no taskId
moved initial DashBoard reporting to scheduler, added failure codes for OSG WN tmp directory removal, fixed bugs in DashBoard exitcode reporting (no spaces), introduced default for other.GlueCEPolicyMaxCPUTime of 1000
added default max_wall_clock_time of 8 hours, added submission to sites which publish max_wall_clock_time=0 (no restrictions assumed)
changed validity time of requested proxy in voms-proxy-init to 96 hours (new maximal possible length of lcg-voms.cern.ch)
moved SyncGridId creation in wrapper script to front that error exit codes during job setup are reported correctly to the DashBoard
Integrate CMSSW: changes due to arguments string rather than separate data members for first event, etc.
Substitute os.getlogin with os.environ['USER']
check also localTime
fixed proxy with timeleft = 0 problem
change voms-proxy-info - actimeleft to get only the first attribute
use myproxy server with voms: update for appropriate chack
include EdgConfig and update checkProxy to voms
final version of jobtype supporting both Lcg and Osg
changes related to black and white list
added DashboardAPI.py to be included in input sandbox. Missing for new apmon api
Get RB configuration files automatically
increased time out for stage out from 30 to 1200
protection for listMatch failure
add loop for pile Up & mior bug fixed
bug fix for famos
removed a print
fixed bug related to additional files in inputsandbox
added new function CopyInput
some changes for FAMOS and LFC
change paramenter name
first test with LFC catalog
changed output copy commands
New error code and new files added to the inputsandbox
resubmit
improved runCommand plus cosmetics
fix problem in list match with better parsing
fixed problem with copy_data, return_data and register_data value
removed a print
fixed list_match bug
fixed bug with close_se
fixed bug about "created job status"
post mortem ok
removed self.configOpt from logging_info command
PostMortem with boss
use standard runCommand() for edg-list-match so if exit>0 stdout/err is printed
remove printout
get sid from output, not from command
Fix problem in check and create proxy
mods to run with central bossDB or task-limited bossDB
boss table entry exit_code
moved EDG_WL_LOCATION ...
changed crab, orca and edg schema, to grep new exit_code
changed for copy and register data
fixed bugs
lines about glite
Allow user to manage grid-proxy-init interactively
new function sched_param, changed createJdl in createSchScript
proto mon
too many changes to be listed here...
too many changes to be listed...
too many changes to list them here...
Commands '-list', '-status', '-kill', '-retrieve' implemented
The '-continue' option implemented
Job submission implemented
job script generation implemented
initial set of files
This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, select a symbolic revision name using the selection box, or choose 'Use Text Field' and enter a numeric revision.