remove ML message logging https://savannah.cern.ch/bugs/index.php?99330
report scheduler=GLIDEIN to dashboard for remoteGlidein: https://savannah.cern.ch/bugs/index.php?97957
report correct RBname https://savannah.cern.ch/bugs/?97919
rename scheduler rcondor to remoteglidein
improve ML reporting for rcondor
add RCONDOR scheduler
fix spelling in printout
add log message for https://savannah.cern.ch/bugs/?93114#postcomment
rollback for savannah 85243
try to remove the crab working_dir if the task has problem during creation step, savannah bug 85243
added configurable [USER].tasktype in the crab.cfg, savannah bug 76950
Fix the resubmission of automated jobs
Note on CAF's in Submitter, clarify
better handling of hashlib / sha
Fix for bug #58043: now stageout uses unique names for the files sent to SE
sha / hashlib
fix GridJobId for Dashboard reporting bug #59312
Change name of the field sent to dashboard to 'resubmitter' for bug #58044
Fix for bug #58044: distinguish automated from user driven resubmission in dashboard)
add link to Site Status Page web page in case of submission failure
removed print
Fix SchedulerJobId for Dashboard reporting for SchedulerArc.
support ranges also using WMBS.
add support for WMBS
adding SchedulerPbs
Stub for glExec specific actions during delegation, as requested by Sanjay. Typo in a log printout in Submitter code
Client-side changes from Sanjay for Glidein, deal with multiple submission attempts
Move from limiting # of created jobs to # of submitted jobs
Use scheduler name instead of hostname in jobId:s everywhere.
delegate proxy to WMS for each task submission
Fix on broken submission with range in form x-y
Make datasetPath class variable, consolidate
prepare list of jobs to be submitted after the database has been filled
mods to use new filed "state" to check if action is allowed
Added ARC support left and right.
imrpved log
Introduce a CrabLogger class which hanlde the std python logging
logging improvements
wrong condition. Removed double check
formatted print out
check "state" filed to define list of jobs to submit
common.logger.debugLevel not more there
adapting code to EDG --> GRID migration
adapting code to logging usage. (crab_logger removed)
Submission action/workflow generalized (cient,sa)
fix for dashboard
send CMSUser attribute to the dashboard
specify also the submission type (direct)
Fix [bug #46635] CMSSW version is not properly reported form CRAB to Dashboard
Fix [bug #46637] Job identifyer for Dashboard reporting in case of submission to local CAF at US sites does not follow naming convention
still a fix for ML reporting.
notify user about default T1 BL in case of no resources founded
print out improvement
Don't pass cfg_params to SiteScreening
use BLite object once possible
Transition to WMCore SiteScreening and SiteDB
fix for ML info reporting
Unique task names if ui_working_dir defined
Use identifier for CondorG/Glidein closer to Local schedulers
Minor cleanup
Fix for Dashboard reporting in CondorG
Allow patterns like T1,T3
removed EE temporary status...in case of server usage
fixed bug in Target SE reported to the dashboard
Killing status to hide latencies
check also TEMPORARY EE status
HOSTNAME and USER are not defined in case of cron job: add protection
At the submission level is now used the "fast" listmatch while the full one is performed while testing Jdl (-testJdl or -match)
removed some confusing comments
now resubmission working... still an optimization is needed on the status print on screen
fix for info sent to the dashboard in case of local scheduler
added E status in the check of jobs to submit
removed eval usage for dlsDest
hopefully last file written around... has been removed...
if inheritance is correctly implemented.. double range parsing is not neede... added some checks plus minor fixes
removed print, plus bug fix
reimplemented dashboard communication sending again both pre and post submssion infos, plus many Submitter code reorganization
implement -testJdl==-listMatch==-match functionality
Many changes to have LSF working with BossLite Introduce Killer class to handle -kill which works again Work_space::res() return the correct output directory also in case user has set a non default one, Likewise for logDir() USER.outputdir is not to be used anywhere outside workspace class Some cleanup in submit logic, to reduce call of Scheduler specific classes from Submitter.py crab -clean works as well (well, almost, still need to remove twice the directory) Fill startDirectory and outputDirectory to Task GetOuput check status and not schedulerStatus (not stantard) Some cleanup in the use of BlackWhiteListParser No explicit check of scheduler concrete type in Submitter at listMatch level: move different behaviour in SchedulerXYZ implementation Plus other things I'm forgetting... Stefano
Fix for listMatch params order
improvement on updateRunJobs method
rollback for DashBoard code... to be restored
better protection for listmatch if condorG, plus minor bugFix
removed a print and moved the njs instance outside a for-else
fixed datasetpath written in wrong way
fix for blocks of job management
fix for submission success check
still another fix on the job index plus bosslite integration optimization.
enabled submission by range...as in the past
bug fix
Implemented the listmatch support. Cleaned also the code by many old method and workarounds...
accept any capitalization of None as datasetpath
restored the possibility to change WMS (the simply endpoint and/or the full config files) at submission time via command line, plus some adjustments on submission conde
Many changes to integrate BossLite. Creation step fully implemented and optimized... Submission is now working again. Here the missing things are the support for jobs submission by range, the message sending to ML, and the listmatch_match check. Actually the requirements can be changed on the fly as was in the past. The status is fully working with BossLite. The exit code display is not there since the new boss does not implement the RealTime mon.. here the functionality is under development by Federica: to be integrated.
First version which submit jobs using blite. Not yet fully working. Minor problem with jdl arguments. Submission dose not take range yet
Consistent case
Fix exceptions for Condor_G
Fix problem in resubmission when passing a parameter the number of the job you want to resubmit eg -resubmit 4 now means (as was before) to resubmit job #4, not to resubmit 4 jobs. Create a new class Resubmitter (derived from Submitter) to deal with the logic of selecting the job to be resubmitetd from the user request and job status. This clean up a bit crab.py The actual submission is always done by Submitter::run()
more verbose message if white list is used and no site can be selected, plus similar update in documentation
add more verbose error message in case of problem in submission
fixing problem in monitoring with dashbard
improve slightly the reading of ml dictionary from file
fix to report correctly info o dashboard
Redesign the inheritance three of Scheduler Classes, and remove the SchedulerBoss one Introduce ScheuledGrid and ScheduleLocal as base classes for Grid and local scheduler, respectively. All interaction with boss are done via Boss class, whose (unique) instance is owned by Scheduler These changes are done to reduce code duplication. Plus other minor modification and cosmetcs, as usual
move all Submitter inizialization from crab.py to Submitter.py constructor
Add support for LSF/CAF direct submission Re-establish a correct inheritance pattern for Scheruled* classes Start to remove some unneeded try: catch: statement and replace them with appropriate if:then: Erase any use of cfg_param as a common block (expecially in conjuction with apmon) and replace it with the user of task DB Several minor cleanup
CE_white/black_list in glite: print adjustment + bug-fix
Added ce_white/black_list in glite list-match + bug fix ce_white_list
improved TargetSE management to avoid missing info on the dashboard. Added SubmissioType information to enabe the dashboard to show the fraction of jobs submitted directly and via Server
bug fix for list of submitted jobs
Bug fix
just a minor temporary workaround to support server_mode = 1 [if servermode =1--> move boss declaration at creation level to the submission one]
cleanup of deprecated code + use unique tag for jobtype from taskDB
remove upper-ification in log message
pbar recovered
add verbose message in case of failed submission
Cleaned indexes in run()
crabmon take destination info from boss
added information transmition to the DashBoard with jobId : TaskMeta using the information gathered in the creation step before the submission goes into the loops
fix submission
fix progressBar indicator
Fix for wrong Boss-Grid id association
add bulk resubmition and some check in clad file
deactivate progress bar completely fi debug level > 0 and added DashBoard reporting debug logger output
fix progress bar index
fix printout and progressBar
protection for no submittable jobs
no progress bar if debug mode
add progress bar
moved individual output for submission of job to debug level 1. As the output is not printed when the job is submitted but rather when the report to the DashBoard is prepared and sent, does not make sense to have it as a message on the screen (also gets longish for >1000 jobs)
moved hash generation for condor-g to constructor
add block in JobDB and recover SchedulerEdg
changes to submit job per group
add some timing
deactivate listMatch for condor-g
more mode for merging with boss4 branch
BOSS4 + sub-file splitting + taskDB
targetSite sent to dashboard is job specific
Small bug fix on listMatch calls, changed message output
more clever code for listMatch: perform listmatch only if destination wrt previous job has changed
Run edg-job-list-match for all jobs being submitted
Integrate CMSSW: remove number of events per job from ML reporting
added monitoring for OSG using EDG and Condor-G scheduler
compliant with the new ApmonIf
Reads a file with relevant ML params
cosmetics
added ORCA_COMMON in jobtype if query, changed grid-proxy-info to voms-proxy-info and secure parsing of jid and rb, in case of condor, no https grid id is available
typo
removed ML info grabbed from jobtype objects
Removed the call to free() for apmon
add check for jobtype ORCA DBSDLS
Fix for FAMOS not supporting CEs lists
Uncomment Statistic call from previous version
Added parameters for ML
some changes for FAMOS and LFC
Modified to be compliant with the new Boss TaskId definition
moved fillDict in a if and removed some print
Fixed ML bug
Added a call to apmon.free() to release resources and kill threads
modify to support resubmit
improved runCommand plus cosmetics
Keeps better track of exceptions
now common block for proto-mon
switch off ML on demand
fix create and submit
try also notify...
again try except before ML
Bug fix for ML
try except for ML
cosmetic
mods to run with central bossDB or task-limited bossDB
Bug fix
fixed bugs
Save job status also in case of submission failure
commented common.logger.message(msg) at 48 line
commented print
fix to have Marco crap work
Bug fix in the parameter list
crab-mon
MonaLisa monitoring integration
more changes
too many changes to list them here...
more flexible syntax for job range
bug fixed
'-resubmit' implemented
The '-continue' option implemented
Job submission implemented
initial set of files
This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, select a symbolic revision name using the selection box, or choose 'Use Text Field' and enter a numeric revision.