added slash in FOR_LFN
fixed tipe error --> modifyReport_result
changes to run ModifyJobReport in OSG env
printout removed
put additional input files into a tgz _and_ mods to cope with new syntax in pset for maxEvents for CMSSW>150
changed ApplicationFamily name
copy pset.cfg from $RUNTIMEAREA to topdir, lost in 1.90
changes to publish option
changes for DBS2 output publication
Changed job creation and output to be independent of black and white lists. All jobs are created after data discovery and job spitting using black and white lists independent from the entries in the destination list of jobs. If a job does not have any valid destination sites, it is nontheless created. After job splitting, a screen output listing all blocks and all jobs belonging to a block is shown listing available sites per block. The user can submit x number of jobs while CRAB will skip in addition to the normal job submission all jobs which have an empty destination list.
temporarly comment arch requiremtns for 153_pre1
re-introduce handling of various random seeds, lost in version 1.85
add VO-cms-$SCRAM_ARCH as a requirement to jdl
fix for reporting correct error code if output file is missing
export SCRAM_ARCH if grid is OSG
merge version 1.84 with 1.83
Again the fix on additional input files and relative paths
move setting of SCRAM_ARCH before actual creatio of scram project
move import of DBS/DLS stuff to beginning of DataDiscoveryAndLocation. They are needed noly there and beside provide a cleaner error message when trying to create w/o eval scram runtime
InputSandBox max size default to 9.5 Mb
removed some line added by cvs update?? (<<<<<<< cms_cmssw.py)
DBS2 is default
Fix for relative path for additional input files
input sandbox is set by default to 9.5 Mb: actual liit is 10, 1/2 Mb is for crab stuff
add handling for g4SimHits and mix random seeds and cleanup the sed manipulation in wrapper script
fix bug in checking existence of additional_input_files
DBS tag changed to latest tag: DBS_1_0_0_pre6 DBS default URL changed to : http://cmsdbsprod.cern.ch/cms_dbs_int_global/servlet/DBSServlet DBS api version changed to : v00_00_06 new format of datasetPath: /primaryDataset/processedDataset/Tier Parsing for ML report adapted accordingly
fixed case when user defined executable is not within the CMSSW user project area
User defined executable was packed into wrong subdirectory in default.tgz and could not be found on wn corrected to be packed on the top level of defalt.tgz
Provide check for default.tgz tarball size to limit input sandbox size for all submission systems. Condor_G has no sandbox size check as EGEE does, so a size check on the default.tgz tarball which now also contains the data directories was introduced. The default is 100 MB. It can be changed by: [EDG] maxtarballsize = X where X is the size in MB (float). The switch is not documented in the template crab.cfg not to mislead users.
set SCRAM_ARCH on WN to the one got from user environment
re-establish submission and execution of user script
Prevent crash in case of empty fileblock.
cms_cmssw.py
Add dbs_version card for steering the api version of the selected dbs server, default v00_00_05. Improved exception handling
Added card "use_dbs_2" to crab.cfg to steer usage of DBS-1 (default) or DBS-2
added last job splitting combination (event_per_job & number_of_job) for NON input mode
fix check existence of additional input files before doing anything with them
many minor fixes reported by pychecker, mostly unsude import and unused variables
cleanup
rewrite the creation of tar-ball files, using the tarfile module from python rather than opening a shell and do tar -czvf... Moreover, non need to copy anything in swArea for ProdAgent stuff not ML
add all data dir found in swarea to tar-ball
add option to tar to dereference symlinks
set relative path also for additional input files
added "first run" parameter managment for pythia job
ML files added to the tgz
put sw version on TaskDB
fix to change name, adding _NUM, also to FJR
The FJR produced by each jobs is always returned via output sandbox even if the ouput is copied to a SE, as already happens for stdout and err
forgot printout
strip whitespaces from file names
added FrameworkJobReport crab_fjr.xml per default to output sandbox, copy ProdAgentApi directory from to swAera of local USER CMSSW project, include ProdAgentApi into PYTHONPATH on WN
cosmetics
commented out last call to analisys_common_info
remove common.analisys_common_info
correct variable replacement in CMSSW parameter-set
allow wildcards in additional input files
fixed splitting logic, added forgotten increase of counter, changed event caluclation for last job
working dir creation on OSG moved to mktemp
bug fix to write correctly xml in case of None datasetPath jobs
BOSS4 + sub-file splitting + taskDB
Fixed cmsset.sh dir for OSG sites
fixed argument replacing in pset
introduced sub fileblock splitting and added discovery only for requested jobs (-create 100)
Gets events/file. Requires cvs head of DBS/Clients/PythonAPI
targetSite sent to dashboard is job specific
Commit for Malina: Handled block-splitting for CMSSW and CE->SE in .jdl files
Burt Holzman fix for arguments and VO_CMS_SW_DIR/cmsset_default.sh
Burt Holzman fix for arguments and VO_CMS_SW_DIR/cmsset_default.sh
Burt Holzman fix for arguments and /uscmst1/prod/sw/cms/cmsset_default.sh
Shell script strips full path from additional_input_files and uses only the file name for copying from RUNTIME_AREA to the scram project directory
printout removed
additional_input_files is in USER section, not in CMSSW
cosmetics for VTx set
add manipulation VtxSmeared
copy pset to pset.cfg even if untouched: bugfix
better messages
copy pset to pset.cfg even if untouched
fix problem in splitting and modify seed only if defined
better job splitting for cmssw
splitting per events
simplify and fix handling of list in JobDB
fix probem if ask more events than available
fixed bug related to total number of file and jobs
fix problem in job arguments definition
fix bug if asked all events but more files per job than total available
minor fix in printout
removed GridSyncJobId from the fields which are reported every time from the WN script to the DashBoard
changes WN wrapper script ML reporting to report only the relevant information (repo is deleted after report to ML) at any stage of WN script
changed common.logger.message for total_number_of_events
commented a print
support for None input
support for "none" datasetpath" and split by events
added taskId to be reported at Submission time
moved initial DashBoard reporting to scheduler, added failure codes for OSG WN tmp directory removal, fixed bugs in DashBoard exitcode reporting (no spaces)
moved SyncGridId creation in wrapper script to front that error exit codes during job setup are reported correctly to the DashBoard
added ML reporting of application, dataset, owner and fixed monitoring for status check for condor-g
add optional (secret) switches for DLS type (both in ORCA and CMSSW jobtype) and for DBS instances (in CMSSW jobtype).
Integrate CMSSW: added OSG capabilities
bug fix in copying multiple files on SE. BTW same code in 4 different classescvscheckcvscheck BAD!
initial version of cmssw jobtype
This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, select a symbolic revision name using the selection box, or choose 'Use Text Field' and enter a numeric revision.