edu.isi.pegasus.planner.common
public class PegasusProperties extends Object implements Cloneable
org.griphyn.common.util.CommonProperties
Modifier and Type | Class and Description |
---|---|
static class |
PegasusProperties.CLEANUP_SCOPE
An enum defining The scope for cleanup algorithm
|
Modifier | Constructor and Description |
---|---|
private |
PegasusProperties(String confProperties)
The constructor that constructs the default paths to the various
configuration files, and populates the singleton instance as required.
|
Modifier and Type | Method and Description |
---|---|
boolean |
abortOnFirstJobFailure()
Returns a boolean indicating whether seqexec trips on the first job failure.
|
boolean |
assignDefaultJobPriorities()
Returns a boolean indicating whether we assign job priorities or not
to the jobs
Referred to by the "pegasus.job.priority.assign" property.
|
boolean |
bypassFirstLevelStagingForInputs()
Returns a boolean indicating whether to bypass first level staging of
inputs.
|
Object |
clone()
Returns the clone of the object.
|
boolean |
createRegistrationJobs()
Returns a boolean indicating whether we create registration jobs or not.
|
boolean |
disableInvokeInGridStart()
Returns a boolean indicating whether to disable use of invoke or not.
|
boolean |
doStatWithKickstart()
Return a boolean indicating whether to turn the stat option for kickstart
on or not.
|
boolean |
executeOnWorkerNode()
Returns a boolean indicating whether to have jobs executing on worker
node tmp or not.
|
boolean |
generateKickstartExtraOptions()
Returns a boolean indicating whehter to pass extra options to kickstart
or not.
|
boolean |
generateLOFFiles()
Return a boolean indicating whether to generate the LOF files for the jobs
or not.
|
String |
getAllIgnoredSites()
Returns a comma separated list of sites, from which to ignore data
transfers for all sites.
|
String |
getAllPreferredSites()
Returns a comma separated list of sites, from which to prefer data
transfers for all sites.
|
String |
getBaseSourceURLForSetupTransfers()
Returns the base source URL where pointing to the directory where the
worker package executables for pegasus releases are kept.
|
File |
getBinDir()
Accessor to the bin directory of the Pegasus install
|
String |
getChmodDisabledSites()
Returns the list of sites for which the chmod job creation has to be
disabled for executable staging.
|
String |
getCleanupImplementation()
Returns the name of the class that the user wants, to render the cleanup
jobs.
|
PegasusProperties.CLEANUP_SCOPE |
getCleanupScope()
Returns the scope for file cleanup.
|
String |
getCleanupStrategy()
Returns the name of the Strategy class that the user wants, to insert the
cleanup jobs in the graph.
|
String |
getClustererLabelKey()
Returns the key that is to be used as a label key, for labelled
clustering.
|
String |
getClusterSizeCleanupJobsPerLevel()
Returns the fraction of cleanup jobs clustered into a single clustered
cleanup job.
|
String |
getCollapseFactors()
Returns a comma separated list for the node collapsing criteria for the
execution pools.
|
String |
getCreateDirClass()
Returns the name of the class that the user wants, to insert the
create directory jobs in the graph in case of creating random
directories.
|
String |
getCreateDirImplementation()
Returns the name of the class that the user wants, to render the directory
creation jobs.
|
String |
getCredName()
Returns the credential name to be used for the stork transfer jobs.
|
String |
getDAXSchemaLocation()
Returns the location of the schema for the DAX.
|
String |
getDAXSchemaLocation(String defaultLocation)
Returns the location of the schema for the DAX.
|
String |
getDefaultPathToCondorKickstart()
Returns the default path to the condor kickstart.
|
String |
getDefaultPathToSC()
Returns the default path to the site catalog file.
|
String |
getDefaultPathToTC()
Returns the default path to the transformation catalog.
|
private String |
getDefaultThirdPartySites()
Returns the default list of third party sites.
|
private String |
getDefaultTransferImplementation()
Returns the default transfer implementation to be picked up for
constructing transfer jobs.
|
private String |
getDefaultTransferPriority()
Returns the default priority for the transfer jobs if specified in
the properties file.
|
String |
getExecDirectory()
Returns the execution directory suffix or absolute specified
that is appended/replaced to the exec-mount-point specified in the
pool catalog for the various pools.
|
String |
getGridFTPTimeout()
Returns the timeout value in seconds after which to timeout in case of
opening sockets to grid ftp server.
|
String |
getGridStart()
Returns the GRIDSTART that is to be used to launch the jobs on the grid.
|
long |
getGridStartInvokeLength()
Returns the trigger value for invoking an application through kickstart
using kickstart.
|
String |
getHorizontalClusterPreference()
Returns the users horizontal clustering preference.
|
String |
getHorizontalPartitionerBundleValue(String name)
Returns the bundle value for a particular transformation.
|
String |
getHorizontalPartitionerCollapseValue(String name)
Returns the collapse value for a particular transformation.
|
String |
getHttpLog4jURL()
Returns the http url for log4j properties for windward project.
|
static PegasusProperties |
getInstance()
Returns an instance to this properties object.
|
static PegasusProperties |
getInstance(String confProperties)
Returns an instance to this properties object.
|
String |
getJobAggregator()
Returns what job aggregator is to be used to aggregate multiple
compute jobs into a single condor job.
|
String |
getLog4JLogFile()
Returns the location of the local log file where you want the messages to
be logged.
|
String |
getLogFormatter()
Returns the log formatter to use.
|
String |
getLoggingFile()
Returns the file to which all the logging needs to be directed to.
|
String |
getLogManager()
Returns the log manager to use.
|
List |
getMatchingProperties(String prefix,
boolean system)
Returns the properties matching a particular prefix as a list of
sorted name value pairs, where name is the full name of the matching
property (including the prefix) and value is it's value in the properties
file.
|
String |
getMaximumCleanupJobsPerLevel()
Returns the maximum number of clean up jobs created per level of the workflow
in case of InPlace cleanup.
|
String |
getMetricsLogFile()
Returns the path to the file that is used to be logging metrics
Referred to by the "pegasus.log.metrics.file" property.
|
String |
getNumOfTransferProcesses()
It returns the number of processes of g-u-c that the transfer script needs to
spawn to do the transfers.
|
String |
getNumOfTransferStreams()
It returns the number of streams that each transfer process uses to do the
ftp transfer.
|
String |
getPartitionerDAXCallback()
Returns the DAXCallback that is to be used while parsing the DAX.
|
String |
getPartitionerLabelKey()
Returns the key that is to be used as a label key, for labelled
partitioning.
|
String |
getPartitionParsingMode()
Returns the mode for parsing the dax while writing out the partitioned
daxes.
|
String |
getPDAXSchemaLocation(String defaultLocation)
Returns the location of the schema for the PDAX.
|
String |
getPoolFile()
Returns the path to the pool file.
|
String |
getPoolMode()
Returns the mode to be used for accessing the pool information.
|
String |
getPoolSchemaLocation()
Returns the location of the schema for the DAX.
|
String |
getPoolSchemaLocation(String defaultLocation)
Returns the location of the schema for the site catalog file.
|
Namespace |
getProfiles(Profiles.NAMESPACES ns)
Returns all the profiles relevant to a particular namespace
|
String |
getPropertiesInSubmitDirectory()
Returns the path to the property file that has been writting out in
the submit directory.
|
String |
getProperty(String key)
It allows you to get any property from the property file without going
through the corresponding accesor function in this class.
|
private String |
getProperty(String newProperty,
String deprecatedProperty)
This function is used to check whether a deprecated property is used or
not.
|
private String |
getProperty(String newProperty,
String deprecatedProperty,
String defaultValue)
This function is used to check whether a deprecated property is used or
not.
|
String |
getRefinementProvenanceStore()
Returns the provenance store to use to log the refiner actions.
|
String |
getReplicaMode()
Returns the replica mode.
|
String |
getReplicaSelector()
Returns the name of the selector to be used for selection amongst the
various replicas of a single lfn.
|
String |
getRLIURL()
Returns the url to the RLI of the RLS.
|
int |
getRLSTimeout()
It returns the timeout value in seconds after which to timeout in case of
no activity from the RLS.
|
String |
getRootWorkflowUUID()
Returns the root workflow UUID if defined in the properties, else null
Referred to by the "pegasus.workflow.root.uuid" property.
|
File |
getSchemaDir()
Accessor to the schema directory of the Pegasus install
|
File |
getSharedDir()
Accessor to the bin directory of the Pegasus install
|
String |
getSiteSelectorKeep()
Returns a value designating whether we need to keep the temporary files
that are passed to the external site selectors.
|
String |
getSiteSelectorMode()
Returns the class name of the site selector, that needs to be invoked to do
the site selection.
|
String |
getSiteSelectorPath()
Returns the path to the external site selector that needs to be called
out to make the decision of site selection.
|
int |
getSiteSelectorTimeout()
It returns the timeout value in seconds after which to timeout in case of
no activity from the external site selector.
|
String |
getSLSTransferArguments()
Returns the extra arguments with which the SLS transfer executables needs
to be invoked.
|
String |
getSLSTransferImplementation()
Returns the sls transfer implementation that is to be used for constructing
the transfer jobs.
|
String |
getStagingDelimiter()
Returns the delimiter to be used for constructing the staged executable
name, during transfer of executables to remote sites.
|
String |
getStorageDirectory()
Returns the storage directory suffix or absolute specified
that is appended/replaced to the storage-mount-point specified in the
pool catalog for the various pools.
|
String |
getSubmitLogsDirectory()
Returns the the path to the logs directory on the submit host.
|
String |
getSubmitMode()
Returns which submit mode to be used to submit the jobs on to the grid.
|
File |
getSysConfDir()
Accessor to $PEGASUS_HOME/etc.
|
String |
getTCMapperMode()
Returns the mode for loading the transformation mapper that sits in
front of the transformation catalog.
|
String |
getTCMode()
Returns the mode to be used for accessing the Transformation Catalog.
|
String |
getTCPath()
Returns the location of the transformation catalog.
|
String |
getThirdPartySites(String property)
Returns the comma separated list of third party sites, specified in the
properties.
|
String |
getThirdPartySitesRemote(String property)
Returns the comma separated list of third party sites for which
the third party transfers are executed on the remote sites.
|
String |
getTransferArguments()
Returns the arguments with which the transfer executable needs
to be invoked.
|
String |
getTransferImplementation()
Returns the transfer implementation that is to be used for constructing
the transfer jobs.
|
String |
getTransferImplementation(String property)
Returns the transfer implementation.
|
String |
getTransferInterPriority()
Returns the priority to be set for the interpool transfer job.
|
private String |
getTransferPriority(String property)
Returns the transfer priority.
|
String |
getTransferRefiner()
Returns the transfer refiner that is to be used for adding in the
transfer jobs in the workflow
Referred to by the "pegasus.transfer.refiner" property.
|
String |
getTransferStageInPriority()
Returns the priority to be set for the stage in transfer job.
|
String |
getTransferStageOutPriority()
Returns the priority to be set for the stage out transfer job.
|
String |
getTXSelectorMode()
Returns the mode for loading the transformation selector that selects
amongst the various candidate transformation catalog entry objects.
|
boolean |
getUseOfSymbolicLinks()
It returns whether the use of symbolic links in case where the source
and destination files happen to be on the same file system.
|
CommonProperties |
getVDSProperties()
Returns the CommonProperties that this object encapsulates.
|
String |
getWingsPropertiesFile()
Returns the path to the wings properties file.
|
String |
getWingsRequestID()
Returns the request id.
|
private void |
initializePropertyFile(String confProperties)
Gets the handle to the properties file.
|
boolean |
labelBasedSubmitDirectoryForSubWorkflows()
Returns a boolean indicating whether the submit directory for the sub
workflows should include the label of the sub workflow or not.
|
private void |
logDeprecatedWarning(String deprecatedProperty,
String newProperty)
Logs a warning about the deprecated property.
|
boolean |
logJobAggregatorProgress()
Returns whether the seqexec job aggregator should log progress to a log or not.
|
boolean |
logJobAggregatorProgressToGlobal()
Returns whether the seqexec job aggregator should write to a global log or not.
|
Properties |
matchingSubset(String prefix,
boolean keepPrefix)
Extracts a specific property key subset from the known properties.
|
Map<Profiles.NAMESPACES,String> |
namespaceToPropertiesPrefix() |
static PegasusProperties |
nonSingletonInstance()
To get a reference to the the object.
|
protected static PegasusProperties |
nonSingletonInstance(String confProperties)
To get a reference to the the object.
|
boolean |
preserveParserLineBreaks()
Returns a boolean indicating whether to preserver line breaks.
|
boolean |
quoteTransferURL()
Returns whether to introduce quotes around url's before handing to
g-u-c and condor.
|
Profiles |
retrieveProfilesFromProperties()
Retrieves profiles from the properties
|
protected Profiles |
retrieveProfilesFromProperties(CommonProperties properties)
Retrieves profiles from the properties
|
private void |
sanitizePathForProperty(Properties properties,
String key)
Santizes the value in the properties .
|
protected static void |
sanityCheck(File dir)
Checks the destination location for existence, if it can
be created, if it is writable etc.
|
boolean |
setPostSCRIPTDebugON()
Returns a boolean indicating whether to turn debug on or not for exitcode.
|
Object |
setProperty(String key,
String value)
Accessor: Overwrite any properties from within the program.
|
boolean |
setXBitWithKickstart()
Returns a boolean indicating whether kickstart should set x bit on
staged executables before launching them.
|
boolean |
stageSLSFilesViaFirstLevelStaging()
Returns a boolean indicating whether to stage sls files via Pegasus
First Level Staging or let Condor do it.
|
boolean |
symlinkCommonLog()
Completely disable placing a symlink for Condor common log (indiscriminately).
|
boolean |
transferWorkerPackage()
It specifies if the worker package needs to be staged to the remote site
or not.
|
boolean |
treatCacheAsRC()
Returns a boolean indicating whether to treat the entries in the cache
files as a replica catalog or not.
|
boolean |
useCondorQuotingForArguments()
Returns a boolean indicating whether we want to Condor Quote the
arguments of the job or not.
|
boolean |
useDeepStorageDirectoryStructure()
Returns a boolean indicating whether to have a deep storage directory
structure or not while staging out data to the output site.
|
boolean |
useExtendedTimeStamp()
It specifies whether to use the extended timestamp format for generation
of timestamps that are used to create the random directory name, and for
the classads generation.
|
boolean |
useForceInTransfer()
It specifies whether the underlying transfer mechanism being used should
use the force option if available to transfer the files.
|
boolean |
useInvokeInGridStart()
Returns a boolean indicating whether to use invoke in kickstart always
or not.
|
boolean |
useTimestampForDirectoryStructure()
Returns a boolean indicating whether to use timestamp for directory
name creation or not.
|
boolean |
writeOutMetrics()
Returns a boolean indicating whether to write out the planner metrics
or not.
|
String |
writeOutProperties(String directory)
Writes out the properties to a temporary file in the directory passed.
|
String |
writeOutProperties(String directory,
boolean sanitizePath)
Writes out the properties to a temporary file in the directory passed.
|
String |
writeOutProperties(String directory,
boolean sanitizePath,
boolean setInternalVariable)
Writes out the properties to a temporary file in the directory passed.
|
public static final String DISABLE_INVOKE_PROPERTY
public static final String PEGASUS_WORKER_NODE_EXECUTION_PROPERTY
public static final String PEGASUS_TRANSFER_WORKER_PACKAGE_PROPERTY
public static final String PEGASUS_TRANSFORMATION_CATALOG_PROPERTY
public static final String PEGASUS_TRANSFORMATION_CATALOG_FILE_PROPERTY
public static final String PEGASUS_REPLICA_CATALOG_PROPERTY
public static final String PEGASUS_REPLICA_CATALOG_FILE_PROPERTY
public static final String PEGASUS_SITE_CATALOG_PROPERTY
public static final String PEGASUS_SITE_CATALOG_FILE_PROPERTY
public static final String PEGASUS_APP_METRICS_PREFIX
public static final String DEFAULT_RC_COLLECTION
public static final String DEFAULT_RLI_URL
public static final String DEFAULT_RLS_QUERY_MODE
public static final String DEFAULT_RLS_EXIT_MODE
public static final String DEFAULT_RLS_QUERY_ATTRIB
public static final String DEFAULT_LRC_IGNORE_URL
public static final String DEFAULT_RLS_TIMEOUT
public static final String DEFAULT_EXEC_DIR
public static final String DEFAULT_STORAGE_DIR
public static final String DEFAULT_TC_MODE
public static final String TC_TEXT_FILE
public static final String TC_DATA_FILE
public static final String DEFAULT_POOL_MODE
public static final String DEFAULT_CONDOR_BIN_DIR
public static final String DEFAULT_CONDOR_CONFIG_DIR
public static final String SC_XML_FILE
public static final String SC_XML3_FILE
public static final String CONDOR_KICKSTART
public static final String DEFAULT_STAGING_DELIMITER
public static final String DEFAULT_TRANSFER_PROCESSES
public static final String DEFAULT_TRANSFER_STREAMS
public static final String DEFAULT_GRIDSTART_MODE
public static final String DEFAULT_INVOKE_LENGTH
public static final String DEFAULT_SITE_SELECTOR
public static final String DEFAULT_SITE_SELECTOR_TIMEOUT
public static final String DEFAULT_SITE_SELECTOR_KEEP
public static final String DEFAULT_DATA_MULTIPLICATION_FACTOR
public static final String DEFAULT_COMP_MULTIPLICATION_FACTOR
public static final String DEFAULT_COMP_ERROR_PERCENTAGE
public static final String DEFAULT_COMP_VARIANCE_PERCENTAGE
public static final String DEFAULT_JOB_AGGREGATOR
public static final String DEFAULT_TC_MAPPER_MODE
public static final String DEFAULT_TX_SELECTOR_MODE
public static final String DEFAULT_LOGGING_FILE
public static final String ALL_TRANSFER_PRIORITY_PROPERTY_KEY
public static final String ROOT_WORKFLOW_UUID_PROPERTY_KEY
public static final String DEFAULT_DAGMAN_MAX_PRE_VALUE
private static final String DEFAULT_DAX_CALLBACK
private String mPegasusHome
private CommonProperties mProps
private String mDefaultTC
private String mDefaultPoolFile
private String mDefaultTransferPriority
private Set mDeprecatedProperties
private String mPropsInSubmitDir
private Profiles mProfiles
private static Map<Profiles.NAMESPACES,String> mNamepsaceToPropertiesPrefix
private PegasusProperties(String confProperties)
confProperties
- the path to conf properties, that supersede the
loading of properties from $PEGASUS_HOME/.pegasusrcpublic Map<Profiles.NAMESPACES,String> namespaceToPropertiesPrefix()
public static PegasusProperties getInstance()
public static PegasusProperties getInstance(String confProperties)
confProperties
- the path to conf properties, that supersede the
loading of properties from $PEGASUS_HOME/.pegasusrcprotected static PegasusProperties nonSingletonInstance(String confProperties)
confProperties
- the path to conf properties, that supersede the
loading of properties from $PEGASUS_HOME/.pegasusrcpublic static PegasusProperties nonSingletonInstance()
public Profiles retrieveProfilesFromProperties()
properties
- the common properties so farprotected Profiles retrieveProfilesFromProperties(CommonProperties properties)
properties
- the common properties so farpublic Object clone()
public File getBinDir()
public File getSchemaDir()
public File getSharedDir()
public Namespace getProfiles(Profiles.NAMESPACES ns)
ns
- the namespace corresponding to which you need the profilespublic String getDefaultPathToTC()
public String getDefaultPathToSC()
getPoolMode()
public String getDefaultPathToCondorKickstart()
private void initializePropertyFile(String confProperties)
confProperties
- the path to conf properties, that supersede the
loading of properties from $PEGASUS_HOME/.pegasusrcpublic String getProperty(String key)
key
- the property whose value is desired.public CommonProperties getVDSProperties()
public Object setProperty(String key, String value)
key
- is the key to look upvalue
- is the new property value to place in the system.public Properties matchingSubset(String prefix, boolean keepPrefix)
prefix
- is the key prefix to filter the properties by.keepPrefix
- if true, the key prefix is kept in the resulting
dictionary. As side-effect, a key that matches the prefix exactly
will also be copied. If false, the resulting dictionary's keys are
shortened by the prefix. An exact prefix match will not be copied,
as it would result in an empty string key.is used to assemble matches
public List getMatchingProperties(String prefix, boolean system)
prefix
- the prefix for the property names.system
- boolean indicating whether to match only System properties
or all including the ones in the property file.NameValue
objects corresponding to the matched
properties sorted by keys.
null if no matching property is found.public File getSysConfDir()
public String getDAXSchemaLocation()
public String getDAXSchemaLocation(String defaultLocation)
defaultLocation
- the default location to the schema.public String getPDAXSchemaLocation(String defaultLocation)
defaultLocation
- the default location to the schema.public String getCreateDirClass()
public String getCreateDirImplementation()
public boolean useExtendedTimeStamp()
public boolean useTimestampForDirectoryStructure()
public String getExecDirectory()
DEFAULT_EXEC_DIR
public String getSubmitLogsDirectory()
public boolean labelBasedSubmitDirectoryForSubWorkflows()
public String getStorageDirectory()
DEFAULT_STORAGE_DIR
public boolean useDeepStorageDirectoryStructure()
public String getCleanupStrategy()
public String getCleanupImplementation()
public String getMaximumCleanupJobsPerLevel()
public String getClusterSizeCleanupJobsPerLevel()
public PegasusProperties.CLEANUP_SCOPE getCleanupScope()
public String getTCMode()
DEFAULT_TC_MODE
public String getTCPath()
mDefaultTC
public String getTCMapperMode()
DEFAULT_TC_MAPPER_MODE
public String getReplicaMode()
public String getRLIURL()
DEFAULT_RLI_URL
public int getRLSTimeout()
DEFAULT_RLS_TIMEOUT
public String getPoolMode()
DEFAULT_POOL_MODE
public String getPoolFile()
mDefaultPoolFile
public String getPoolSchemaLocation()
public String getPoolSchemaLocation(String defaultLocation)
defaultLocation
- the default location where the schema should be
if no other location is specified.public String getRefinementProvenanceStore()
public String getTransferImplementation()
public String getSLSTransferImplementation()
public String getTransferImplementation(String property)
property
- property name.public boolean stageSLSFilesViaFirstLevelStaging()
private String getDefaultThirdPartySites()
private String getDefaultTransferImplementation()
public boolean bypassFirstLevelStagingForInputs()
private String getDefaultTransferPriority()
public String getBaseSourceURLForSetupTransfers()
public String getTransferRefiner()
public boolean quoteTransferURL()
public String getNumOfTransferProcesses()
DEFAULT_TRANSFER_PROCESSES
public String getNumOfTransferStreams()
DEFAULT_TRANSFER_STREAMS
public boolean useForceInTransfer()
public boolean getUseOfSymbolicLinks()
public String getThirdPartySites(String property)
property
- property name.public String getThirdPartySitesRemote(String property)
property
- property name.public String getStagingDelimiter()
DEFAULT_STAGING_DELIMITER
public String getChmodDisabledSites()
public boolean transferWorkerPackage()
public String getTransferArguments()
public String getSLSTransferArguments()
public String getTransferStageInPriority()
public String getTransferStageOutPriority()
public String getTransferInterPriority()
private String getTransferPriority(String property)
property
- property name.public String getTXSelectorMode()
DEFAULT_TC_MAPPER_MODE
public String getReplicaSelector()
public String getAllPreferredSites()
public String getAllIgnoredSites()
public String getSiteSelectorMode()
DEFAULT_SITE_SELECTOR
public String getSiteSelectorPath()
public int getSiteSelectorTimeout()
DEFAULT_SITE_SELECTOR_TIMEOUT
public String getSiteSelectorKeep()
DEFAULT_SITE_SELECTOR_KEEP
public String getGridStart()
DEFAULT_GRIDSTART_MODE
public boolean setXBitWithKickstart()
public boolean doStatWithKickstart()
public boolean generateLOFFiles()
public boolean useInvokeInGridStart()
public boolean disableInvokeInGridStart()
public long getGridStartInvokeLength()
DEFAULT_INVOKE_LENGTH
public boolean generateKickstartExtraOptions()
public boolean setPostSCRIPTDebugON()
public boolean symlinkCommonLog()
public boolean useCondorQuotingForArguments()
public String getCredName()
public String getLogManager()
public String getLogFormatter()
public String getHttpLog4jURL()
public String getLoggingFile()
public String getLog4JLogFile()
public boolean writeOutMetrics()
public String getMetricsLogFile()
public boolean assignDefaultJobPriorities()
public boolean createRegistrationJobs()
public boolean executeOnWorkerNode()
public boolean treatCacheAsRC()
public boolean preserveParserLineBreaks()
public String getWingsPropertiesFile()
public String getWingsRequestID()
public String getGridFTPTimeout()
DEFAULT_SITE_SELECTOR_TIMEOUT
public String getSubmitMode()
public String getPartitionParsingMode()
public String getCollapseFactors()
public String getHorizontalClusterPreference()
job.runtime
property. For all other cases the default horizontal clustering approach
will be used.public String getJobAggregator()
DEFAULT_JOB_AGGREGATOR
public boolean logJobAggregatorProgress()
public boolean logJobAggregatorProgressToGlobal()
public boolean abortOnFirstJobFailure()
public String getRootWorkflowUUID()
public String getPartitionerDAXCallback()
DEFAULT_DAX_CALLBACK
public String getPartitionerLabelKey()
public String getHorizontalPartitionerBundleValue(String name)
name
- the logical name of the transformation.public String getHorizontalPartitionerCollapseValue(String name)
name
- the logical name of the transformation.public String getClustererLabelKey()
public String getPropertiesInSubmitDirectory()
RuntimeException
- in case of file not being generated.public String writeOutProperties(String directory) throws IOException
directory
- the directory in which the properties file needs to
be written to.IOException
- in case of error while writing out file.public String writeOutProperties(String directory, boolean sanitizePath) throws IOException
directory
- the directory in which the properties file needs to
be written to.sanitizePath
- boolean indicating whether to sanitize paths for
certain properties or not.IOException
- in case of error while writing out file.public String writeOutProperties(String directory, boolean sanitizePath, boolean setInternalVariable) throws IOException
directory
- the directory in which the properties file needs to
be written to.sanitizePath
- boolean indicating whether to sanitize paths for
certain properties or not.setInternalVariable
- whether to set the internal variable that stores
the path to the properties file.IOException
- in case of error while writing out file.private void sanitizePathForProperty(Properties properties, String key)
properties
- the propertieskey
- the key whose value needs to be sanitizedprotected static void sanityCheck(File dir) throws IOException
dir
- is the new base directory to optionally create.IOException
- in case of error while writing out files.private String getProperty(String newProperty, String deprecatedProperty)
newProperty
- the new property that should be used.deprecatedProperty
- the deprecated property that needs to be
replaced.private String getProperty(String newProperty, String deprecatedProperty, String defaultValue)
newProperty
- the new property that should be used.deprecatedProperty
- the deprecated property that needs to be
replaced.defaultValue
- the default value that should be returned.private void logDeprecatedWarning(String deprecatedProperty, String newProperty)
deprecatedProperty
- the deprecated property that needs to be
replaced.newProperty
- the new property that should be used.