Notebook Runtime Parameters
Important rules:
RunMode:BUILD,PARSE, orFULLSourceType:XMLorDBPipelineTriggerTime: Timestamp value
ingestion_master.ipynb
Mandatory values:
RunMode:BUILD,PARSE, orFULLPipelineId: MandatoryPipelineTriggerTime: Mandatory
Mandatory when RunMode includes build:
SourceType:XMLorDBBuildConfigPath: MandatoryRootFolder: Mandatory whenSourceType = XML
Mandatory when RunMode includes parse:
ParseStage: Must beFilterParseConfigPath: Mandatory
Pass when required for downstream parsing:
ExtensionConfigPath
xml_build.ipynb
Mandatory values:
PipelineId: MandatoryPipelineTriggerTime: MandatorySourceType:XMLorDBBuildConfigPath: Mandatory
Conditional values:
RootFolder: Mandatory whenSourceType = XMLSubFolder: Optional
Implementation note:
- When
SourceType = DB, the notebook constantSOURCE_QUERYmust be maintained for the source system.
xml_parse.ipynb
Mandatory values:
ParseStage:FilterorProcessParseConfigPath: MandatoryPipelineId: MandatoryPipelineTriggerTime: Mandatory
Conditional values:
LineOfBusiness: Mandatory whenParseStage = ProcessScenarioId: Pass when process-stage parsing must resolve scenario-specific response rowsExtensionConfigPath: Pass when extension-table parsing is required
scenario_api_build_and_process.ipynb
Mandatory values:
ScenarioId: MandatoryContextPayloadConfigPath: MandatoryAPIThroughputConfigPath: MandatoryPipelineId: MandatoryPipelineTriggerTime: Mandatory
Branch control:
CurrentPremiumCheck = Activefor the current-premium flowCurrentPremiumCheck = ""for the proposed-premium flow
Conditional values:
PreEndPoint: Mandatory for the current-premium flowPostEndPoint: Mandatory for the proposed-premium flowPreEnvironmentId: Pass when current-premium endpoint authentication requires environment lookupPostEnvironmentId: Pass when proposed-premium endpoint authentication requires environment lookup
scenario_data_process.ipynb
Mandatory values:
ScenarioId: MandatoryLineOfBusiness: MandatoryParseStage: Must beProcessPostParseConfigPath: MandatoryAPIThroughputConfigPath: MandatoryContextPayloadConfigPath: MandatoryPostEndPoint: MandatoryPipelineId: MandatoryPipelineTriggerTime: Mandatory
Conditional values:
CurrentPremiumCheck = Activewhen current-premium pre-parse is requiredCurrentPremiumCheck = ""when only the proposed branch is requiredPreParseConfigPath: Mandatory whenCurrentPremiumCheck = ActivePreEndPoint: Mandatory whenCurrentPremiumCheck = ActivePreEnvironmentId: Pass when current-premium API authentication must be resolved through environment lookupPostEnvironmentId: Pass when proposed-premium API authentication must be resolved through environment lookup