Editing Imms (section)

===ELT Process===

Overview of current process shown below:

<mermaid>
%%{init: {'theme': 'default', 'flowchart': {'useMaxWidth': false,'htmlLabels': false}, 'logLevel': 'debug', 'securityLevel': 'loose', 'themeVariables': {'fontSize': '10px', 'nodeSpacing': 20, 'rankSpacing': 20}} }%%
flowchart TB
    
    subgraph EB0["📅 EventBridge"]
        direction TB
        EB1["cron(30 18 ? * MON,TUE *)"]:::mono-.->
        EB2[Sync_Imms_Files_Weekly]:::mono
    end
    subgraph L0["⚙️ Lambda"]
        direction TB
        L1[syncImmsFileSftp]:::mono
        subgraph S30["📁 s3://kpa-imms"]
            direction TB
            S31[Check for new files]-.->
            S32[Convert to parquet]-.->
            S33[Move to folder path <code> parquet/ </code>]
        end
        subgraph TW0["🔒 SFTP Endpoint"]
            direction TB
            N1[Weekly data produced]-.->
            N2[Files added to filepath]
        end
        L21[copyImmsData]:::mono
    end
    subgraph DB0["🗄️ Database"]
            DB1[Append new data to target in schema<code> imms </code>]
            DB2["cron(0 13 * * 2)"]:::mono-.->
            DB3["rpt.fn_imms_merge()"]:::mono-.->
            DB4[Patient level view of all overdue imms<code> imms.imms_all </code>]
    end
    
    L1<-->TW0
    L1<-->S30
    TW0<-->S30
    EB2-->L0
    S33-.PUT Trigger.->L21
    L21-.->DB1
    
    classDef mono font-family:Courier New,fill:#393939,color:#ffffff;

</mermaid>