PL1 - Pipeline Overview

Category

PL - Programming Language

Description

Jayvee splits block definitions and connecting blocks into a pipeline into separate code locations. This leads to a pipeline model that is structured as follows (from task 2):

pipeline RescueStationPipeline {
 
HttpDataSource
    ->TextInterpreter
    ->CSVFileInterpreter
    ->ValuetypeValidator
    ->IsPubliclyFundedColumnAdder
    ->SQLiteSink;
    
    block HttpDataSource oftype HttpExtractor {
        url: 'https://geo.sv.rostock.de/download/opendata/rettungswachen/rettungswachen.csv';
    }
    
    // Further block definitions
}

This provides an overview of the pipeline at the top of each file that does not exist in Python scripts.

Content

• Information is split between pipeline overview and implementation
• Without pipeline overview, all code must be considered
• Python does not provide a pipeline overview
• Jayvee pipeline overview improves speed
• Jayvee pipeline overview helps to understand the flow of a pipeline