2017 © Pedro Peláez
 

library pipeline

Pipeline processing library

image

linkorb/pipeline

Pipeline processing library

  • Monday, June 11, 2018
  • by joostfaassen
  • Repository
  • 3 Watchers
  • 0 Stars
  • 66 Installations
  • PHP
  • 0 Dependents
  • 0 Suggesters
  • 0 Forks
  • 0 Open issues
  • 11 Versions
  • 3 % Grown

The README.md

Pipeline

Pipeline is a library + CLI tool to load programmable pipelines, execute jobs and get detailed results per stage for reporting/debugging., (*1)

Concepts

  • Pipeline: A sequential list of stages
  • Stage: An command template with a unique name within the pipeline.
  • Job: A job that will be executed on a pipeline with an optional set of input variables
  • JobResult: The output of a Job that has been executed on a pipeline, contains status and a StageResult for each stage in the pipeline
  • StageResult: The exact command that was executed, it's exitcode, stdout and stderr.

CLI examples

Load a pipeline YML file and execute it with input variable topic=technology, (*2)

bin/pipeline run examples/bbc-news-demo.pipeline.yml -d topic=technology

Load a pipeline YML file and execute it with input from STDIN, (*3)

bin/pipeline run examples/bbc-news-stdin-demo.pipeline.yml < examples/bbc-news-demo.rss.xml

Output a JSON result of the JobResult + StageResults to result.json, (*4)

bin/pipeline run -o result.json examples/bbc-news-demo.pipeline.yml -d topic=technology

Load a pipeline YML file and intentially cause an error by requesting a non-existant topic. This will output the errors., (*5)

bin/pipeline run examples/bbc-news-demo.pipeline.yml -d topic=this-topic-does-not-exist

You can suppress output and debugging output by using --quiet. You can use this in combination with -o to read the details from a .json file., (*6)

In all cases the exit code of the pipeline command will match the exit code of the last stage result: 0 on success, or other on failure., (*7)

Library example

Please refer to examples/example-code.php on how to use the pipeline package as a library., (*8)

Configuration through environment variables

pipeline will use environment variables in the inputs of pipelines. This way you don't need to define all required variables using -d., (*9)

When pipeline runs, it first checks if a .env file exists in the current directory and update the environment variabels based on it's contents., (*10)

License

MIT. Please refer to the license file for details., (*11)

Brought to you by the LinkORB Engineering team


Check out our other projects at linkorb.com/engineering., (*12)

Btw, we're hiring!, (*13)

The Versions

11/06 2018

dev-master

9999999-dev https://github.com/linkorb/pipeline

Pipeline processing library

  Sources   Download

MIT

The Requires

 

by LinkORB Engineering

pipeline processing linkorb

11/06 2018

v1.7.0

1.7.0.0 https://github.com/linkorb/pipeline

Pipeline processing library

  Sources   Download

MIT

The Requires

 

by LinkORB Engineering

pipeline processing linkorb

19/05 2017

v1.6.2

1.6.2.0 https://github.com/linkorb/pipeline

Pipeline processing library

  Sources   Download

MIT

The Requires

 

by LinkORB Engineering

pipeline processing linkorb

19/05 2017

v1.6.1

1.6.1.0 https://github.com/linkorb/pipeline

Pipeline processing library

  Sources   Download

MIT

The Requires

 

by LinkORB Engineering

pipeline processing linkorb

05/03 2017

v1.6.0

1.6.0.0 https://github.com/linkorb/pipeline

Pipeline processing library

  Sources   Download

MIT

The Requires

 

by LinkORB Engineering

pipeline processing linkorb

05/03 2017

v1.5.0

1.5.0.0 https://github.com/linkorb/pipeline

Pipeline processing library

  Sources   Download

MIT

The Requires

 

by LinkORB Engineering

pipeline processing linkorb

20/02 2017

v1.4.0

1.4.0.0 https://github.com/linkorb/pipeline

Pipeline processing library

  Sources   Download

MIT

The Requires

 

by LinkORB Engineering

pipeline processing linkorb

20/02 2017

v1.3.0

1.3.0.0 https://github.com/linkorb/pipeline

Pipeline processing library

  Sources   Download

MIT

The Requires

 

by LinkORB Engineering

pipeline processing linkorb

20/02 2017

v1.2.0

1.2.0.0 https://github.com/linkorb/pipeline

Pipeline processing library

  Sources   Download

MIT

The Requires

 

by LinkORB Engineering

pipeline processing linkorb

20/02 2017

v1.1.0

1.1.0.0 https://github.com/linkorb/pipeline

Pipeline processing library

  Sources   Download

MIT

The Requires

 

by LinkORB Engineering

pipeline processing linkorb

19/02 2017

v1.0.0

1.0.0.0 https://github.com/linkorb/pipeline

Pipeline processing library

  Sources   Download

MIT

The Requires

 

by LinkORB Engineering

pipeline processing linkorb