2017 © Pedro Peláez
 

library input

image

tdt/input

  • Saturday, August 5, 2017
  • by pietercolpaert
  • Repository
  • 5 Watchers
  • 4 Stars
  • 1,330 Installations
  • PHP
  • 1 Dependents
  • 1 Suggesters
  • 7 Forks
  • 13 Open issues
  • 16 Versions
  • 8 % Grown

The README.md

Input package

Latest Stable Version Build Status, (*1)

This is the Laravel package called "input" and serves as an extract-map-load configuration (EML) as part of the datatank core application (tdt/core). The current instances of the eml stack are focussed on semantifying data. This means that raw data can be transformed into semantic data by providing a mapping file., (*2)

Future work exists in extracting data from large files and loading them into a NoSQL store. This endpoint can then be exploited freely, or proxied by the datatank core., (*3)

Configuration with queues

In order to harvest large datasets, jobs will need to be put in a queue so they can be executed asynchronously. One way to do this is to have a beanstalkd service up and running on the server in combination with the artisan queue:listen command., (*4)

In order to make sure the artisan listen command, which executes jobs when they enter the beanstalkd queue, keeps running, configure it in supervisord!, (*5)

Lastly configure the beanstalkd queue in the configuration file of the application. (app/config/queue.php), (*6)

The Versions

03/02 2014

v0.1.4

0.1.4.0 http://thedatatank.com

A streaming ETL with mapping function included. Depending on your configuration, you can extract files in different formats, transform then into PHP arrays, optionally map them to a vocabulary and load the arrays in a store

  Sources   Download

AGPLv3

The Requires

 

mapper input rdf etl ontologies

16/09 2013

dev-RDFa

dev-RDFa http://thedatatank.com

A streaming ETL with mapping function included. Depending on your configuration, you can extract files in different formats, transform then into PHP arrays, optionally map them to a vocabulary and load the arrays in a store

  Sources   Download

AGPLv3

The Requires

 

mapper input rdf etl ontologies

18/06 2013

v0.1.3

0.1.3.0 http://thedatatank.com

A streaming ETL with mapping function included. Depending on your configuration, you can extract files in different formats, transform then into PHP arrays, optionally map them to a vocabulary and load the arrays in a store

  Sources   Download

AGPLv3

The Requires

 

mapper input rdf etl ontologies

17/05 2013

dev-transformers

dev-transformers http://thedatatank.com

A streaming ETL with mapping function included. Depending on your configuration, you can extract files in different formats, transform then into PHP arrays, optionally map them to a vocabulary and load the arrays in a store

  Sources   Download

AGPLv3

The Requires

 

mapper input rdf etl ontologies

11/05 2013

v0.1.2

0.1.2.0 http://thedatatank.com

A streaming ETL with mapping function included. Depending on your configuration, you can extract files in different formats, transform then into PHP arrays, optionally map them to a vocabulary and load the arrays in a store

  Sources   Download

AGPLv3

The Requires

 

mapper input rdf etl ontologies

13/03 2013

v0.1.1

0.1.1.0 http://thedatatank.com

A streaming ETL with mapping function included. Depending on your configuration, you can extract files in different formats, transform then into PHP arrays, optionally map them to a vocabulary and load the arrays in a store

  Sources   Download

AGPLv3

The Requires

 

mapper input rdf etl ontologies

12/03 2013

v0.1

0.1.0.0 http://thedatatank.com

A streaming ETL with mapping function included. Depending on your configuration, you can extract files in different formats, transform then into PHP arrays, optionally map them to a vocabulary and load the arrays in a store

  Sources   Download

AGPLv3

The Requires

 

mapper input rdf etl ontologies