mixnode/mixnode-warcreader-php

Read Web ARChive (WARC) files in PHP.

Mixnode WARC Reader for PHP

This library allows developers to read Web ARChive (WARC) files in PHP., _(*1)

Installation Guide

We recommend Composer for installing this package:, _(*2)

curl -sS https://getcomposer.org/installer | php

Once done, run the Composer command to install Mixnode WARC Reader for PHP:, _(*3)

php composer.phar require mixnode/mixnode-warcreader-php

After installing, you need to require Composer's autoloader in your code:, _(*4)

require 'vendor/autoload.php';

You can then later update Mixnode WARC Reader using composer:, _(*5)

bash composer.phar update, _(*6)

A Simple Example

<?php
require 'vendor/autoload.php';

// Initialize a WarcReader object 
// The WarcReader constructure accepts paths to both raw WARC files and GZipped WARC files
$warc_reader = new Mixnode\WarcReader("test.warc.gz");

// Using nextRecord, iterate through the WARC file and output each record.
while(($record = $warc_reader->nextRecord()) != FALSE){
    // A WARC record is broken into two parts: header and content.
    // header contains metadata about content, while content is the actual resource captured.
    print_r($record['header']);
    print_r($record['content']);
    echo "------------------------------------\n";
}