2017 © Pedro PelĂĄez
 

library lhm

Large Hadron Migrator for phinx

image

masom/lhm

Large Hadron Migrator for phinx

  • Monday, May 14, 2018
  • by masom
  • Repository
  • 4 Watchers
  • 24 Stars
  • 3,406 Installations
  • PHP
  • 0 Dependents
  • 0 Suggesters
  • 4 Forks
  • 0 Open issues
  • 15 Versions
  • 23 % Grown

The README.md

Build Status, (*1)

Large Hadron Migrator

Phinx meets LHM, (*2)

This is a PHP port of https://github.com/soundcloud/lhm . lhm_php supports primary keys with a name other than id., (*3)

Version 0.4.0 is considered "production-ready". It is in use at PopKey.co to migrate millions of records., (*4)

TODO

  • [x] [SqlHelper] Support column renames
  • [x] [LHM] Support cleanup
  • [ ] [Chunker] data limits/filtering
  • [ ] [Chunker] throttle
  • [x] [Switchers] Locked switcher
  • [x] add index / remove index

Usage

<?php

use Phinx\Migration\AbstractMigration;


class DropLargeColumns extends AbstractMigration
{
    /**
     * Migrate Up.
     */
    public function up()
    {
        /**
         * Uncomment this to see logs.
         * $logger = new Monolog\Logger('test', [new \Monolog\Handler\StreamHandler('php://stdout')]);
         * \Lhm\Lhm::setLogger($logger);
         */
        \Lhm\Lhm::setAdapter($this->getAdapter());
        \Lhm\Lhm::changeTable('characters', function (Phinx\Db\Table $table) {
            $table
                ->removeColumn('alternate_name')
                ->removeColumn('alternate_bio')
                ->removeColumn('alternate_storyline')
                ->save();
        });
    }

    /**
     * Migrate Down.
     */
    public function down()
    {
        \Lhm\Lhm::setAdapter($this->getAdapter());
        \Lhm\Lhm::changeTable('characters', function (Phinx\Db\Table $table) {
            $table
                ->addColumn('alternate_name', 'string', ['limit' => 255, 'null' => true, 'default' => null])
                ->addColumn('alternate_bio', 'string', ['limit' => 255, 'null' => true, 'default' => null])
                ->addColumn('alternate_storyline', 'string', ['limit' => 255, 'null' => true, 'default' => null])
                ->save();
        });
    }
}

Cleanup

If there is an error while LHM is running a few triggers and tables might be left in the database., (*5)

bin/lhm command will let you clean your database., (*6)

It executes a dry-run unless the --run option is specified., (*7)

Large Hadron Migrator version 0.4.0

Usage:
 cleanup [-c|--configuration="..."] [-p|--parser="..."] [-e|--environment="..."] [-r|--run] [-u|--until="..."]

Options:
 --configuration (-c)  The configuration file to load
 --parser (-p)         Parser used to read the config file. Defaults to YAML
 --environment (-e)    The target environment
 --run (-r)            Apply the cleanup operations.
 --until (-u)          Drop archive tables older than the specified date at UTC (YYYY-MM-DD_hh:mm:ss).
 --help (-h)           Display this help message
 --quiet (-q)          Do not output any message

Help:

 Cleanup LHM tables, old archives and triggers. Defaults to a dry-run unless --run is specified.

AWS Considerations

Amazon RDS disables log_bin_trust_function_creators by default., (*8)

See https://github.com/soundcloud/lhm/issues/76 and https://github.com/soundcloud/lhm/issues/65, (*9)

If your database instance is running a custom parameter group:
  1. Open the RDS web console.
  2. Open the “Parameter Groups” tab.
  3. Create a new Parameter Group. On the dialog, select the MySQL family compatible to your MySQL database version, give it a name and confirm.
  4. Select the just created Parameter Group and issue “Edit Parameters”.
  5. Look for the parameter ‘log_bin_trust_function_creators’ and set its value to ‘1’.
  6. Save the changes.

The changes to the parameter group will be applied immediately., (*10)

If your database instance is running on the default parameter group:
  1. Open the RDS web console.
  2. Open the “Parameter Groups” tab.
  3. Create a new Parameter Group. On the dialog, select the MySQL family compatible to your MySQL database version, give it a name and confirm.
  4. Select the just created Parameter Group and issue “Edit Parameters”.
  5. Look for the parameter ‘log_bin_trust_function_creators’ and set its value to ‘1’.
  6. Save the changes.
  7. Open the “Instances” tab. Expand your MySQL instance and issue the “Instance Action” named “Modify”.
  8. Select the just created Parameter Group and enable “Apply Immediately”.
  9. Click on “Continue” and confirm the changes.
  10. Open the “Instances” tab. Expand your MySQL instance and issue the “Instance Action” named “Reboot”.

source: https://techtavern.wordpress.com/2013/06/17/mysql-triggers-and-amazon-rds/, (*11)

The Versions

14/05 2018

dev-master

9999999-dev

Large Hadron Migrator for phinx

  Sources   Download

BSD-3-Clause

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

26/05 2017

dev-fix_cleanup_issues

dev-fix_cleanup_issues

Large Hadron Migrator for phinx

  Sources   Download

BSD-3-Clause

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

11/05 2017

0.5.1

0.5.1.0

Large Hadron Migrator for phinx

  Sources   Download

BSD-3-Clause

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

11/05 2017

0.5.0

0.5.0.0

Large Hadron Migrator for phinx

  Sources   Download

BSD-3-Clause

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

03/05 2017

0.4.3

0.4.3.0

Large Hadron Migrator for phinx

  Sources   Download

BSD-3-Clause

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

03/05 2017

dev-rel-0.4.3

dev-rel-0.4.3

Large Hadron Migrator for phinx

  Sources   Download

BSD-3-Clause

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

27/01 2016

0.4.2

0.4.2.0

Large Hadron Migrator for phinx

  Sources   Download

BSD-3-Clause

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

02/11 2015

0.4.1

0.4.1.0

Large Hadron Migrator for phinx

  Sources   Download

BSD-3-Clause

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

29/05 2015

0.4.0

0.4.0.0

Large Hadron Migrator for phinx

  Sources   Download

BSD-3-Clause

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

05/05 2015

0.3.7

0.3.7.0

Large Hadron Migrator for phinx

  Sources   Download

MIT

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

04/05 2015

0.3.4

0.3.4.0

Large Hadron Migrator for phinx

  Sources   Download

MIT

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

01/05 2015

0.3.3

0.3.3.0

Large Hadron Migrator for phinx

  Sources   Download

MIT

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

01/05 2015

0.3.2

0.3.2.0

Large Hadron Migrator for phinx

  Sources   Download

MIT

The Requires

 

The Development Requires

by Martin Samson

database migrations db phinx database migrations lhm

28/04 2015

0.2

0.2.0.0

Large Hadron Migrator for phinx

  Sources   Download

MIT

The Requires

 

The Development Requires

by Martin Samson

28/04 2015

0.1

0.1.0.0

Large Hadron Migrator for phinx

  Sources   Download

MIT

The Requires

 

The Development Requires

by Martin Samson