bidzm/mysticquent

Mysticquent is an Elasticsearch ODM and mapper for Laravel. It is inspired from sleimanx2/plastic and searchkick

Mysticquent is an Elasticsearch ODM and mapper for Laravel. It renders the developer experience more enjoyable while using Elasticsearch, by providing a fluent syntax for mapping, querying, and storing eloquent models. This package inspired from sleimanx2/plastic and searchkick, _(*1)

This package is still under active development and may change., _(*2)

Installing Mysticquent

composer require bidzm/mysticquent

Then we need to add the plastic service provider to config/app.php under the providers key:, _(*3)

Mysticquent\MysticquentServiceProvider::class

Finally we need to run:, _(*4)

php artisan vendor:publish

This will create a config file at config/mysticquent.php., _(*5)

Usage

• Defining Searchable Models
• Storing Model Content
• Searching
• Aggregation
• Suggestions
• Mappings
• Access The Client

Defining Searchable Models

To get started, enable searching capabilities in your model by adding the Mysticquent\Searchable trait:, _(*6)

use Mysticquent\Searchable;

class User extends Model
{
    use Searchable;
}

Defining what data to store.

By default, Mysticquent will store all visible properties of your model., _(*7)

In addition, Mysticquent provides you to manually specify which data should be stored in Elasticsearch., _(*8)

Providing a buildDocument method

public function buildDocument()
{
    return [
        'id' => $this->id,
        'email' => $this->email
    ];
}

Custom elastic type name

By the default Mysticquent will use class name of model as document type. You can customize it by adding a $documentType property to your model:, _(*9)

public $documentType = 'custom_type';

Custom elastic index name

By the default Mysticquent will use the model table name as index. You can customize in which index your model data will be stored by setting the $documentIndex property to your model:, _(*10)

public $documentIndex = 'custom_index';

Storing Model Content

Mysticquent automatically syncs model data with elastic when you save or delete your model from our SQL DB, however this feature can be disabled by adding public $syncDocument = false to your model., _(*11)

Its important to note that manual document update should be performed in multiple scenarios:, _(*12)

1 - When you perform a bulk update or delete, no Eloquent event is triggered, therefore the document data won't be synced., _(*13)

2 - Mysticquent doesn't listen to related models events (yet), so when you update a related model's content you should consider updating the parent document., _(*14)

Saving a document

$book = User::first()->document()->save();

Partial updating a document

$book = User::first()->document()->update();

Deleting a document

$book = User::first()->document()->delete();

Saving documents in bulk

Mysticquent::document()->bulkSave(User::find(1)->books);

Deleting documents in bulk

$users = User::where('age','>',25)->get();

Mysticquent::document()->bulkDelete($users);

Searching Model Content

Plastic provides a fluent syntax to query Elasticsearch which leads to compact readable code. Lets dig into it:, _(*15)

$result = Book::search()->match('title','pulp')->get();

// Returns a collection of Book Models
$books = $result->hits();

// Returns the total number of matched documents
$result->totalHits();

// Returns the highest query score
$result->maxScore();

//Returns the time needed to execute the query
$result->took();

To get the raw DSL query that will be executed you can call toDSL():, _(*16)

$dsl = Book::search()->match('title','pulp')->toDSL();

Pagination

$books = Book::search()
    ->multiMatch(['title', 'description'], 'ham on rye', ['fuzziness' => 'AUTO'])
    ->sortBy('date')
    ->paginate();

You can still access the result object after pagination using the result method:, _(*17)

$books->result();

Bool Query

User::search()
    ->must()
        ->term('name','kimchy')
    ->mustNot()
        ->range('age',['from'=>10,'to'=>20]);
    ->should()
        ->match('bio','developer')
        ->match('bio','elastic')
    ->filter()
        ->term('tag','tech')
    ->get();

Nested Query

$contain = 'foo';

Post::search()
    ->multiMatch(['title', 'body'], $contain)
    ->nested('tags', function (SearchBuilder $builder) use ($contain) {
        $builder->match('tags.name', $contain);
    })->get();

Check out this documentation of supported search queries within Plastic and how to apply unsupported queries., _(*18)

Change index on the fly

To switch to a different index for a single query, simply use the index method., _(*19)

$result = Book::search()->index('special-books')->match('title','pulp')->get();

Aggregation

$result = User::search()
    ->match('bio', 'elastic')
    ->aggregate(function (AggregationBuilder $builder) {
        $builder->average('average_age', 'age');
    })->get();

$aggregations = $result->aggregations();

Check out this documentation of supported aggregations within plastic and how to apply unsupported aggregations., _(*20)

Suggestions

Plastic::suggest()->completion('tag_suggest', 'photo')->get();

The suggestions query builder can also be accessed directly from the model as well:, _(*21)

//this be handy if you have a custom index for your model
Tag::suggest()->term('tag_term','admin')->get();

Model Mapping

Mappings are an important aspect of Elasticsearch. You can compare them to indexing in SQL databases. Mapping your models yields better and more efficient search results, and allows us to use some special query functions like nested fields and suggestions., _(*22)

Generate a Model Mapping

php artisan make:mapping "App\User"

The new mapping will be placed in your database/mappings directory., _(*23)

Mapping Structure

A mapping class contains a single method map. The map method is used to map the given model fields., _(*24)

Within the map method you may use the Plastic Map builder to expressively create field maps. For example, let's look at a sample mapping that creates a Tag model map:, _(*25)

use Sleimanx2\Plastic\Map\Blueprint;
use Sleimanx2\Plastic\Mappings\Mapping;

class AppTag extends Mapping
{
    /**
     * Full name of the model that should be mapped
     *
     * @var string
     */
    protected $model = App\Tag::class;

    /**
     * Run the mapping.
     *
     * @return void
     */
    public function map()
    {
        Map::create($this->getModelType(), function (Blueprint $map) {
            $map->string('name')->store('true')->index('analyzed');

            // instead of the fluent syntax we can use the second method argument to fill the attributes
            $map->completion('suggestion', ['analyzer' => 'simple', 'search_analyzer' => 'simple']);
        },$this->getModelIndex());
    }
}

To learn about all of the methods available on the Map builder, check out this documentation., _(*26)

Run Mappings

Running the created mappings can be done using the Artisan console command:, _(*27)

php artisan mapping:run

Updating Mappings

If your update consists only of adding a new field mapping you can always update our model map with your new field and run:, _(*28)

php artisan mapping:rerun

The mapping for existing fields cannot be updated or deleted, so you'll need to use one of following techniques to update existing fields., _(*29)

1 - Create a new index

You can always create a new Elasticsearch index and re-run the mappings. After running the mappings you can use the bulkSave method to sync your SQL data with Elasticsearch., _(*30)

2 - Using aliases

Its recommended to create your Elasticsearch index with an alias to ease the process of updating your model mappings with zero downtime. To learn more check out:, _(*31)

https://www.elastic.co/blog/changing-mapping-with-zero-downtime, _(*32)

Access The Client

You can access the Elasticsearch client to manage your indices and aliases as follows:, _(*33)

$client = Plastic::getClient();

//index delete
$client->indices()->delete(['index'=> Plastic::getDefaultIndex()]);
//index create
$client->indices()->create(['index' => Plastic::getDefaultIndex()]);

More about the official elastic client : https://github.com/elastic/elasticsearch-php, _(*34)

Contributing

Thank you for contributing, The contribution guide can be found Here., _(*35)

License

Plastic is open-sourced software licensed under the MIT license., _(*36)

To Do

Search Query Builder

• [ ] implement Boosting query
• [ ] implement ConstantScore query
• [ ] implement DisMaxQuery query
• [ ] implement MoreLikeThis query (with raw eloquent models)
• [ ] implement GeoShape query

Aggregation Query Builder

• [ ] implement Nested aggregation
• [ ] implement ExtendedStats aggregation
• [ ] implement TopHits aggregation

Mapping

• [ ] Find a seamless way to update field mappings with zero downtime with aliases

General

• [ ] Better query builder documentation