webysther/packagist-mirror

Build mirror of packagist

Monday, July 30, 2018
by Webysther
Repository
3 Watchers
6 Stars
23 Installations

PHP
0 Dependents
0 Suggesters
7 Forks
0 Open issues
8 Versions
92 % Grown

The README.md

DEPRECATED

The project has been frozen since the announcement of composer 2, which solved several problems, but still did not cover all users, especially in China. A few weeks ago, it adopted a global CDN model and will shutdown all legacy version 1, which makes this mirror unnecessary. This includes Brazil, China and other countries where performance was still not good enough. This is a good move and I recommend that all existing mirrors start shutting down their domains. I will open a PR to remove the Packagist mirror page. Thank you to the community and everyone who helped the project., _(*1)

📦 Packagist Mirror

, _(*2)

❤️ Recommended by packagist.org ❤️, _(*3)

Announcement: Composer 2 is now available!

This mirror is for Composer 1; Composer 2 is very fast on its own. We will update to support the version 2 for those need solve the slow internet access or availability problem with the main repository., _(*4)

A mirror for packagist.org that regularly caches packages from one or more main mirrors to add to a distributed package repository., _(*5)

, _(*6)

If you're using PHP Composer, commands like create-project, require, update, remove are often used. When those commands are executed, Composer will download information from the packages that are needed also from dependent packages. The number of json files downloaded depends on the complexity of the packages which are going to be used. The further you are from the location of the packagist.org server, the more time is needed to download json files. By using a mirror, it will save you time when downloading json because the server location is closer., _(*7)

⚙️ How it works?

This project aims to create a local mirror with ease, allowing greater availability for companies/countries that want to use composer without depending on the infrastructure of third parties. It is also possible to create a public mirror to reduce the load on the main repository and better distribute requests around the world, helping make the packagist ecosystem faster as a whole!, _(*8)

When creating a mirror, you add a list of other mirrors to use for initial sync, which pulls all packages to your local machine. After the mirror is created and synced, the next runs will only pull updates. If any mirror fails to deliver a metadata file, the client will fallback to its configured main mirror, whether that be packagist.org or otherwise. If the client encounters an installation problem or loses connection to a mirror, it can return from where it stopped running., _(*9)

Mirror creation , _(*10)

🌎 Packagist public metadata mirrors observatory around the world

🛫 Amazing data mirrors used to download repositories metadata built using this recommended repository or another:, _(*11)

Lists are ordered by country and sync frequency., _(*12)

Location	Mirror	Maintainer	Github	Sync	Since
Brazil	packagist.com.br	Webysther	main	Continuously	Q3'17
China	php.cnpkg.org	Eagle Wu	fork	Every minute	Q3'18
China	packagist.mirrors.sjtug.sjtu.edu.cn	Shanghai Jiao Tong University	fork	Every hour	Q2'19
Czech Republic	packagist.hostuj.to	HOSTUJ TO	fork	Every 5 minutes	🆕Q1'20
Finland	packagist.fi	Niko Granö	fork	Continuously	🆕Q2'20
Germany	packagist.hesse.im	Benjamin Hesse	fork	Every minute	🆕Q3'20
Germany	composer.mg100.net	Alex Gummenscheimer	fork	Every minute	🆕Q1'21
India	packagist.in	Varun Sridharan	fork	Every minute	Q2'19
India	packagist.vrkansagara.in	Vallabh Kansagara	fork	Every 5 minutes	Q4'19
Indonesia	packagist.phpindonesia.id	Indra Gunawan	fork	Every 30 seconds	Q3'18
Indonesia	packagist.ianmustafa.com	Ian Mustafa	fork	Every 30 seconds	Q3'19
Indonesia	packagist.telkomuniversity.ac.id	Telkom University	fork	Every 5 minutes	🆕Q1'20
Japan	packagist.dev.studio-umi.jp	Studio Umi	fork	Every minute	🆕Q1'20
Russia	packagist.org.ru	Konstantin Tarasov	fork	Every 15 minutes	Q3'22
South Africa	packagist.co.za	SolidWorx	fork	Every 5 minutes	Q3'18
South Korea	packagist.kr	PackagistKR	fork	Every minute	Q3'18
Thailand	packagist.mycools.in.th	Jarak Kritkiattisak	fork	Every 5 minutes	Q4'19
USA	packagist-mirror.wmcloud.org	Wikimedia	fork	Every 5 minutes	Q3'18
Taiwan	packagist.tw	Peter	fork	Every 5 minutes	🆕Q2'20
Vietnam	packagist.ondinh.net	Long Nguyen	main	Every 5 minutes	🆕Q3'20

⚠️ Not based on this source code:, _(*13)

Location	Mirror	Maintainer	Github	Sync	Since
China	mirrors.aliyun.com	Aliyun		Every 5 minutes
China	mirrors.cloud.tencent.com	Tecent Cloud		Every day
Japan	packagist.jp	Hiraku	forked	Every 2 minutes	Q4'14
Japan	packagist.kawax.biz	Kawax	another	Every hour	Q4'18

🛑 Not working as a mirror of packagist.org (checked at Q1'20):, _(*14)

Location	Mirror	Maintainer	Github	Reason	At least
China	mirrors.huaweicloud.com	Huawei Cloud		Outdated	Q3'19
China	packagist.phpcomposer.com		Outdated	Q4'19

If you know any new mirror based or not on this one, please create a issue or a pull request with the new data., _(*15)

Check status page for health mirror's., _(*16)

, _(*17)

This map shows working mirrors from above at the country level. The colors represent the topology drawn below., _(*18)

🚀 Create your own mirror

, _(*19)

💡Tip: use a machine with at least 2GB of RAM to avoid using the disk or swap space during sync., _(*20)

⚠️ When syncing from DATA_MIRROR or MAIN_MIRROR, your server encodes and decodes all packages as .gz files to save disk space. You may need to enable server-side decoding for legacy composer clients that ask for decompressed packages., _(*21)

There are currently three supported methods for creating your own mirror., _(*22)

Docker Compose - Fully automated solution using Docker Compose.
Docker + Nginx + PHP - Docker for cron jobs, Nginx + PHP on the host.
Nginx + PHP - Cron + Nginx + PHP all running on the host.

In all three methods, you need to clone the repository and copy .env.example to .env and modify to include your values instead of the defaults., _(*23)

# Clone this repository
$ git clone https://github.com/websyther/packagist-mirror.git

# Setup environment variables
$ cd packagist-mirror
$ cp .env.example .env
$ nano .env

Docker Compose

Run the following commands to start a container for Nginx, PHP-FPM, and a worker that runs cron jobs., _(*24)

# Start all Docker containers
$ docker-compose up -d

# Follow log output
$ docker-compose logs -f

Once the initial sync has finished, open https://localhost:9248 to see your site., _(*25)

💡Tip: Add -f docker-compose.prod.yml between docker-compose and up or down while running the above commands. If you are using traefik, the services in this docker-compose file contain labels used by a running traefik container to automatically route traffic matching those labels to that container. It even auto-renews LetsEncrypt certificates for you., _(*26)

Docker Nginx PHP

First, add the following line to /etc/crontab to tell the host to start a container for the packagist-mirror image on boot, replacing the values for each -e flag with your own. This will start the initial sync and generate the website files to be served by nginx., _(*27)

Learn about more the available options for this docker image here., _(*28)

* * * * * root docker run --name mirror --rm -v /var/www:/public \
-e MAINTAINER_REPO='packagist.com.br' \
-e APP_COUNTRY_NAME='Brazil' \
-e APP_COUNTRY_CODE='br' \
-e MAINTAINER_MIRROR='Webysther' \
-e MAINTAINER_PROFILE='https://github.com/Webysther' \
-e MAINTAINER_REPO='https://github.com/Webysther/packagist-mirror' \
-e URL='packagist.com.br' \
webysther/packagist-mirror

Next, add the following to /etc/nginx/sites-available/packagist.com.br.conf to host the website files:, _(*29)

server {
    index.html;

    server_name packagist.com.br www.packagist.com.br;

    location / {
        try_files $uri $uri/ =404;
        gzip_static on;
        gunzip on;
    }
}

To monitor sync progress, run the following command:, _(*30)

docker logs --follow --timestamps --tail 10 mirror

Nginx PHP

After cloning the repository, run the following commands to configure for your host., _(*31)

``` bash $ cd packagist-mirror && composer install $ cp .env.example .env, _(*32)


Then, schedule the command to create and update the mirror:

```bash
$ php bin/mirror create -vvv

Nginx will now serve your mirror at the configured URL., _(*33)

🐧 Development & Contributing

Please see CONTRIBUTING and CONDUCT for details., _(*34)

📋 Requirements

The following versions of PHP are supported by this version., _(*35)

PHP >=7.2

🧪 Testing

bash $ vendor/bin/phpunit, _(*36)

🥂 Credits

💙 Other correlated projects

composer/mirror The official composer mirrorring script (used for official packagist.org mirrors)
composer-mirror Create a mirror (open sourced code but not maintained)
composer-registry-manager Easily switch to the composer repository you want
packagist-bot Yet Another Packagist Mirror
twity Provide a web based management of private and public composer packages.
velocita-proxy Composer caching reverse proxy

☮️ License

MIT License. Please see License File for more information., _(*37)

, _(*38)

packagist mirror

13/11 2017

dev-feature/decoupled

Build mirror of packagist

Sources Download

CC0-1.0

The Requires

The Development Requires

by Webysther

packagist mirror

18/10 2017

2.x-dev

2.9999999.9999999.9999999-dev

Build mirror of packagist

Sources Download

CC0-1.0

The Requires

The Development Requires

by Webysther

packagist mirror

01/01 2015

0.0.1

0.0.1.0

build mirror of packagist.org

Sources Download

CC0-1.0

The Requires

spindle/httpclient 1.*
php >=5.3
ext-json *
ext-hash *
ext-curl *
ext-pdo *
ext-zlib *
ext-pdo_sqlite *

library packagist-mirror

Build mirror of packagist

webysther/packagist-mirror

The README.md

DEPRECATED

📦 Packagist Mirror

Announcement: Composer 2 is now available!

⚙️ How it works?

🌎 Packagist public metadata mirrors observatory around the world

🚀 Create your own mirror

Docker Compose

Docker Nginx PHP

Nginx PHP

🐧 Development & Contributing

📋 Requirements

🧪 Testing

🥂 Credits

💙 Other correlated projects

☮️ License

The Versions

dev-master

The Requires

The Development Requires

by Webysther

1.0.3

The Requires

The Development Requires

by Webysther

1.0.2

The Requires

The Development Requires

by Webysther

1.0.1

The Requires

The Development Requires

by Webysther

1.0.0

The Requires

The Development Requires

by Webysther

dev-feature/decoupled

The Requires

The Development Requires

by Webysther

2.x-dev

The Requires

The Development Requires

by Webysther

0.0.1

The Requires

by Hiraku NAKANO