[kibana-plugin CLI][master] add optimize task and skip-optimize option on install task

[gwintzer]

Same as #14515, but with my pull request against master

Here's a PR according to the issue #6057.

Add a new optimize task to the kibana-plugin CLI
Add an option --skip-optimize for the existing install task
Example :

#install your plugins faster
./bin/kibana-plugin install --skip-optimize plugin1
./bin/kibana-plugin install --skip-optimize plugin2

#finally run the optimize task once
./bin/kibana-plugin optimize

[elasticmachine]

Can one of the admins verify this patch?

[jbudz]

This is awesome and much needed, thanks for the PR @gwintzer.

A couple discussion points, /cc @tylersmalley :

• My ideal version of this would be to make optimization opt in for plugin installation. We get tons of bugs filed for Permission errors in packages after server optimizing #8818 and this would cut down on nearly all of them.
• Plugin installation validates kibana.yml due to the optimize task, there's been a few related bugs to setting kibana.yml before installation
• I'd like to see a separate script for optimization to be as clear as possible for the standalone task - it fits under bin/kibana and bin/kibana-plugin so instead of supporting both we can be explicit with bin/kibana-optimize.

usage:

bin/kibana-plugin install foo --optimize
bin/kibana-optimize

Thoughts?

[tylersmalley]

@jbudz, I agree with all of your points but changing the default to not optimize during plugin installation might be considered a breaking change. I would be for backporting this to 6.0, and in 7 flipping the defaults. Though, hopefully then we will have removed the optimize process altogether.

[FireBurn]

Here's the backport to 6.1, I have ones for 6.0 and 5.6 if anyone else needs them https://gist.github.com/FireBurn/2ecaaff4c40a6dd9bb865f732a9754a7

[theikkila]

Any idea when you're gonna merge this?

[hierony94]

I hope this feature will release soon.

{"type":"log","@timestamp":"2018-01-18T04:34:36Z","tags":["info","optimize"],"pid":1,"message":"Optimization of bundles for kibana, timelion and status_page complete in **466.53 seconds**"}

[CpuID]

+1 to getting this merged sometime soonish

[Stono]

+1, this is a pain in the arse and results in long builds for us!

[pchanas]

+1 I do confirm the pain

[jcoeltjen]

👍 , we be a great feature for us! Then we would be able to remove some nasty workaround hacks...

[elasticmachine]

Since this is a community submitted pull request, a Jenkins build has not been kicked off automatically. Can an Elastic organization member please verify the contents of this patch and then kick off a build manually?

[joshdover]

Closing since we've implemented this over in #16302