On Mon, Feb 12, 2018 at 09:22:30AM +0000, Daniel P. Berrangé wrote:
On Fri, Feb 09, 2018 at 06:01:53PM +0000, Richard W.M. Jones wrote:
> My contention is that the libguestfs git repository is too large and
> unwieldy. There are too many separate, unrelated projects and as a
> result of that the source has too many dependencies and takes too long
> to build and test.
>
> The project divides (sort of) naturally into layers -- the library,
> the bindings, the various virt tools -- and could be split along those
> lines into separate projects which can then be released and evolve at
> their own pace.
>
> My suggested split would be something like this:
>
> * libguestfs: The library, daemon and appliance. That would include
> the following directories in a single project:
> appliance
> bash
> contrib
> daemon
> docs
> examples
> gnulib
> lib
> logo
> test-tool
> tmp
> utils
> website
>
> * 1 project for each language binding:
> csharp
> erlang
> gobject
> golang
> haskell
> java
> lua
> ocaml
> php
> perl
> python
> ruby
So, the core library above would still include the API description
and "make install" it into some location, such that these language
bindings cna auto-generate themselves I presume. I guess that means
you would rarely need to do releases of these language bindings, as
one release ought to be capable of being built against multiple
versions of the core library ?
Certainly the language bindings are the hardest to deal with but also
the most important to move out in terms of reducing dependencies. The
"API description" continues to be the generator, turned into a git
submodule and shared across all of them.
But it's not a fully formed plan. One particular difficulty is - as
you note - that some of the bindings cannot be compiled against a
different version of libguestfs (we discovered this when we turned the
Python bindings into a PyPi module), so likely they'd all need to be
released at the same time, or else modified so at least they need a
minimum version of libguestfs.
> * I'd be inclined to drop the legacy Perl tools virt-tar,
> virt-list-filesystems, virt-list-partitions unless someone
> especially wished to step forward to maintain them.
>
> * common code and generator: Off to the side we'd somehow need to
> package up the common code and the generator for use by all of the
> above projects. It wouldn't be a separate project for downstream
> packagers, but instead the code would be included (ie. duplicated)
> in tarballs and upstream available as a side git repo that you'd
> need to include when building (git submodule?). This is somewhat
> unspecified.
I guess sub-modules are reasonable for this, unless you actually
modulized the generator itself, such that the language binding
generation code could be a loadable module. That way the core
generator could be in the core library (and its -devel) package,
and the language binding repo could have the langauge specific
plugin for the generator ?
We can keep the generator as a single program with only a small
modification (it needs to check if a directory exists before putting
files there).
How exactly this all works when compiling from tarballs is also not
clear.
Rich.
--
Richard Jones, Virtualization Group, Red Hat
http://people.redhat.com/~rjones
Read my programming and virtualization blog:
http://rwmj.wordpress.com
virt-top is 'top' for virtual machines. Tiny program with many
powerful monitoring features, net stats, disk stats, logging, etc.
http://people.redhat.com/~rjones/virt-top