Quantcast

[HEADSUP & CFT] pkg 1.0rc1 and schedule

classic Classic list List threaded Threaded
34 messages Options
12
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

[HEADSUP & CFT] pkg 1.0rc1 and schedule

Baptiste Daroussin-2
Hi,

On behalf of the pkgng team I'm really pleased to announce pkg 1.0 RC1 (aka pkgng)

Only bug fixes will be accepted in the RC phase.

What is pkg
-----------
pkg is a new package manager for FreeBSD. It is designed as a replacement for
the pkg_* tools, and as a full featured binary package manager.

It provides a library that does all the work, and a frontend to be used by users

The ports tree is already able to transparently switch to pkgng by default by
adding WITH_PKGNG=yes to your make.conf

It provides a pkg2ng tool to help converting from an old installation to a new
one.

Test repositories are available on http://pkgbeta.freebsd.org/ (I try to update
them as fast as I can)

It will live forever in the ports tree (with a binary bootstrap in 9 and 10)

Why pkg?
--------
pkg_* tools have become hardly maintainable over the time, it lacks lots of
features most of people are expecting from a package manager:
  - binary upgrade
  - ability to search information about remote packages
  - real reverse dependency tracking
  - tracking leaves
  - many more.

Third party tools
-----------------

Tools supporting natively pkgng
  - ports-mgmt/portupgrade-devel (soon the main portupgrade will support)
  - ports-mgmt/pkg_cutleaves
  - ports-mgmt/poudriere
  - ports-mgmt/portdowngrade
  - ports-mgmt/tinderbox-devel (support can be improved)

Tools supporting pkgng via a patch (I hope it will be reviewed/integrated soon)
  - ports-mgmt/portmaster (https://github.com/pkgng/pkgng/blob/master/ports/patch-portmaster-pkgng)

Tools being worked on (or I heard people are interested) :
  - salt support (in version 0.10) http://salt.readthedocs.org/en/v0.10.0/ref/modules/all/salt.modules.freebsdpkg.html
  - cfengine support
  - puppet support: (https://github.com/xaque208/puppet-pkgng)
  - ruby bindings: (https://github.com/baloo/libpkg-ruby/)
  - PackageKit

Links
-----
  - http://wiki.freebsd.org/PkgPrimer
  - http://wiki.freebsd.org/pkgng

Please report bugs in the github issue tracker:
  - http://github.com/pkgng/pkgng

Schedule
--------

The plan is to switch the ports tree to pkgng on CURRENT by default on July 25th
No dates are planned yet for other branches.

Note that there will be a NO_PKGNG knob for some time (undefined yet) for people
not will to switch on July 25th

Please also note that some ports won't work with pkgng right now, because pkgng
is more strict than pkg_install on purpose.
The major one is: nvidia drivers, because pkgng does not allow to overwrite a file
owned by another package, and we will not accept any hacks for that in pkgng.

Road to next version
--------------------

The road to the next version is already open and lots of work will happen, list
of ideas:
  - remote repositories will be able to display update messages
  - optionnal remote files repository to be able to search which packages to
    install if you want a known binary
  - real solver,
  - better support for multi repository
  - provides/requires support
  - stabilisation of the library API
  - reduce as much as possible scripting in packages to allow cross installation
  - many more :D

regards,
Bapt

attachment0 (203 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Alberto Villa-3
On Thu, Jul 12, 2012 at 12:01 PM, Baptiste Daroussin <[hidden email]> wrote:
> Third party tools
> -----------------
>
> Tools supporting natively pkgng
>   - ports-mgmt/portupgrade-devel (soon the main portupgrade will support)
>   - ports-mgmt/pkg_cutleaves
>   - ports-mgmt/poudriere
>   - ports-mgmt/portdowngrade
>   - ports-mgmt/tinderbox-devel (support can be improved)

Also:
- ports-mgmt/portbuilder.
--
Alberto Villa, FreeBSD committer <[hidden email]>
http://people.FreeBSD.org/~avilla
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Marin Atanasov Nikolov
In reply to this post by Baptiste Daroussin-2
On Thu, Jul 12, 2012 at 1:01 PM, Baptiste Daroussin <[hidden email]> wrote:

> Tools being worked on (or I heard people are interested) :
>   - salt support (in version 0.10) http://salt.readthedocs.org/en/v0.10.0/ref/modules/all/salt.modules.freebsdpkg.html
>   - cfengine support

And here's a link to the Cfengine 3 + pkgng documentation :)

 - http://unix-heaven.org/cfengine3-freebsd-pkgng

Regards,
Marin



--
Marin Atanasov Nikolov

dnaeon AT gmail DOT com
daemon AT unix-heaven DOT org
http://www.unix-heaven.org/
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

dougb
In reply to this post by Baptiste Daroussin-2
I do not mean this e-mail to be in any way critical. I was told after
the new OPTIONS framework discussion that I should have asked questions
before the change, so I'm asking these questions now; in a genuine
attempt to get information.

On 07/12/2012 03:01 AM, Baptiste Daroussin wrote:

In the time that you have been working on this project I have asked
numerous times for you(pl.) to answer the following questions:

1. What are the goals for pkg?
2. Why can't the existing tools fulfill those goals?
3. How does pkg fulfill them?

You've put some of this in the various places where pkg is documented,
but I don't see any thorough treatment of these questions. You have some
of it below, which I'd like to see expanded on if you would be so kind. :)

> Why pkg?
> --------
> pkg_* tools have become hardly maintainable over the time,

I agree on this point, but the right solution (as some of us have been
saying for years) is to move the pkg_* tools into the ports tree. You
are correctly handling that by keeping pkg in the ports tree, I'm simply
pointing out that this isn't a reason we need to switch to pkg.

> it lacks lots of features most of people are expecting from a package manager:
>   - binary upgrade

I'm not sure what you mean by this. We have the ability to create binary
packages now.

>   - ability to search information about remote packages

This is a good feature, certainly. However there is no reason we can't
create a tool to do this, or add the functionality to an existing tool.

>   - real reverse dependency tracking
>   - tracking leaves

Can you expand on what these 2 mean?

What I'm looking for is compelling motivation to make this overwhelming
change to the ports infrastructure.


> Schedule
> --------
>
> The plan is to switch the ports tree to pkgng on CURRENT by default on July 25th
> No dates are planned yet for other branches.

Can you describe how this is going to be done? I assume with an
OSVERSION knob in bsd.port.mk?

> Note that there will be a NO_PKGNG knob for some time (undefined yet) for people
> not will to switch on July 25th
>
> Please also note that some ports won't work with pkgng right now, because pkgng
> is more strict than pkg_install on purpose.
> The major one is: nvidia drivers, because pkgng does not allow to overwrite a file
> owned by another package, and we will not accept any hacks for that in pkgng.

IMO it would be a very large mistake to switch the default in any branch
until the problem with the nvidia drivers is sorted out. We have a lot
of users (myself included) who use this port, and by switching the
default there's going to be 1 of 2 outcomes for those users. Either they
will opt-out, which means you won't get the level of testing you're
looking for; or you'll break their existing ports installation. Neither
outcome is desirable.

Doug
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Craig Rodrigues
On Thu, Jul 12, 2012 at 11:48 AM, Doug Barton <[hidden email]> wrote:

> 1. What are the goals for pkg?
> 2. Why can't the existing tools fulfill those goals?
> 3. How does pkg fulfill them?
>
>
Hi,

You might want to view Baptiste's pkgng presentation at BSDCan:

http://www.youtube.com/watch?v=4Hxq7AHZ27I

For me, that presentation clarified the goals and motivation
of the pkgng project.

After viewing that presentation, for me it put into perspective some of the
other pkgng information at http://wiki.freebsd.org/pkgng/ .

--
Craig Rodrigues
[hidden email]
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

dougb
On 07/12/2012 02:11 PM, Craig Rodrigues wrote:
> You might want to view Baptiste's pkgng presentation at BSDCan:
>
> http://www.youtube.com/watch?v=4Hxq7AHZ27I

Sure, the next time I have an hour to spare.

I don't think what I'm asking for is unreasonable. One could even
conclude that answering those 3 questions should have been a
prerequisite for starting down this road in the first place.

Doug
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Baptiste Daroussin-2
In reply to this post by dougb
On Thu, Jul 12, 2012 at 11:48:41AM -0700, Doug Barton wrote:

> I do not mean this e-mail to be in any way critical. I was told after
> the new OPTIONS framework discussion that I should have asked questions
> before the change, so I'm asking these questions now; in a genuine
> attempt to get information.
>
> On 07/12/2012 03:01 AM, Baptiste Daroussin wrote:
>
> In the time that you have been working on this project I have asked
> numerous times for you(pl.) to answer the following questions:
>
> 1. What are the goals for pkg?
The why part of this mail should reply this question, no?

Anyway the goal is to have a decent package manager, providing modern features:
repositories, decent dependency tracking, decent reverse dependency tracking,
managing upgrade correctly (I'll explain this more later), provide a decent
library for third party tools (desktop integration via PackageKit for example)

Providing easy package management for enterprise (who never got problems
managing packages on a large set of freebsd servers, and how complicated it is
on FreeBSD to have automated reliable puppet,salt,chef,cfengine like tools)
One of the proof of this problem is how fast people integrated pkgng in those
tools.

> 2. Why can't the existing tools fulfill those goals?

The existing tools can't fulfill those goals, because they are hardly
maintainable, the code hasn't change much since when they were written, lot of
people have tried over the year to improve them, but all of them gave up. The
design of the tools, (I mean the code) is really imho not adapted to be
improved, I spent a lot of time trying to work on it before starting a complete
new project.

For example they do not know what is a version, they do not know what are the
reverse dependencies except through this ugly hack that is +REQUIRED_BY, the
database is pretty fragile: who never got the package corrupted: empty @pkgdep
line for example.

> 3. How does pkg fulfill them?
>
> You've put some of this in the various places where pkg is documented,
> but I don't see any thorough treatment of these questions. You have some
> of it below, which I'd like to see expanded on if you would be so kind. :)

It is true that, I'm not very good at documenting in general, and even more in
english, hopefully, the documentation is improving a lot recently, there is the
for usage:
http://wiki.freebsd.org/PkgPrimer
and for all other things:
http://wiki.freebsd.org/pkgng

Lot of native english speakers have joined the project and help with
documentation, if you find someting missing, do not hesitate to had the section
in the apropriate wiki page, I often have a look at them, and try to fill all
the blank section to answer user questions.
>

> > Why pkg?
> > pkg_* tools have become hardly maintainable over the time,
>
> I agree on this point, but the right solution (as some of us have been
> saying for years) is to move the pkg_* tools into the ports tree. You
> are correctly handling that by keeping pkg in the ports tree, I'm simply
> pointing out that this isn't a reason we need to switch to pkg.
>
> > it lacks lots of features most of people are expecting from a package manager:
> >   - binary upgrade
>
> I'm not sure what you mean by this. We have the ability to create binary
> packages now.
No we haven't :), I know we can mimic a binary upgrade using for example
portmaster (I describe this in a poudriere howto) but this is not fully binary
upgrade, it is deinstalling/reinstalling a package. Binary upgrade is much more
complexe than that, for example one thing you can't handle now is a package that
has been splitted into lib vs runtime will break with the current way we can do
it. Just as an example.

Just have a look at this old video:
http://www.youtube.com/watch?v=iBgcuKF8R_A (it is only 1m30)

>
> >   - ability to search information about remote packages
>
> This is a good feature, certainly. However there is no reason we can't
> create a tool to do this, or add the functionality to an existing tool.

Have a look at what pkgng can present you as information and you will see the
difference.

>
> >   - real reverse dependency tracking
> >   - tracking leaves
>
> Can you expand on what these 2 mean?

Of course. The current reverse dependency tracking in pkg_install is a hack: a
+REQUIRED_BY file trying to maintain the list of packages that may depend on the
said dependency, a good way to see it is a hack is to see how often the file get
broken (and on portmaster you added an options to fix them so you might know :))

>
> What I'm looking for is compelling motivation to make this overwhelming
> change to the ports infrastructure.

There is not much changes needed in the ports infrastructure. It now works ootb
But there are tons of improvements pkgng will offers, like: ability to simply
add new plist keyword without the need of modifying pkgng, native support for
registering a package from a stagedir.

>
>
> > Schedule
> > --------
> >
> > The plan is to switch the ports tree to pkgng on CURRENT by default on July 25th
> > No dates are planned yet for other branches.
>
> Can you describe how this is going to be done? I assume with an
> OSVERSION knob in bsd.port.mk?
Yes the plan if to check OSVERSION and define WITH_PKGNG on the concerned
versions except if the user have defined NO_PKGNG in make.conf

>
> > Note that there will be a NO_PKGNG knob for some time (undefined yet) for people
> > not will to switch on July 25th
> >
> > Please also note that some ports won't work with pkgng right now, because pkgng
> > is more strict than pkg_install on purpose.
> > The major one is: nvidia drivers, because pkgng does not allow to overwrite a file
> > owned by another package, and we will not accept any hacks for that in pkgng.
>
> IMO it would be a very large mistake to switch the default in any branch
> until the problem with the nvidia drivers is sorted out. We have a lot
> of users (myself included) who use this port, and by switching the
> default there's going to be 1 of 2 outcomes for those users. Either they
> will opt-out, which means you won't get the level of testing you're
> looking for; or you'll break their existing ports installation. Neither
> outcome is desirable.
I proposed 3 differents way to fix the nvidia driver problem, no one really
takle the task on it even if most agreed with at least one of the method.

So waiting for someone to provide a really clean way to provide nvidia driver,
I'm now working on a small modification of the current way it works, that will
bypass the pkgng strictness.

So nvidia-driver should be fixed on pkgng quite soon (if maintainer do accept
the modification :)).

I hope, I have answered your question correctly?

regards,
Bapt

attachment0 (203 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Michel Talon
In reply to this post by Baptiste Daroussin-2
Doug Barton wrote:
> What I'm looking for is compelling motivation to make this overwhelming
> change to the ports infrastructure.
Because the present state of the ports system is not a compelling enough reason?  My
arms are falling …



--

Michel Talon
[hidden email]





Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

dougb
In reply to this post by Baptiste Daroussin-2
On 07/12/2012 03:02 PM, Baptiste Daroussin wrote:

> On Thu, Jul 12, 2012 at 11:48:41AM -0700, Doug Barton wrote:
>> I do not mean this e-mail to be in any way critical. I was told after
>> the new OPTIONS framework discussion that I should have asked questions
>> before the change, so I'm asking these questions now; in a genuine
>> attempt to get information.
>>
>> On 07/12/2012 03:01 AM, Baptiste Daroussin wrote:
>>
>> In the time that you have been working on this project I have asked
>> numerous times for you(pl.) to answer the following questions:
>>
>> 1. What are the goals for pkg?
>
> The why part of this mail should reply this question, no?

Well clearly not, because if it did I wouldn't keep asking the same
questions over and over again. :)

> Anyway the goal is to have a decent package manager, providing modern features:
> repositories, decent dependency tracking, decent reverse dependency tracking,
> managing upgrade correctly (I'll explain this more later), provide a decent
> library for third party tools (desktop integration via PackageKit for example)

I don't know what "decent" means. I don't know what "modern features"
means (beyond the buzzwords that you've included).

> Providing easy package management for enterprise

Having set up package management systems for enterprises before, *this*
is actually a big-picture goal that I have a lot of sympathy for. But
again, what's missing is *details* about here is what large enterprises
need to make things work for them, here's why the existing tools don't
meet those needs, and here is how pkg does meet them.

> (who never got problems
> managing packages on a large set of freebsd servers, and how complicated it is
> on FreeBSD to have automated reliable puppet,salt,chef,cfengine like tools)
> One of the proof of this problem is how fast people integrated pkgng in those
> tools.

This gets to the heart of my biggest fear regarding this whole project.
It's new, it's shiny, and it looks like forward progress is being made.
Thus, it's attracted a lot of attention, input, time, etc. Heck, it may
even BE forward progress, but I don't know how to measure that because I
don't know what the goals of the project are. Thus, my fear is that
without *details* about what the project is, and what it's trying to
accomplish, we're going to put an exponentially larger volume of work
into the transition and end up no closer to the goal of having a mature
package management system.

And just to be clear, I am *not* saying that "pkg sucks" or that it's
bad, or wrong, or anything else. I'm saying that I don't know how to
evaluate it, because you haven't given us a criteria by which to measure
it.

So what's the problem? We *desperately* need a better system for ports
and packages. We only have so many person-hours we can devote to making
that happen. If we spend all of them on pkg, and it ends up not helping
us enough, we've burnt out our volunteers for no good reason.

>> 2. Why can't the existing tools fulfill those goals?
>
> The existing tools can't fulfill those goals, because they are hardly
> maintainable, the code hasn't change much since when they were written, lot of
> people have tried over the year to improve them, but all of them gave up. The
> design of the tools, (I mean the code) is really imho not adapted to be
> improved, I spent a lot of time trying to work on it before starting a complete
> new project.

This paragraph really frightens me.

> For example they do not know what is a version, they do not know what are the
> reverse dependencies except through this ugly hack that is +REQUIRED_BY, the
> database is pretty fragile: who never got the package corrupted: empty @pkgdep
> line for example.

So these 2 are a lot closer to what I'd like to see ... *details* about
what isn't working now. I would tend to disagree with you that
+REQUIRED_BY is an ugly hack, it's no uglier than any of the other text
file based dependency tracking we have. But thank you for giving us more
information.

So taking your last example, how does pkg handle the situation where the
user wants to forcibly delete a package that is depended on by another
package?

>> 3. How does pkg fulfill them?
>>
>> You've put some of this in the various places where pkg is documented,
>> but I don't see any thorough treatment of these questions. You have some
>> of it below, which I'd like to see expanded on if you would be so kind. :)
>
> It is true that, I'm not very good at documenting in general, and even more in
> english, hopefully, the documentation is improving a lot recently, there is the
> for usage:
> http://wiki.freebsd.org/PkgPrimer
> and for all other things:
> http://wiki.freebsd.org/pkgng
>
> Lot of native english speakers have joined the project and help with
> documentation, if you find someting missing, do not hesitate to had the section
> in the apropriate wiki page, I often have a look at them, and try to fill all
> the blank section to answer user questions.

I'm not looking for "how to." I've explained to you numerous times that
I'm looking for a project description. And your English is fine, I
understand what you write perfectly, the problem is that you are not
willing to sit down and write out, in detail, what the project's goals are.

So I'm left to conclude that either A) you don't know because you've
never actually sat down and thought them through, or B) you don't think
you should have to explain yourself. I find both answers disturbing. Of
course there is always answer C) you think I'm a jerk and can't be
bothered to answer my questions. If that's the case, fair enough. Just
tell me that so I can stop trying to make sense of it.

>>> Why pkg?
>>> pkg_* tools have become hardly maintainable over the time,
>>
>> I agree on this point, but the right solution (as some of us have been
>> saying for years) is to move the pkg_* tools into the ports tree. You
>> are correctly handling that by keeping pkg in the ports tree, I'm simply
>> pointing out that this isn't a reason we need to switch to pkg.
>>
>>> it lacks lots of features most of people are expecting from a package manager:
>>>   - binary upgrade
>>
>> I'm not sure what you mean by this. We have the ability to create binary
>> packages now.
>
> No we haven't :), I know we can mimic a binary upgrade using for example
> portmaster (I describe this in a poudriere howto) but this is not fully binary
> upgrade, it is deinstalling/reinstalling a package. Binary upgrade is much more
> complexe than that, for example one thing you can't handle now is a package that
> has been splitted into lib vs runtime will break with the current way we can do
> it.

So what you're saying is that you want to do an in-place binary upgrade
of an already installed package? If so, that's an interesting goal, and
I'd like to hear more about it. Including but not limited to, what are
the advantages and disadvantages to doing that, vs. deinstall->install
of the "old" kind of packages? How do you handle the case where the new
version has less files than the old? What happens if the files in the
installed version have become modified/corrupted somehow?

>>>   - ability to search information about remote packages
>>
>> This is a good feature, certainly. However there is no reason we can't
>> create a tool to do this, or add the functionality to an existing tool.
>
> Have a look at what pkgng can present you as information and you will see the
> difference.

Sorry, this response doesn't address what I wrote. You're saying that
you want this feature, so you created a tool that does it. That doesn't
change my point that moving to pkg isn't necessary to accomplish this.

>>>   - real reverse dependency tracking
>>>   - tracking leaves
>>
>> Can you expand on what these 2 mean?
>
> Of course. The current reverse dependency tracking in pkg_install is a hack: a
> +REQUIRED_BY file trying to maintain the list of packages that may depend on the
> said dependency, a good way to see it is a hack is to see how often the file get
> broken (and on portmaster you added an options to fix them so you might know :))

Actually if you pkg_delete stuff in the right order it never gets
broken. But, users don't do that, so you're correct that one of the
features of portmaster is that it keeps +CONTENTS and +REQUIRED_BY up to
date when dependent packages are updated.

But the same logic I use in portmaster could easily be brought into the
ports framework itself, if that was something that people wanted.

>> What I'm looking for is compelling motivation to make this overwhelming
>> change to the ports infrastructure.
>
> There is not much changes needed in the ports infrastructure. It now works ootb
> But there are tons of improvements pkgng will offers, like: ability to simply
> add new plist keyword without the need of modifying pkgng,

That's a feature that could be had just as easily by moving pkg_* to the
ports tree.

> native support for registering a package from a stagedir.

That's another set of changes that it would be nice to see a thorough
project plan for. :)

>> IMO it would be a very large mistake to switch the default in any branch
>> until the problem with the nvidia drivers is sorted out. We have a lot
>> of users (myself included) who use this port, and by switching the
>> default there's going to be 1 of 2 outcomes for those users. Either they
>> will opt-out, which means you won't get the level of testing you're
>> looking for; or you'll break their existing ports installation. Neither
>> outcome is desirable.
>
> I proposed 3 differents way to fix the nvidia driver problem, no one really
> takle the task on it even if most agreed with at least one of the method.
>
> So waiting for someone to provide a really clean way to provide nvidia driver,
> I'm now working on a small modification of the current way it works, that will
> bypass the pkgng strictness.
>
> So nvidia-driver should be fixed on pkgng quite soon (if maintainer do accept
> the modification :)).

As long as the solution arrives in the ports tree *before* the default
is switched, it should be fine.

Doug
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Michael Ranner-2
Am 13.07.12 01:10, schrieb Doug Barton:

> On 07/12/2012 03:02 PM, Baptiste Daroussin wrote:
>> On Thu, Jul 12, 2012 at 11:48:41AM -0700, Doug Barton wrote:
>>> I do not mean this e-mail to be in any way critical. I was told after
>>> the new OPTIONS framework discussion that I should have asked questions
>>> before the change, so I'm asking these questions now; in a genuine
>>> attempt to get information.
>>>
>>> On 07/12/2012 03:01 AM, Baptiste Daroussin wrote:
>>>
>>> In the time that you have been working on this project I have asked
>>> numerous times for you(pl.) to answer the following questions:
>>>
>>> 1. What are the goals for pkg?
>> The why part of this mail should reply this question, no?
> Well clearly not, because if it did I wouldn't keep asking the same
> questions over and over again. :)
>
>> Anyway the goal is to have a decent package manager, providing modern features:
>> repositories, decent dependency tracking, decent reverse dependency tracking,
>> managing upgrade correctly (I'll explain this more later), provide a decent
>> library for third party tools (desktop integration via PackageKit for example)
> I don't know what "decent" means. I don't know what "modern features"
> means (beyond the buzzwords that you've included).
>
>> Providing easy package management for enterprise
> Having set up package management systems for enterprises before, *this*
> is actually a big-picture goal that I have a lot of sympathy for. But
> again, what's missing is *details* about here is what large enterprises
> need to make things work for them, here's why the existing tools don't
> meet those needs, and here is how pkg does meet them.
>
>> (who never got problems
>> managing packages on a large set of freebsd servers, and how complicated it is
>> on FreeBSD to have automated reliable puppet,salt,chef,cfengine like tools)
>> One of the proof of this problem is how fast people integrated pkgng in those
>> tools.
> This gets to the heart of my biggest fear regarding this whole project.
> It's new, it's shiny, and it looks like forward progress is being made.
> Thus, it's attracted a lot of attention, input, time, etc. Heck, it may
> even BE forward progress, but I don't know how to measure that because I
> don't know what the goals of the project are. Thus, my fear is that
> without *details* about what the project is, and what it's trying to
> accomplish, we're going to put an exponentially larger volume of work
> into the transition and end up no closer to the goal of having a mature
> package management system.
>
> And just to be clear, I am *not* saying that "pkg sucks" or that it's
> bad, or wrong, or anything else. I'm saying that I don't know how to
> evaluate it, because you haven't given us a criteria by which to measure
> it.
>
> So what's the problem? We *desperately* need a better system for ports
> and packages. We only have so many person-hours we can devote to making
> that happen. If we spend all of them on pkg, and it ends up not helping
> us enough, we've burnt out our volunteers for no good reason.

I am using pkg_* tools since '94 and I am using portmaster for ports/pkg
maintainance for years: pkg_* tools are a pain in the ass in the view of
an administrator. I use it only and partly on fresh installs and doing
further security auditing with portaudit and upgrading with portmaster -
most time upgrading from source. But only, because its simply not
possible the same way with the pkg_* tools.

Because I manage dozens of installation across Europe, buildind and
updating from ports will be more and more time consuming. portmaster is
really a great tool to take control of this lack of features in pkg_*
tools , but I am running out of time more and more.

I was also a bit concerned and reserved to pkgng. But I am also in
contact with some local FreeBSD ports committers and one of them (decke)
told me some stories about pkgng and poudriere. I saw the talk from Beat
Gätzi (beat) at EU BSD Day 2012 about pkgng and was I see was really
nice and made me courious. So I tried to setup a small build environment
with poudriere and pkgng to evaluate an substitution for my traditional
pkg/port security upgrading with portmaster.

Finally I think, I can complete replace portmaster with pkgng, poudriere
and an self build and maintained pkg repository. This will save a huge
amount of time in future and allow to roll out security updates for
packages really fast and easy.

So pkgng is not designed as a replacement for portmaster, but now it
allows me to work without it on most of my installations.

I know almost any of the "Linux Enterprise" package management features,
pkg_* tools a far away from this kind of functionality, even with the
support of the great portmaster tool. Bug pkgng improves much more.

Its a very complex problematic. Yes documentation is not so good as it
could be. But I saw the talks from beat in live, saw the screencasts
from bapt on Youtube and finally I tried it on my own. It was necessary
to try it out and see it, feel it, smell and taste it.

I think its good work from admin and enterprise point of view.

Doug has written portmaster and integrated package handeling, which I
only use rarely on my old desktop. Why was this handling integrated in
portmaster and not in pkg_* tools?

I know its something unkown and new and I had also my problems with the
idea of pkgng for the first time (why reinventing the wheel...) - but I
tried it out and it works really really well.

My opinion after 18 years of FreeBSD administration.

Regards,
Michael

--
Mit freundlichen Grüßen

Ing. Michael Ranner

GSM:  +43 676 4155044
Mail: [hidden email]
WWW:  http://www.azedo.at/

_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Fbsd8
What I want to know is this new pkg system going to remove the
requirement of having the complete ports tree on my system?

What I am looking for in an port system, is to install a port and any
files needed for the parent port and its dependents to automatically be
downloaded. So in the end my system ports tree only contain the files
used to install the ports I use and their dependents.
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

John Baldwin
In reply to this post by dougb
On Thursday, July 12, 2012 5:16:41 pm Doug Barton wrote:

> On 07/12/2012 02:11 PM, Craig Rodrigues wrote:
> > You might want to view Baptiste's pkgng presentation at BSDCan:
> >
> > http://www.youtube.com/watch?v=4Hxq7AHZ27I
>
> Sure, the next time I have an hour to spare.
>
> I don't think what I'm asking for is unreasonable. One could even
> conclude that answering those 3 questions should have been a
> prerequisite for starting down this road in the first place.

One could also assume that other people in the Project aren't morons and do
actually put thought into the things they do for starters (you do realize,
btw, that that is how you come across, that even though you don't intend that,
constantly questioning decisions made by other people in an accusatory fashion
gives that impression?  At least adjust your wording to start off with the
assumption that other people _have_ put thought into things.  Also, when other
people have taken time to explain an large decision because you are too lazy
to invest the time doesn't really help your case).

In terms of the first feature (binary upgrades), the truth is that if you have
more than 5 machines to manage, our current pkg tools completely suck.  There
is no automated upgrade mechanism.  If you want one you have to write your own
set of infrastructure to do the right collection of pkg_delete/pkg_adds.  
Certainly there is no support in the current package tools for doing batch
upgrades (i.e. upgrading from one completely package set to another).  pkgng
adds that feature, and I find it a must for supporting large installations of
machines that need automated management.

--
John Baldwin
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Michael Ranner-2
In reply to this post by Fbsd8
Am 13.07.12 14:14, schrieb Fbsd8:
> What I want to know is this new pkg system going to remove the
> requirement of having the complete ports tree on my system?
>
> What I am looking for in an port system, is to install a port and any
> files needed for the parent port and its dependents to automatically
> be downloaded. So in the end my system ports tree only contain the
> files used to install the ports I use and their dependents.
>
The new pkg system is not a replacement for the ports tree.

If you still like to compile software from ports, you will need the
ports tree.

But you can install a precompiled package with the new pkg system and it
automatically downloads all necessary binary packages it depends on. So
probably you dont need the ports any more.

Regards
Michael

--
Mit freundlichen Grüßen

Ing. Michael Ranner

GSM:  +43 676 4155044
Mail: [hidden email]
WWW:  http://www.azedo.at/

_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Matthew Seaman-2
In reply to this post by Fbsd8
On 13/07/2012 13:14, Fbsd8 wrote:
> What I want to know is this new pkg system going to remove the
> requirement of having the complete ports tree on my system?
>
> What I am looking for in an port system, is to install a port and any
> files needed for the parent port and its dependents to automatically be
> downloaded. So in the end my system ports tree only contain the files
> used to install the ports I use and their dependents.

Yes, you will be able to use pkgng without having a full ports tree
installed on your system.  You can pretty much do that already, although
the central pkgng package repository is still only in beta.

The only bit of pkgng that still requires the ports to be installed is
'pkg version' which is not critical for maintaining your system.
Modifying 'pkg version' so that it doesn't need to use the ports tree is
an open issue on github:

   https://github.com/pkgng/pkgng/issues/195

Patches / pull requests gratefully received.

        Cheers,

        Matthew

--
Dr Matthew J Seaman MA, D.Phil.                   7 Priory Courtyard
                                                  Flat 3
PGP: http://www.infracaninophile.co.uk/pgpkey     Ramsgate
JID: [hidden email]               Kent, CT11 9PW




signature.asc (275 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Bryan Drewery
In reply to this post by Michael Ranner-2
On 7/13/2012 3:16 AM, Michael Ranner wrote:
> I was also a bit concerned and reserved to pkgng. But I am also in
> contact with some local FreeBSD ports committers and one of them (decke)
> told me some stories about pkgng and poudriere. I saw the talk from Beat
> Gätzi (beat) at EU BSD Day 2012 about pkgng and was I see was really
> nice and made me courious. So I tried to setup a small build environment
> with poudriere and pkgng to evaluate an substitution for my traditional
> pkg/port security upgrading with portmaster.

This explains how you can setup your own repository and build your own
packages with poudriere+pkgng:

http://blog.etoilebsd.net/post/Home_made_pkgng_repo

--
Regards,
Bryan Drewery
bdrewery@freenode/EFNet




signature.asc (915 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

dougb
In reply to this post by John Baldwin
On 07/13/2012 05:26 AM, John Baldwin wrote:

> On Thursday, July 12, 2012 5:16:41 pm Doug Barton wrote:
>> On 07/12/2012 02:11 PM, Craig Rodrigues wrote:
>>> You might want to view Baptiste's pkgng presentation at BSDCan:
>>>
>>> http://www.youtube.com/watch?v=4Hxq7AHZ27I
>>
>> Sure, the next time I have an hour to spare.
>>
>> I don't think what I'm asking for is unreasonable. One could even
>> conclude that answering those 3 questions should have been a
>> prerequisite for starting down this road in the first place.
>
> One could also assume that other people in the Project aren't morons and do
> actually put thought into the things they do for starters

I certainly *want* to believe that. But considering the giant mess that
portmgr + Baptiste made of the changes to the OPTIONS framework, that
only touches a fraction of the ports, my willingness to have faith in
"them" to do it right is near zero.

Not to mention that I've been asking for a project plan for pkg since
long before it even hit the ports tree in beta. What I'm asking for
should have been done already considering that this change will affect
*every* port, and *every* user. So either it hasn't actually been done,
or the PTB are refusing to provide it.

Also, please keep in mind that I was criticized for *not* speaking up
about the OPTIONS changes, now I'm being criticized *for* speaking up
prior to pkg going live. In spite of the fact that I'm doing my best to
(repeatedly) be clear that I'm not against the project, I just want to
know more about it.

> Also, when other
> people have taken time to explain an large decision because you are too lazy
> to invest the time doesn't really help your case).

Um, I'm too lazy? I've read everything that's been written on pkg to
date. Have you? 90% of it is "how to" type stuff that doesn't address
what we need. The other 10% is so vague and general as to be useless as
a project plan.

You're an experienced project manager John. If someone who worked for
you came to you with a plan this vague ("modern" foo, "decent" bar), for
a critical system, how would you respond? (And yes, I realize that no
one around here works for me, that isn't my point at all.)

> In terms of the first feature (binary upgrades), the truth is that if you have
> more than 5 machines to manage, our current pkg tools completely suck.  There
> is no automated upgrade mechanism.  If you want one you have to write your own
> set of infrastructure to do the right collection of pkg_delete/pkg_adds.  
> Certainly there is no support in the current package tools for doing batch
> upgrades (i.e. upgrading from one completely package set to another).  pkgng
> adds that feature, and I find it a must for supporting large installations of
> machines that need automated management.

And as I wrote previously, I've been there and done that, so yes, I'm
interested in the feature. But I'd like to know more about the plans for
it so that those of us who *do* have experience in this topic can share
that, and we can avoid having to reinvent the wheel. Or worse, putting
out something half-assed that uses up a lot of developer cycles and
doesn't get the job done.

Doug
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Bryan Drewery
On 7/13/2012 10:36 AM, Doug Barton wrote:

> On 07/13/2012 05:26 AM, John Baldwin wrote:
>> On Thursday, July 12, 2012 5:16:41 pm Doug Barton wrote:
>>> On 07/12/2012 02:11 PM, Craig Rodrigues wrote:
>>>> You might want to view Baptiste's pkgng presentation at BSDCan:
>>>>
>>>> http://www.youtube.com/watch?v=4Hxq7AHZ27I
>>>
>>> Sure, the next time I have an hour to spare.
>>>
>>> I don't think what I'm asking for is unreasonable. One could even
>>> conclude that answering those 3 questions should have been a
>>> prerequisite for starting down this road in the first place.
>>
>> One could also assume that other people in the Project aren't morons and do
>> actually put thought into the things they do for starters
>
> I certainly *want* to believe that. But considering the giant mess that
> portmgr + Baptiste made of the changes to the OPTIONS framework, that
> only touches a fraction of the ports, my willingness to have faith in
> "them" to do it right is near zero.

There's a *major* difference in the testing effort and community
involvement in these 2 projects. OPTIONSng had maybe a handful of
testers over a shorter period of time.

PKGNG has had 40+ contributors and has been in development since 2010.
It's been presented and discussed at multiple conferences and dev
summits. Many people have been building their own packages with PKGNG
for months now, greatly raising the testing coverage on the ports tree.

>
> Not to mention that I've been asking for a project plan for pkg since
> long before it even hit the ports tree in beta. What I'm asking for
> should have been done already considering that this change will affect
> *every* port, and *every* user. So either it hasn't actually been done,
> or the PTB are refusing to provide it.

http://lists.freebsd.org/pipermail/freebsd-current/2012-January/031533.html

I find bapt's research in that post to be evident that a lot of thought
and time did go into planning this.

>
> Also, please keep in mind that I was criticized for *not* speaking up
> about the OPTIONS changes, now I'm being criticized *for* speaking up
> prior to pkg going live. In spite of the fact that I'm doing my best to
> (repeatedly) be clear that I'm not against the project, I just want to
> know more about it.
>
>> Also, when other
>> people have taken time to explain an large decision because you are too lazy
>> to invest the time doesn't really help your case).
>
> Um, I'm too lazy? I've read everything that's been written on pkg to
> date. Have you? 90% of it is "how to" type stuff that doesn't address
> what we need. The other 10% is so vague and general as to be useless as
> a project plan.

Have you watched the BSDCan presentation video yet? It is very
compelling and exciting.

>
> You're an experienced project manager John. If someone who worked for
> you came to you with a plan this vague ("modern" foo, "decent" bar), for
> a critical system, how would you respond? (And yes, I realize that no
> one around here works for me, that isn't my point at all.)
>
>> In terms of the first feature (binary upgrades), the truth is that if you have
>> more than 5 machines to manage, our current pkg tools completely suck.  There
>> is no automated upgrade mechanism.  If you want one you have to write your own
>> set of infrastructure to do the right collection of pkg_delete/pkg_adds.  
>> Certainly there is no support in the current package tools for doing batch
>> upgrades (i.e. upgrading from one completely package set to another).  pkgng
>> adds that feature, and I find it a must for supporting large installations of
>> machines that need automated management.
>
> And as I wrote previously, I've been there and done that, so yes, I'm
> interested in the feature. But I'd like to know more about the plans for
> it so that those of us who *do* have experience in this topic can share
> that, and we can avoid having to reinvent the wheel. Or worse, putting
> out something half-assed that uses up a lot of developer cycles and
> doesn't get the job done.

So get involved! Come help. Contribute.

>
> Doug


--
Regards,
Bryan Drewery
bdrewery@freenode/EFNet


_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Chris Rees-11
On 13 July 2012 17:02, Bryan Drewery <[hidden email]> wrote:

> On 7/13/2012 10:36 AM, Doug Barton wrote:
>> On 07/13/2012 05:26 AM, John Baldwin wrote:
>>> On Thursday, July 12, 2012 5:16:41 pm Doug Barton wrote:
>>>> On 07/12/2012 02:11 PM, Craig Rodrigues wrote:
>>>>> You might want to view Baptiste's pkgng presentation at BSDCan:
>>>>>
>>>>> http://www.youtube.com/watch?v=4Hxq7AHZ27I
>>>>
>>>> Sure, the next time I have an hour to spare.
>>>>
>>>> I don't think what I'm asking for is unreasonable. One could even
>>>> conclude that answering those 3 questions should have been a
>>>> prerequisite for starting down this road in the first place.
>>>
>>> One could also assume that other people in the Project aren't morons and do
>>> actually put thought into the things they do for starters
>>
>> I certainly *want* to believe that. But considering the giant mess that
>> portmgr + Baptiste made of the changes to the OPTIONS framework, that
>> only touches a fraction of the ports, my willingness to have faith in
>> "them" to do it right is near zero.
>
> There's a *major* difference in the testing effort and community
> involvement in these 2 projects. OPTIONSng had maybe a handful of
> testers over a shorter period of time.
>
> PKGNG has had 40+ contributors and has been in development since 2010.
> It's been presented and discussed at multiple conferences and dev
> summits. Many people have been building their own packages with PKGNG
> for months now, greatly raising the testing coverage on the ports tree.
>
>>
>> Not to mention that I've been asking for a project plan for pkg since
>> long before it even hit the ports tree in beta. What I'm asking for
>> should have been done already considering that this change will affect
>> *every* port, and *every* user. So either it hasn't actually been done,
>> or the PTB are refusing to provide it.
>
> http://lists.freebsd.org/pipermail/freebsd-current/2012-January/031533.html
>
> I find bapt's research in that post to be evident that a lot of thought
> and time did go into planning this.
>
>>
>> Also, please keep in mind that I was criticized for *not* speaking up
>> about the OPTIONS changes, now I'm being criticized *for* speaking up
>> prior to pkg going live. In spite of the fact that I'm doing my best to
>> (repeatedly) be clear that I'm not against the project, I just want to
>> know more about it.
>>
>>> Also, when other
>>> people have taken time to explain an large decision because you are too lazy
>>> to invest the time doesn't really help your case).
>>
>> Um, I'm too lazy? I've read everything that's been written on pkg to
>> date. Have you? 90% of it is "how to" type stuff that doesn't address
>> what we need. The other 10% is so vague and general as to be useless as
>> a project plan.
>
> Have you watched the BSDCan presentation video yet? It is very
> compelling and exciting.
>
>>
>> You're an experienced project manager John. If someone who worked for
>> you came to you with a plan this vague ("modern" foo, "decent" bar), for
>> a critical system, how would you respond? (And yes, I realize that no
>> one around here works for me, that isn't my point at all.)
>>
>>> In terms of the first feature (binary upgrades), the truth is that if you have
>>> more than 5 machines to manage, our current pkg tools completely suck.  There
>>> is no automated upgrade mechanism.  If you want one you have to write your own
>>> set of infrastructure to do the right collection of pkg_delete/pkg_adds.
>>> Certainly there is no support in the current package tools for doing batch
>>> upgrades (i.e. upgrading from one completely package set to another).  pkgng
>>> adds that feature, and I find it a must for supporting large installations of
>>> machines that need automated management.
>>
>> And as I wrote previously, I've been there and done that, so yes, I'm
>> interested in the feature. But I'd like to know more about the plans for
>> it so that those of us who *do* have experience in this topic can share
>> that, and we can avoid having to reinvent the wheel. Or worse, putting
>> out something half-assed that uses up a lot of developer cycles and
>> doesn't get the job done.
>
> So get involved! Come help. Contribute.
>

And PLEASE get that portmaster patch integrated.

Chris
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

Mark Felder-4
In reply to this post by Bryan Drewery
On Fri, 13 Jul 2012 09:52:24 -0500, Bryan Drewery <[hidden email]> wrote:

>
> This explains how you can setup your own repository and build your own
> packages with poudriere+pkgng:


Yes, and it's fantastic. I'm currently using it to build updates for my  
low powered laptop at home and the package database fetch and "what needs  
to be upgraded" process is faster than any other package management system  
I've ever seen. Pkgng is a fantastic project.
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: [HEADSUP & CFT] pkg 1.0rc1 and schedule

John Baldwin
In reply to this post by dougb
On Friday, July 13, 2012 11:36:11 am Doug Barton wrote:
> Also, please keep in mind that I was criticized for *not* speaking up
> about the OPTIONS changes, now I'm being criticized *for* speaking up
> prior to pkg going live. In spite of the fact that I'm doing my best to
> (repeatedly) be clear that I'm not against the project, I just want to
> know more about it.

To clarify, you are not being criticized for speaking up, you are being
criticized for the way in which you are speaking up (an accusatory tone) and
for blowing off a pointer to a talk that would perhaps answer some of your
questions.

> > Also, when other
> > people have taken time to explain an large decision because you are too lazy
> > to invest the time doesn't really help your case).
>
> Um, I'm too lazy? I've read everything that's been written on pkg to
> date. Have you? 90% of it is "how to" type stuff that doesn't address
> what we need. The other 10% is so vague and general as to be useless as
> a project plan.

Hmm, that is not my distinct impression.  However, I do have the advantage of
having been part of several in-person meetings and discussions (for example,
the ports working group at the developer summit for BSDCan where a lot of
discussion and planning took place about the future of packages).

> You're an experienced project manager John. If someone who worked for
> you came to you with a plan this vague ("modern" foo, "decent" bar), for
> a critical system, how would you respond? (And yes, I realize that no
> one around here works for me, that isn't my point at all.)

My understanding of this plan is far less vague.  In practice, pkgng hasn't
really been happening under a rock.  There have been multiple announcements
and calls for testing and I know that many folks are testing it and working
with it.  Large projects such as this can be a bit bumpy in FreeBSD land, and
I expect that there will be things that crop up that have to be fixed as a
result of wider testing.  (For example, I agree with you that the nvidia driver
packages have to work correctly as that is a non-starter for me as well).
However, I am confident that pkgng and the new packages model is aiming at the
right target based on my own interactions with Erwin, Baptiste, and others,
and I think we need to push this forward and gain wider testing to make
progress, even if there are bumps in the road.

> > In terms of the first feature (binary upgrades), the truth is that if you have
> > more than 5 machines to manage, our current pkg tools completely suck.  There
> > is no automated upgrade mechanism.  If you want one you have to write your own
> > set of infrastructure to do the right collection of pkg_delete/pkg_adds.  
> > Certainly there is no support in the current package tools for doing batch
> > upgrades (i.e. upgrading from one completely package set to another).  pkgng
> > adds that feature, and I find it a must for supporting large installations of
> > machines that need automated management.
>
> And as I wrote previously, I've been there and done that, so yes, I'm
> interested in the feature. But I'd like to know more about the plans for
> it so that those of us who *do* have experience in this topic can share
> that, and we can avoid having to reinvent the wheel. Or worse, putting
> out something half-assed that uses up a lot of developer cycles and
> doesn't get the job done.

Well, what I can tell you is that many of us who do have experience with that
model have been discussing this in various fora, initially in e-mails, IRC
discussions, informal discussions during the "hallway track" at conferences,
etc.  To build a broader consensus, portmgr@ has been holding larger, more
formal discussions in the form of devsummit working groups, presentations at
conferences, etc.  I personally have been petitioning anyone's ear I could
bend for package sets for example.

I realize, btw, that not all of those discussions have occurred on public
mailing lists.  The fact is, there is a tradeoff between informal
communication (such as in-person commucation) and mails to a mailing list.
In-person communication especially offers far higher bandwidth and can be far
more effective for reaching consensus and working through alternatives, but
it has a more limited audience.  Being a volunteer project distributed all
over the globe, we are somewhat stuck with that tradeoff.  We attempt to
mitigate that tradeoff somewhat by making more of these informal discussions
more formal (e.g. adding working groups at the devsummit which include wiki
pages with summaries of the agenda and slide decks used to present the wg
summary to the full complement of attendees so there is at least some
information availble for folks who were not able to attend).  However, it
does mean that just because you were not personally involved in a discussion
or did not see a long and tedious thread, you should not assume that no
discussion has taken place at all.

Back to my original e-mail: FreeBSD is a big project.  I try to keep a pulse
on as much of it as I can (mostly by reading/skimming a _lot_ of e-mail each
day), but even with all that there is a lot going on that I don't know the
intimate details of.  Instead, I choose to trust my fellow developers to
best manage the areas over which they have expertise and detailed knowledge
until given strong evidence to assume otherwise.  My humble suggestion to you
would be to adopt a similar strategy.

--
John Baldwin
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "[hidden email]"
12
Loading...