|
Hi,
On behalf of the pkgng team I'm really pleased to announce pkg 1.0 RC1 (aka pkgng) Only bug fixes will be accepted in the RC phase. What is pkg ----------- pkg is a new package manager for FreeBSD. It is designed as a replacement for the pkg_* tools, and as a full featured binary package manager. It provides a library that does all the work, and a frontend to be used by users The ports tree is already able to transparently switch to pkgng by default by adding WITH_PKGNG=yes to your make.conf It provides a pkg2ng tool to help converting from an old installation to a new one. Test repositories are available on http://pkgbeta.freebsd.org/ (I try to update them as fast as I can) It will live forever in the ports tree (with a binary bootstrap in 9 and 10) Why pkg? -------- pkg_* tools have become hardly maintainable over the time, it lacks lots of features most of people are expecting from a package manager: - binary upgrade - ability to search information about remote packages - real reverse dependency tracking - tracking leaves - many more. Third party tools ----------------- Tools supporting natively pkgng - ports-mgmt/portupgrade-devel (soon the main portupgrade will support) - ports-mgmt/pkg_cutleaves - ports-mgmt/poudriere - ports-mgmt/portdowngrade - ports-mgmt/tinderbox-devel (support can be improved) Tools supporting pkgng via a patch (I hope it will be reviewed/integrated soon) - ports-mgmt/portmaster (https://github.com/pkgng/pkgng/blob/master/ports/patch-portmaster-pkgng) Tools being worked on (or I heard people are interested) : - salt support (in version 0.10) http://salt.readthedocs.org/en/v0.10.0/ref/modules/all/salt.modules.freebsdpkg.html - cfengine support - puppet support: (https://github.com/xaque208/puppet-pkgng) - ruby bindings: (https://github.com/baloo/libpkg-ruby/) - PackageKit Links ----- - http://wiki.freebsd.org/PkgPrimer - http://wiki.freebsd.org/pkgng Please report bugs in the github issue tracker: - http://github.com/pkgng/pkgng Schedule -------- The plan is to switch the ports tree to pkgng on CURRENT by default on July 25th No dates are planned yet for other branches. Note that there will be a NO_PKGNG knob for some time (undefined yet) for people not will to switch on July 25th Please also note that some ports won't work with pkgng right now, because pkgng is more strict than pkg_install on purpose. The major one is: nvidia drivers, because pkgng does not allow to overwrite a file owned by another package, and we will not accept any hacks for that in pkgng. Road to next version -------------------- The road to the next version is already open and lots of work will happen, list of ideas: - remote repositories will be able to display update messages - optionnal remote files repository to be able to search which packages to install if you want a known binary - real solver, - better support for multi repository - provides/requires support - stabilisation of the library API - reduce as much as possible scripting in packages to allow cross installation - many more :D regards, Bapt |
|
On Thu, Jul 12, 2012 at 12:01 PM, Baptiste Daroussin <[hidden email]> wrote:
> Third party tools > ----------------- > > Tools supporting natively pkgng > - ports-mgmt/portupgrade-devel (soon the main portupgrade will support) > - ports-mgmt/pkg_cutleaves > - ports-mgmt/poudriere > - ports-mgmt/portdowngrade > - ports-mgmt/tinderbox-devel (support can be improved) Also: - ports-mgmt/portbuilder. -- Alberto Villa, FreeBSD committer <[hidden email]> http://people.FreeBSD.org/~avilla _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
In reply to this post by Baptiste Daroussin-2
On Thu, Jul 12, 2012 at 1:01 PM, Baptiste Daroussin <[hidden email]> wrote:
> Tools being worked on (or I heard people are interested) : > - salt support (in version 0.10) http://salt.readthedocs.org/en/v0.10.0/ref/modules/all/salt.modules.freebsdpkg.html > - cfengine support And here's a link to the Cfengine 3 + pkgng documentation :) - http://unix-heaven.org/cfengine3-freebsd-pkgng Regards, Marin -- Marin Atanasov Nikolov dnaeon AT gmail DOT com daemon AT unix-heaven DOT org http://www.unix-heaven.org/ _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
In reply to this post by Baptiste Daroussin-2
I do not mean this e-mail to be in any way critical. I was told after
the new OPTIONS framework discussion that I should have asked questions before the change, so I'm asking these questions now; in a genuine attempt to get information. On 07/12/2012 03:01 AM, Baptiste Daroussin wrote: In the time that you have been working on this project I have asked numerous times for you(pl.) to answer the following questions: 1. What are the goals for pkg? 2. Why can't the existing tools fulfill those goals? 3. How does pkg fulfill them? You've put some of this in the various places where pkg is documented, but I don't see any thorough treatment of these questions. You have some of it below, which I'd like to see expanded on if you would be so kind. :) > Why pkg? > -------- > pkg_* tools have become hardly maintainable over the time, I agree on this point, but the right solution (as some of us have been saying for years) is to move the pkg_* tools into the ports tree. You are correctly handling that by keeping pkg in the ports tree, I'm simply pointing out that this isn't a reason we need to switch to pkg. > it lacks lots of features most of people are expecting from a package manager: > - binary upgrade I'm not sure what you mean by this. We have the ability to create binary packages now. > - ability to search information about remote packages This is a good feature, certainly. However there is no reason we can't create a tool to do this, or add the functionality to an existing tool. > - real reverse dependency tracking > - tracking leaves Can you expand on what these 2 mean? What I'm looking for is compelling motivation to make this overwhelming change to the ports infrastructure. > Schedule > -------- > > The plan is to switch the ports tree to pkgng on CURRENT by default on July 25th > No dates are planned yet for other branches. Can you describe how this is going to be done? I assume with an OSVERSION knob in bsd.port.mk? > Note that there will be a NO_PKGNG knob for some time (undefined yet) for people > not will to switch on July 25th > > Please also note that some ports won't work with pkgng right now, because pkgng > is more strict than pkg_install on purpose. > The major one is: nvidia drivers, because pkgng does not allow to overwrite a file > owned by another package, and we will not accept any hacks for that in pkgng. IMO it would be a very large mistake to switch the default in any branch until the problem with the nvidia drivers is sorted out. We have a lot of users (myself included) who use this port, and by switching the default there's going to be 1 of 2 outcomes for those users. Either they will opt-out, which means you won't get the level of testing you're looking for; or you'll break their existing ports installation. Neither outcome is desirable. Doug _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
On Thu, Jul 12, 2012 at 11:48 AM, Doug Barton <[hidden email]> wrote:
> 1. What are the goals for pkg? > 2. Why can't the existing tools fulfill those goals? > 3. How does pkg fulfill them? > > Hi, You might want to view Baptiste's pkgng presentation at BSDCan: http://www.youtube.com/watch?v=4Hxq7AHZ27I For me, that presentation clarified the goals and motivation of the pkgng project. After viewing that presentation, for me it put into perspective some of the other pkgng information at http://wiki.freebsd.org/pkgng/ . -- Craig Rodrigues [hidden email] _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
On 07/12/2012 02:11 PM, Craig Rodrigues wrote:
> You might want to view Baptiste's pkgng presentation at BSDCan: > > http://www.youtube.com/watch?v=4Hxq7AHZ27I Sure, the next time I have an hour to spare. I don't think what I'm asking for is unreasonable. One could even conclude that answering those 3 questions should have been a prerequisite for starting down this road in the first place. Doug _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
In reply to this post by dougb
On Thu, Jul 12, 2012 at 11:48:41AM -0700, Doug Barton wrote:
> I do not mean this e-mail to be in any way critical. I was told after > the new OPTIONS framework discussion that I should have asked questions > before the change, so I'm asking these questions now; in a genuine > attempt to get information. > > On 07/12/2012 03:01 AM, Baptiste Daroussin wrote: > > In the time that you have been working on this project I have asked > numerous times for you(pl.) to answer the following questions: > > 1. What are the goals for pkg? Anyway the goal is to have a decent package manager, providing modern features: repositories, decent dependency tracking, decent reverse dependency tracking, managing upgrade correctly (I'll explain this more later), provide a decent library for third party tools (desktop integration via PackageKit for example) Providing easy package management for enterprise (who never got problems managing packages on a large set of freebsd servers, and how complicated it is on FreeBSD to have automated reliable puppet,salt,chef,cfengine like tools) One of the proof of this problem is how fast people integrated pkgng in those tools. > 2. Why can't the existing tools fulfill those goals? The existing tools can't fulfill those goals, because they are hardly maintainable, the code hasn't change much since when they were written, lot of people have tried over the year to improve them, but all of them gave up. The design of the tools, (I mean the code) is really imho not adapted to be improved, I spent a lot of time trying to work on it before starting a complete new project. For example they do not know what is a version, they do not know what are the reverse dependencies except through this ugly hack that is +REQUIRED_BY, the database is pretty fragile: who never got the package corrupted: empty @pkgdep line for example. > 3. How does pkg fulfill them? > > You've put some of this in the various places where pkg is documented, > but I don't see any thorough treatment of these questions. You have some > of it below, which I'd like to see expanded on if you would be so kind. :) It is true that, I'm not very good at documenting in general, and even more in english, hopefully, the documentation is improving a lot recently, there is the for usage: http://wiki.freebsd.org/PkgPrimer and for all other things: http://wiki.freebsd.org/pkgng Lot of native english speakers have joined the project and help with documentation, if you find someting missing, do not hesitate to had the section in the apropriate wiki page, I often have a look at them, and try to fill all the blank section to answer user questions. > > > Why pkg? > > pkg_* tools have become hardly maintainable over the time, > > I agree on this point, but the right solution (as some of us have been > saying for years) is to move the pkg_* tools into the ports tree. You > are correctly handling that by keeping pkg in the ports tree, I'm simply > pointing out that this isn't a reason we need to switch to pkg. > > > it lacks lots of features most of people are expecting from a package manager: > > - binary upgrade > > I'm not sure what you mean by this. We have the ability to create binary > packages now. portmaster (I describe this in a poudriere howto) but this is not fully binary upgrade, it is deinstalling/reinstalling a package. Binary upgrade is much more complexe than that, for example one thing you can't handle now is a package that has been splitted into lib vs runtime will break with the current way we can do it. Just as an example. Just have a look at this old video: http://www.youtube.com/watch?v=iBgcuKF8R_A (it is only 1m30) > > > - ability to search information about remote packages > > This is a good feature, certainly. However there is no reason we can't > create a tool to do this, or add the functionality to an existing tool. Have a look at what pkgng can present you as information and you will see the difference. > > > - real reverse dependency tracking > > - tracking leaves > > Can you expand on what these 2 mean? Of course. The current reverse dependency tracking in pkg_install is a hack: a +REQUIRED_BY file trying to maintain the list of packages that may depend on the said dependency, a good way to see it is a hack is to see how often the file get broken (and on portmaster you added an options to fix them so you might know :)) > > What I'm looking for is compelling motivation to make this overwhelming > change to the ports infrastructure. There is not much changes needed in the ports infrastructure. It now works ootb But there are tons of improvements pkgng will offers, like: ability to simply add new plist keyword without the need of modifying pkgng, native support for registering a package from a stagedir. > > > > Schedule > > -------- > > > > The plan is to switch the ports tree to pkgng on CURRENT by default on July 25th > > No dates are planned yet for other branches. > > Can you describe how this is going to be done? I assume with an > OSVERSION knob in bsd.port.mk? versions except if the user have defined NO_PKGNG in make.conf > > > Note that there will be a NO_PKGNG knob for some time (undefined yet) for people > > not will to switch on July 25th > > > > Please also note that some ports won't work with pkgng right now, because pkgng > > is more strict than pkg_install on purpose. > > The major one is: nvidia drivers, because pkgng does not allow to overwrite a file > > owned by another package, and we will not accept any hacks for that in pkgng. > > IMO it would be a very large mistake to switch the default in any branch > until the problem with the nvidia drivers is sorted out. We have a lot > of users (myself included) who use this port, and by switching the > default there's going to be 1 of 2 outcomes for those users. Either they > will opt-out, which means you won't get the level of testing you're > looking for; or you'll break their existing ports installation. Neither > outcome is desirable. takle the task on it even if most agreed with at least one of the method. So waiting for someone to provide a really clean way to provide nvidia driver, I'm now working on a small modification of the current way it works, that will bypass the pkgng strictness. So nvidia-driver should be fixed on pkgng quite soon (if maintainer do accept the modification :)). I hope, I have answered your question correctly? regards, Bapt |
|
In reply to this post by Baptiste Daroussin-2
Doug Barton wrote:
> What I'm looking for is compelling motivation to make this overwhelming > change to the ports infrastructure. Because the present state of the ports system is not a compelling enough reason? My arms are falling … -- Michel Talon [hidden email] |
|
In reply to this post by Baptiste Daroussin-2
On 07/12/2012 03:02 PM, Baptiste Daroussin wrote:
> On Thu, Jul 12, 2012 at 11:48:41AM -0700, Doug Barton wrote: >> I do not mean this e-mail to be in any way critical. I was told after >> the new OPTIONS framework discussion that I should have asked questions >> before the change, so I'm asking these questions now; in a genuine >> attempt to get information. >> >> On 07/12/2012 03:01 AM, Baptiste Daroussin wrote: >> >> In the time that you have been working on this project I have asked >> numerous times for you(pl.) to answer the following questions: >> >> 1. What are the goals for pkg? > > The why part of this mail should reply this question, no? Well clearly not, because if it did I wouldn't keep asking the same questions over and over again. :) > Anyway the goal is to have a decent package manager, providing modern features: > repositories, decent dependency tracking, decent reverse dependency tracking, > managing upgrade correctly (I'll explain this more later), provide a decent > library for third party tools (desktop integration via PackageKit for example) I don't know what "decent" means. I don't know what "modern features" means (beyond the buzzwords that you've included). > Providing easy package management for enterprise Having set up package management systems for enterprises before, *this* is actually a big-picture goal that I have a lot of sympathy for. But again, what's missing is *details* about here is what large enterprises need to make things work for them, here's why the existing tools don't meet those needs, and here is how pkg does meet them. > (who never got problems > managing packages on a large set of freebsd servers, and how complicated it is > on FreeBSD to have automated reliable puppet,salt,chef,cfengine like tools) > One of the proof of this problem is how fast people integrated pkgng in those > tools. This gets to the heart of my biggest fear regarding this whole project. It's new, it's shiny, and it looks like forward progress is being made. Thus, it's attracted a lot of attention, input, time, etc. Heck, it may even BE forward progress, but I don't know how to measure that because I don't know what the goals of the project are. Thus, my fear is that without *details* about what the project is, and what it's trying to accomplish, we're going to put an exponentially larger volume of work into the transition and end up no closer to the goal of having a mature package management system. And just to be clear, I am *not* saying that "pkg sucks" or that it's bad, or wrong, or anything else. I'm saying that I don't know how to evaluate it, because you haven't given us a criteria by which to measure it. So what's the problem? We *desperately* need a better system for ports and packages. We only have so many person-hours we can devote to making that happen. If we spend all of them on pkg, and it ends up not helping us enough, we've burnt out our volunteers for no good reason. >> 2. Why can't the existing tools fulfill those goals? > > The existing tools can't fulfill those goals, because they are hardly > maintainable, the code hasn't change much since when they were written, lot of > people have tried over the year to improve them, but all of them gave up. The > design of the tools, (I mean the code) is really imho not adapted to be > improved, I spent a lot of time trying to work on it before starting a complete > new project. This paragraph really frightens me. > For example they do not know what is a version, they do not know what are the > reverse dependencies except through this ugly hack that is +REQUIRED_BY, the > database is pretty fragile: who never got the package corrupted: empty @pkgdep > line for example. So these 2 are a lot closer to what I'd like to see ... *details* about what isn't working now. I would tend to disagree with you that +REQUIRED_BY is an ugly hack, it's no uglier than any of the other text file based dependency tracking we have. But thank you for giving us more information. So taking your last example, how does pkg handle the situation where the user wants to forcibly delete a package that is depended on by another package? >> 3. How does pkg fulfill them? >> >> You've put some of this in the various places where pkg is documented, >> but I don't see any thorough treatment of these questions. You have some >> of it below, which I'd like to see expanded on if you would be so kind. :) > > It is true that, I'm not very good at documenting in general, and even more in > english, hopefully, the documentation is improving a lot recently, there is the > for usage: > http://wiki.freebsd.org/PkgPrimer > and for all other things: > http://wiki.freebsd.org/pkgng > > Lot of native english speakers have joined the project and help with > documentation, if you find someting missing, do not hesitate to had the section > in the apropriate wiki page, I often have a look at them, and try to fill all > the blank section to answer user questions. I'm not looking for "how to." I've explained to you numerous times that I'm looking for a project description. And your English is fine, I understand what you write perfectly, the problem is that you are not willing to sit down and write out, in detail, what the project's goals are. So I'm left to conclude that either A) you don't know because you've never actually sat down and thought them through, or B) you don't think you should have to explain yourself. I find both answers disturbing. Of course there is always answer C) you think I'm a jerk and can't be bothered to answer my questions. If that's the case, fair enough. Just tell me that so I can stop trying to make sense of it. >>> Why pkg? >>> pkg_* tools have become hardly maintainable over the time, >> >> I agree on this point, but the right solution (as some of us have been >> saying for years) is to move the pkg_* tools into the ports tree. You >> are correctly handling that by keeping pkg in the ports tree, I'm simply >> pointing out that this isn't a reason we need to switch to pkg. >> >>> it lacks lots of features most of people are expecting from a package manager: >>> - binary upgrade >> >> I'm not sure what you mean by this. We have the ability to create binary >> packages now. > > No we haven't :), I know we can mimic a binary upgrade using for example > portmaster (I describe this in a poudriere howto) but this is not fully binary > upgrade, it is deinstalling/reinstalling a package. Binary upgrade is much more > complexe than that, for example one thing you can't handle now is a package that > has been splitted into lib vs runtime will break with the current way we can do > it. So what you're saying is that you want to do an in-place binary upgrade of an already installed package? If so, that's an interesting goal, and I'd like to hear more about it. Including but not limited to, what are the advantages and disadvantages to doing that, vs. deinstall->install of the "old" kind of packages? How do you handle the case where the new version has less files than the old? What happens if the files in the installed version have become modified/corrupted somehow? >>> - ability to search information about remote packages >> >> This is a good feature, certainly. However there is no reason we can't >> create a tool to do this, or add the functionality to an existing tool. > > Have a look at what pkgng can present you as information and you will see the > difference. Sorry, this response doesn't address what I wrote. You're saying that you want this feature, so you created a tool that does it. That doesn't change my point that moving to pkg isn't necessary to accomplish this. >>> - real reverse dependency tracking >>> - tracking leaves >> >> Can you expand on what these 2 mean? > > Of course. The current reverse dependency tracking in pkg_install is a hack: a > +REQUIRED_BY file trying to maintain the list of packages that may depend on the > said dependency, a good way to see it is a hack is to see how often the file get > broken (and on portmaster you added an options to fix them so you might know :)) Actually if you pkg_delete stuff in the right order it never gets broken. But, users don't do that, so you're correct that one of the features of portmaster is that it keeps +CONTENTS and +REQUIRED_BY up to date when dependent packages are updated. But the same logic I use in portmaster could easily be brought into the ports framework itself, if that was something that people wanted. >> What I'm looking for is compelling motivation to make this overwhelming >> change to the ports infrastructure. > > There is not much changes needed in the ports infrastructure. It now works ootb > But there are tons of improvements pkgng will offers, like: ability to simply > add new plist keyword without the need of modifying pkgng, That's a feature that could be had just as easily by moving pkg_* to the ports tree. > native support for registering a package from a stagedir. That's another set of changes that it would be nice to see a thorough project plan for. :) >> IMO it would be a very large mistake to switch the default in any branch >> until the problem with the nvidia drivers is sorted out. We have a lot >> of users (myself included) who use this port, and by switching the >> default there's going to be 1 of 2 outcomes for those users. Either they >> will opt-out, which means you won't get the level of testing you're >> looking for; or you'll break their existing ports installation. Neither >> outcome is desirable. > > I proposed 3 differents way to fix the nvidia driver problem, no one really > takle the task on it even if most agreed with at least one of the method. > > So waiting for someone to provide a really clean way to provide nvidia driver, > I'm now working on a small modification of the current way it works, that will > bypass the pkgng strictness. > > So nvidia-driver should be fixed on pkgng quite soon (if maintainer do accept > the modification :)). As long as the solution arrives in the ports tree *before* the default is switched, it should be fine. Doug _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
Am 13.07.12 01:10, schrieb Doug Barton:
> On 07/12/2012 03:02 PM, Baptiste Daroussin wrote: >> On Thu, Jul 12, 2012 at 11:48:41AM -0700, Doug Barton wrote: >>> I do not mean this e-mail to be in any way critical. I was told after >>> the new OPTIONS framework discussion that I should have asked questions >>> before the change, so I'm asking these questions now; in a genuine >>> attempt to get information. >>> >>> On 07/12/2012 03:01 AM, Baptiste Daroussin wrote: >>> >>> In the time that you have been working on this project I have asked >>> numerous times for you(pl.) to answer the following questions: >>> >>> 1. What are the goals for pkg? >> The why part of this mail should reply this question, no? > Well clearly not, because if it did I wouldn't keep asking the same > questions over and over again. :) > >> Anyway the goal is to have a decent package manager, providing modern features: >> repositories, decent dependency tracking, decent reverse dependency tracking, >> managing upgrade correctly (I'll explain this more later), provide a decent >> library for third party tools (desktop integration via PackageKit for example) > I don't know what "decent" means. I don't know what "modern features" > means (beyond the buzzwords that you've included). > >> Providing easy package management for enterprise > Having set up package management systems for enterprises before, *this* > is actually a big-picture goal that I have a lot of sympathy for. But > again, what's missing is *details* about here is what large enterprises > need to make things work for them, here's why the existing tools don't > meet those needs, and here is how pkg does meet them. > >> (who never got problems >> managing packages on a large set of freebsd servers, and how complicated it is >> on FreeBSD to have automated reliable puppet,salt,chef,cfengine like tools) >> One of the proof of this problem is how fast people integrated pkgng in those >> tools. > This gets to the heart of my biggest fear regarding this whole project. > It's new, it's shiny, and it looks like forward progress is being made. > Thus, it's attracted a lot of attention, input, time, etc. Heck, it may > even BE forward progress, but I don't know how to measure that because I > don't know what the goals of the project are. Thus, my fear is that > without *details* about what the project is, and what it's trying to > accomplish, we're going to put an exponentially larger volume of work > into the transition and end up no closer to the goal of having a mature > package management system. > > And just to be clear, I am *not* saying that "pkg sucks" or that it's > bad, or wrong, or anything else. I'm saying that I don't know how to > evaluate it, because you haven't given us a criteria by which to measure > it. > > So what's the problem? We *desperately* need a better system for ports > and packages. We only have so many person-hours we can devote to making > that happen. If we spend all of them on pkg, and it ends up not helping > us enough, we've burnt out our volunteers for no good reason. I am using pkg_* tools since '94 and I am using portmaster for ports/pkg maintainance for years: pkg_* tools are a pain in the ass in the view of an administrator. I use it only and partly on fresh installs and doing further security auditing with portaudit and upgrading with portmaster - most time upgrading from source. But only, because its simply not possible the same way with the pkg_* tools. Because I manage dozens of installation across Europe, buildind and updating from ports will be more and more time consuming. portmaster is really a great tool to take control of this lack of features in pkg_* tools , but I am running out of time more and more. I was also a bit concerned and reserved to pkgng. But I am also in contact with some local FreeBSD ports committers and one of them (decke) told me some stories about pkgng and poudriere. I saw the talk from Beat Gätzi (beat) at EU BSD Day 2012 about pkgng and was I see was really nice and made me courious. So I tried to setup a small build environment with poudriere and pkgng to evaluate an substitution for my traditional pkg/port security upgrading with portmaster. Finally I think, I can complete replace portmaster with pkgng, poudriere and an self build and maintained pkg repository. This will save a huge amount of time in future and allow to roll out security updates for packages really fast and easy. So pkgng is not designed as a replacement for portmaster, but now it allows me to work without it on most of my installations. I know almost any of the "Linux Enterprise" package management features, pkg_* tools a far away from this kind of functionality, even with the support of the great portmaster tool. Bug pkgng improves much more. Its a very complex problematic. Yes documentation is not so good as it could be. But I saw the talks from beat in live, saw the screencasts from bapt on Youtube and finally I tried it on my own. It was necessary to try it out and see it, feel it, smell and taste it. I think its good work from admin and enterprise point of view. Doug has written portmaster and integrated package handeling, which I only use rarely on my old desktop. Why was this handling integrated in portmaster and not in pkg_* tools? I know its something unkown and new and I had also my problems with the idea of pkgng for the first time (why reinventing the wheel...) - but I tried it out and it works really really well. My opinion after 18 years of FreeBSD administration. Regards, Michael -- Mit freundlichen Grüßen Ing. Michael Ranner GSM: +43 676 4155044 Mail: [hidden email] WWW: http://www.azedo.at/ _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
What I want to know is this new pkg system going to remove the
requirement of having the complete ports tree on my system? What I am looking for in an port system, is to install a port and any files needed for the parent port and its dependents to automatically be downloaded. So in the end my system ports tree only contain the files used to install the ports I use and their dependents. _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
In reply to this post by dougb
On Thursday, July 12, 2012 5:16:41 pm Doug Barton wrote:
> On 07/12/2012 02:11 PM, Craig Rodrigues wrote: > > You might want to view Baptiste's pkgng presentation at BSDCan: > > > > http://www.youtube.com/watch?v=4Hxq7AHZ27I > > Sure, the next time I have an hour to spare. > > I don't think what I'm asking for is unreasonable. One could even > conclude that answering those 3 questions should have been a > prerequisite for starting down this road in the first place. One could also assume that other people in the Project aren't morons and do actually put thought into the things they do for starters (you do realize, btw, that that is how you come across, that even though you don't intend that, constantly questioning decisions made by other people in an accusatory fashion gives that impression? At least adjust your wording to start off with the assumption that other people _have_ put thought into things. Also, when other people have taken time to explain an large decision because you are too lazy to invest the time doesn't really help your case). In terms of the first feature (binary upgrades), the truth is that if you have more than 5 machines to manage, our current pkg tools completely suck. There is no automated upgrade mechanism. If you want one you have to write your own set of infrastructure to do the right collection of pkg_delete/pkg_adds. Certainly there is no support in the current package tools for doing batch upgrades (i.e. upgrading from one completely package set to another). pkgng adds that feature, and I find it a must for supporting large installations of machines that need automated management. -- John Baldwin _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
In reply to this post by Joe-2
Am 13.07.12 14:14, schrieb Fbsd8:
> What I want to know is this new pkg system going to remove the > requirement of having the complete ports tree on my system? > > What I am looking for in an port system, is to install a port and any > files needed for the parent port and its dependents to automatically > be downloaded. So in the end my system ports tree only contain the > files used to install the ports I use and their dependents. > The new pkg system is not a replacement for the ports tree. If you still like to compile software from ports, you will need the ports tree. But you can install a precompiled package with the new pkg system and it automatically downloads all necessary binary packages it depends on. So probably you dont need the ports any more. Regards Michael -- Mit freundlichen Grüßen Ing. Michael Ranner GSM: +43 676 4155044 Mail: [hidden email] WWW: http://www.azedo.at/ _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
In reply to this post by Joe-2
On 13/07/2012 13:14, Fbsd8 wrote:
> What I want to know is this new pkg system going to remove the > requirement of having the complete ports tree on my system? > > What I am looking for in an port system, is to install a port and any > files needed for the parent port and its dependents to automatically be > downloaded. So in the end my system ports tree only contain the files > used to install the ports I use and their dependents. Yes, you will be able to use pkgng without having a full ports tree installed on your system. You can pretty much do that already, although the central pkgng package repository is still only in beta. The only bit of pkgng that still requires the ports to be installed is 'pkg version' which is not critical for maintaining your system. Modifying 'pkg version' so that it doesn't need to use the ports tree is an open issue on github: https://github.com/pkgng/pkgng/issues/195 Patches / pull requests gratefully received. Cheers, Matthew -- Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard Flat 3 PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate JID: [hidden email] Kent, CT11 9PW |
|
In reply to this post by Michael Ranner-2
On 7/13/2012 3:16 AM, Michael Ranner wrote:
> I was also a bit concerned and reserved to pkgng. But I am also in > contact with some local FreeBSD ports committers and one of them (decke) > told me some stories about pkgng and poudriere. I saw the talk from Beat > Gätzi (beat) at EU BSD Day 2012 about pkgng and was I see was really > nice and made me courious. So I tried to setup a small build environment > with poudriere and pkgng to evaluate an substitution for my traditional > pkg/port security upgrading with portmaster. This explains how you can setup your own repository and build your own packages with poudriere+pkgng: http://blog.etoilebsd.net/post/Home_made_pkgng_repo -- Regards, Bryan Drewery bdrewery@freenode/EFNet |
|
In reply to this post by John Baldwin
On 07/13/2012 05:26 AM, John Baldwin wrote:
> On Thursday, July 12, 2012 5:16:41 pm Doug Barton wrote: >> On 07/12/2012 02:11 PM, Craig Rodrigues wrote: >>> You might want to view Baptiste's pkgng presentation at BSDCan: >>> >>> http://www.youtube.com/watch?v=4Hxq7AHZ27I >> >> Sure, the next time I have an hour to spare. >> >> I don't think what I'm asking for is unreasonable. One could even >> conclude that answering those 3 questions should have been a >> prerequisite for starting down this road in the first place. > > One could also assume that other people in the Project aren't morons and do > actually put thought into the things they do for starters I certainly *want* to believe that. But considering the giant mess that portmgr + Baptiste made of the changes to the OPTIONS framework, that only touches a fraction of the ports, my willingness to have faith in "them" to do it right is near zero. Not to mention that I've been asking for a project plan for pkg since long before it even hit the ports tree in beta. What I'm asking for should have been done already considering that this change will affect *every* port, and *every* user. So either it hasn't actually been done, or the PTB are refusing to provide it. Also, please keep in mind that I was criticized for *not* speaking up about the OPTIONS changes, now I'm being criticized *for* speaking up prior to pkg going live. In spite of the fact that I'm doing my best to (repeatedly) be clear that I'm not against the project, I just want to know more about it. > Also, when other > people have taken time to explain an large decision because you are too lazy > to invest the time doesn't really help your case). Um, I'm too lazy? I've read everything that's been written on pkg to date. Have you? 90% of it is "how to" type stuff that doesn't address what we need. The other 10% is so vague and general as to be useless as a project plan. You're an experienced project manager John. If someone who worked for you came to you with a plan this vague ("modern" foo, "decent" bar), for a critical system, how would you respond? (And yes, I realize that no one around here works for me, that isn't my point at all.) > In terms of the first feature (binary upgrades), the truth is that if you have > more than 5 machines to manage, our current pkg tools completely suck. There > is no automated upgrade mechanism. If you want one you have to write your own > set of infrastructure to do the right collection of pkg_delete/pkg_adds. > Certainly there is no support in the current package tools for doing batch > upgrades (i.e. upgrading from one completely package set to another). pkgng > adds that feature, and I find it a must for supporting large installations of > machines that need automated management. And as I wrote previously, I've been there and done that, so yes, I'm interested in the feature. But I'd like to know more about the plans for it so that those of us who *do* have experience in this topic can share that, and we can avoid having to reinvent the wheel. Or worse, putting out something half-assed that uses up a lot of developer cycles and doesn't get the job done. Doug _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
On 7/13/2012 10:36 AM, Doug Barton wrote:
> On 07/13/2012 05:26 AM, John Baldwin wrote: >> On Thursday, July 12, 2012 5:16:41 pm Doug Barton wrote: >>> On 07/12/2012 02:11 PM, Craig Rodrigues wrote: >>>> You might want to view Baptiste's pkgng presentation at BSDCan: >>>> >>>> http://www.youtube.com/watch?v=4Hxq7AHZ27I >>> >>> Sure, the next time I have an hour to spare. >>> >>> I don't think what I'm asking for is unreasonable. One could even >>> conclude that answering those 3 questions should have been a >>> prerequisite for starting down this road in the first place. >> >> One could also assume that other people in the Project aren't morons and do >> actually put thought into the things they do for starters > > I certainly *want* to believe that. But considering the giant mess that > portmgr + Baptiste made of the changes to the OPTIONS framework, that > only touches a fraction of the ports, my willingness to have faith in > "them" to do it right is near zero. There's a *major* difference in the testing effort and community involvement in these 2 projects. OPTIONSng had maybe a handful of testers over a shorter period of time. PKGNG has had 40+ contributors and has been in development since 2010. It's been presented and discussed at multiple conferences and dev summits. Many people have been building their own packages with PKGNG for months now, greatly raising the testing coverage on the ports tree. > > Not to mention that I've been asking for a project plan for pkg since > long before it even hit the ports tree in beta. What I'm asking for > should have been done already considering that this change will affect > *every* port, and *every* user. So either it hasn't actually been done, > or the PTB are refusing to provide it. http://lists.freebsd.org/pipermail/freebsd-current/2012-January/031533.html I find bapt's research in that post to be evident that a lot of thought and time did go into planning this. > > Also, please keep in mind that I was criticized for *not* speaking up > about the OPTIONS changes, now I'm being criticized *for* speaking up > prior to pkg going live. In spite of the fact that I'm doing my best to > (repeatedly) be clear that I'm not against the project, I just want to > know more about it. > >> Also, when other >> people have taken time to explain an large decision because you are too lazy >> to invest the time doesn't really help your case). > > Um, I'm too lazy? I've read everything that's been written on pkg to > date. Have you? 90% of it is "how to" type stuff that doesn't address > what we need. The other 10% is so vague and general as to be useless as > a project plan. Have you watched the BSDCan presentation video yet? It is very compelling and exciting. > > You're an experienced project manager John. If someone who worked for > you came to you with a plan this vague ("modern" foo, "decent" bar), for > a critical system, how would you respond? (And yes, I realize that no > one around here works for me, that isn't my point at all.) > >> In terms of the first feature (binary upgrades), the truth is that if you have >> more than 5 machines to manage, our current pkg tools completely suck. There >> is no automated upgrade mechanism. If you want one you have to write your own >> set of infrastructure to do the right collection of pkg_delete/pkg_adds. >> Certainly there is no support in the current package tools for doing batch >> upgrades (i.e. upgrading from one completely package set to another). pkgng >> adds that feature, and I find it a must for supporting large installations of >> machines that need automated management. > > And as I wrote previously, I've been there and done that, so yes, I'm > interested in the feature. But I'd like to know more about the plans for > it so that those of us who *do* have experience in this topic can share > that, and we can avoid having to reinvent the wheel. Or worse, putting > out something half-assed that uses up a lot of developer cycles and > doesn't get the job done. So get involved! Come help. Contribute. > > Doug -- Regards, Bryan Drewery bdrewery@freenode/EFNet _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
On 13 July 2012 17:02, Bryan Drewery <[hidden email]> wrote:
> On 7/13/2012 10:36 AM, Doug Barton wrote: >> On 07/13/2012 05:26 AM, John Baldwin wrote: >>> On Thursday, July 12, 2012 5:16:41 pm Doug Barton wrote: >>>> On 07/12/2012 02:11 PM, Craig Rodrigues wrote: >>>>> You might want to view Baptiste's pkgng presentation at BSDCan: >>>>> >>>>> http://www.youtube.com/watch?v=4Hxq7AHZ27I >>>> >>>> Sure, the next time I have an hour to spare. >>>> >>>> I don't think what I'm asking for is unreasonable. One could even >>>> conclude that answering those 3 questions should have been a >>>> prerequisite for starting down this road in the first place. >>> >>> One could also assume that other people in the Project aren't morons and do >>> actually put thought into the things they do for starters >> >> I certainly *want* to believe that. But considering the giant mess that >> portmgr + Baptiste made of the changes to the OPTIONS framework, that >> only touches a fraction of the ports, my willingness to have faith in >> "them" to do it right is near zero. > > There's a *major* difference in the testing effort and community > involvement in these 2 projects. OPTIONSng had maybe a handful of > testers over a shorter period of time. > > PKGNG has had 40+ contributors and has been in development since 2010. > It's been presented and discussed at multiple conferences and dev > summits. Many people have been building their own packages with PKGNG > for months now, greatly raising the testing coverage on the ports tree. > >> >> Not to mention that I've been asking for a project plan for pkg since >> long before it even hit the ports tree in beta. What I'm asking for >> should have been done already considering that this change will affect >> *every* port, and *every* user. So either it hasn't actually been done, >> or the PTB are refusing to provide it. > > http://lists.freebsd.org/pipermail/freebsd-current/2012-January/031533.html > > I find bapt's research in that post to be evident that a lot of thought > and time did go into planning this. > >> >> Also, please keep in mind that I was criticized for *not* speaking up >> about the OPTIONS changes, now I'm being criticized *for* speaking up >> prior to pkg going live. In spite of the fact that I'm doing my best to >> (repeatedly) be clear that I'm not against the project, I just want to >> know more about it. >> >>> Also, when other >>> people have taken time to explain an large decision because you are too lazy >>> to invest the time doesn't really help your case). >> >> Um, I'm too lazy? I've read everything that's been written on pkg to >> date. Have you? 90% of it is "how to" type stuff that doesn't address >> what we need. The other 10% is so vague and general as to be useless as >> a project plan. > > Have you watched the BSDCan presentation video yet? It is very > compelling and exciting. > >> >> You're an experienced project manager John. If someone who worked for >> you came to you with a plan this vague ("modern" foo, "decent" bar), for >> a critical system, how would you respond? (And yes, I realize that no >> one around here works for me, that isn't my point at all.) >> >>> In terms of the first feature (binary upgrades), the truth is that if you have >>> more than 5 machines to manage, our current pkg tools completely suck. There >>> is no automated upgrade mechanism. If you want one you have to write your own >>> set of infrastructure to do the right collection of pkg_delete/pkg_adds. >>> Certainly there is no support in the current package tools for doing batch >>> upgrades (i.e. upgrading from one completely package set to another). pkgng >>> adds that feature, and I find it a must for supporting large installations of >>> machines that need automated management. >> >> And as I wrote previously, I've been there and done that, so yes, I'm >> interested in the feature. But I'd like to know more about the plans for >> it so that those of us who *do* have experience in this topic can share >> that, and we can avoid having to reinvent the wheel. Or worse, putting >> out something half-assed that uses up a lot of developer cycles and >> doesn't get the job done. > > So get involved! Come help. Contribute. > And PLEASE get that portmaster patch integrated. Chris _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
In reply to this post by Bryan Drewery
On Fri, 13 Jul 2012 09:52:24 -0500, Bryan Drewery <[hidden email]> wrote:
> > This explains how you can setup your own repository and build your own > packages with poudriere+pkgng: Yes, and it's fantastic. I'm currently using it to build updates for my low powered laptop at home and the package database fetch and "what needs to be upgraded" process is faster than any other package management system I've ever seen. Pkgng is a fantastic project. _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
|
In reply to this post by dougb
On Friday, July 13, 2012 11:36:11 am Doug Barton wrote:
> Also, please keep in mind that I was criticized for *not* speaking up > about the OPTIONS changes, now I'm being criticized *for* speaking up > prior to pkg going live. In spite of the fact that I'm doing my best to > (repeatedly) be clear that I'm not against the project, I just want to > know more about it. To clarify, you are not being criticized for speaking up, you are being criticized for the way in which you are speaking up (an accusatory tone) and for blowing off a pointer to a talk that would perhaps answer some of your questions. > > Also, when other > > people have taken time to explain an large decision because you are too lazy > > to invest the time doesn't really help your case). > > Um, I'm too lazy? I've read everything that's been written on pkg to > date. Have you? 90% of it is "how to" type stuff that doesn't address > what we need. The other 10% is so vague and general as to be useless as > a project plan. Hmm, that is not my distinct impression. However, I do have the advantage of having been part of several in-person meetings and discussions (for example, the ports working group at the developer summit for BSDCan where a lot of discussion and planning took place about the future of packages). > You're an experienced project manager John. If someone who worked for > you came to you with a plan this vague ("modern" foo, "decent" bar), for > a critical system, how would you respond? (And yes, I realize that no > one around here works for me, that isn't my point at all.) My understanding of this plan is far less vague. In practice, pkgng hasn't really been happening under a rock. There have been multiple announcements and calls for testing and I know that many folks are testing it and working with it. Large projects such as this can be a bit bumpy in FreeBSD land, and I expect that there will be things that crop up that have to be fixed as a result of wider testing. (For example, I agree with you that the nvidia driver packages have to work correctly as that is a non-starter for me as well). However, I am confident that pkgng and the new packages model is aiming at the right target based on my own interactions with Erwin, Baptiste, and others, and I think we need to push this forward and gain wider testing to make progress, even if there are bumps in the road. > > In terms of the first feature (binary upgrades), the truth is that if you have > > more than 5 machines to manage, our current pkg tools completely suck. There > > is no automated upgrade mechanism. If you want one you have to write your own > > set of infrastructure to do the right collection of pkg_delete/pkg_adds. > > Certainly there is no support in the current package tools for doing batch > > upgrades (i.e. upgrading from one completely package set to another). pkgng > > adds that feature, and I find it a must for supporting large installations of > > machines that need automated management. > > And as I wrote previously, I've been there and done that, so yes, I'm > interested in the feature. But I'd like to know more about the plans for > it so that those of us who *do* have experience in this topic can share > that, and we can avoid having to reinvent the wheel. Or worse, putting > out something half-assed that uses up a lot of developer cycles and > doesn't get the job done. Well, what I can tell you is that many of us who do have experience with that model have been discussing this in various fora, initially in e-mails, IRC discussions, informal discussions during the "hallway track" at conferences, etc. To build a broader consensus, portmgr@ has been holding larger, more formal discussions in the form of devsummit working groups, presentations at conferences, etc. I personally have been petitioning anyone's ear I could bend for package sets for example. I realize, btw, that not all of those discussions have occurred on public mailing lists. The fact is, there is a tradeoff between informal communication (such as in-person commucation) and mails to a mailing list. In-person communication especially offers far higher bandwidth and can be far more effective for reaching consensus and working through alternatives, but it has a more limited audience. Being a volunteer project distributed all over the globe, we are somewhat stuck with that tradeoff. We attempt to mitigate that tradeoff somewhat by making more of these informal discussions more formal (e.g. adding working groups at the devsummit which include wiki pages with summaries of the agenda and slide decks used to present the wg summary to the full complement of attendees so there is at least some information availble for folks who were not able to attend). However, it does mean that just because you were not personally involved in a discussion or did not see a long and tedious thread, you should not assume that no discussion has taken place at all. Back to my original e-mail: FreeBSD is a big project. I try to keep a pulse on as much of it as I can (mostly by reading/skimming a _lot_ of e-mail each day), but even with all that there is a lot going on that I don't know the intimate details of. Instead, I choose to trust my fellow developers to best manage the areas over which they have expertise and detailed knowledge until given strong evidence to assume otherwise. My humble suggestion to you would be to adopt a similar strategy. -- John Baldwin _______________________________________________ [hidden email] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "[hidden email]" |
| Powered by Nabble | Edit this page |
